Lead Data Engineer

About the role

You will design modern data architectures and provide end-to-end solutions to solve complex business challenges for our clients. This role involves leading technical teams through project inception, hands-on coding, and the implementation of scalable data systems.

Key facts

What you'll do

• Manage data engineering projects from initial scope to final delivery while coordinating across teams.
• Partner with stakeholders to align technical strategy with business goals and data quality standards.
• Build and maintain intricate data processing pipelines.
• Work alongside data scientists to create scalable model implementations.
• Write iterative, clean code using Test Driven Development and continuous delivery practices.
• Advise clients on selecting appropriate distributed storage and computing technologies.
• Develop and implement data models using suitable technology stacks.
• Maintain data governance, security, and privacy standards.
• Define and integrate data quality strategies into daily workflows.

Requirements

• Proven experience leading system design and technical implementations.
• Deep expertise in Big Data architecture, distributed systems, and data pipeline operations.
• Proficiency in data modeling and modern data engineering platforms.
• Hands-on experience with Python (must have), Spark, and big data processing.
• Experience with at least one cloud platform (AWS, Azure, or GCP).
• Ability to build and deploy large-scale, data-centric applications in production.
• Experience with various database types including SQL, NoSQL, and data lakes.
• Strong communication skills with the ability to present data insights to diverse audiences.
• Ability to manage stakeholders, navigate ambiguity, and resolve conflicts.
• Experience mentoring and coaching team members to foster professional growth.
• Must be a Thai Citizen.

Nice to have

• Experience with Databricks.

Skills & tools

• Python
• Spark
• AWS, Azure, or GCP
• Databricks
• SQL and NoSQL
• Distributed storage and computing platforms
• Data modeling
• Data visualization
• Continuous delivery practices
• TDD

Practical notes

• This is an onsite role in Bangkok.
• Due to project requirements, this position is restricted to Thai Citizens.
• Thoughtworks uses AI for administrative recruitment tasks, but all hiring decisions are made by human interviewers.