[Job - 30760] Master Data Developer, Brazil

About the role

Ciandt is looking for a skilled Data Developer to advance modern data platforms for our enterprise clients. You will focus on building and refining scalable data pipelines and lake architectures within the AWS ecosystem to support data-driven business decisions.

Key facts

What you'll do

• Create and manage ETL/ELT workflows to move and transform data across Data Lake architectures.
• Use Python and PySpark to process large-scale datasets.
• Apply partitioning techniques in storage frameworks like Delta Lake or Apache Iceberg to manage costs and performance.
• Write and tune advanced SQL queries using window functions, CTEs, and aggregations.
• Move data pipelines from traditional RDBMS to cloud-native environments.
• Use object-oriented programming to build reusable internal code libraries.
• Operate AWS services including Glue, Athena, Redshift, S3, Lambda, and EventBridge.
• Use Infrastructure as Code tools like CloudFormation, CDK, or Terraform to manage resources.
• Track pipeline health and performance using CloudWatch and other observability tools.
• Maintain data governance, integrity, and cataloging standards.
• Collaborate with stakeholders to turn business needs into technical solutions.

Requirements

• Proven experience in ETL and data pipeline development on AWS.
• Advanced proficiency in Python and PySpark for distributed data processing.
• Deep SQL expertise, including complex query construction and legacy RDBMS migration.
• Practical experience with AWS Glue, Athena, and Redshift.
• Understanding of Data Lake architecture and storage optimization.
• Familiarity with object-oriented programming principles.
• Ability to work with Git, Shell scripts, and Linux.
• Knowledge of monitoring and observability practices.
• Advanced or fluent English skills.

Nice to have

• Experience with Delta Lake or Apache Iceberg.
• Proficiency in TypeScript.
• Skills in Infrastructure as Code, specifically CloudFormation.
• Exposure to AWS SageMaker, ECS, RDS, DynamoDB, or IAM.
• Experience with Pandas.
• Background in machine learning or AI-integrated data projects.

Skills & tools

• AWS (Glue, Athena, Redshift, S3, Lambda, EventBridge, CloudFormation)
• Python, PySpark, SQL, TypeScript, Pandas
• Git, Shell, Linux
• Data Lake architectures, ETL/ELT
• Delta Lake, Apache Iceberg

Practical notes

• Benefits include health and dental insurance, meal/food allowances, life insurance, and profit sharing.
• Support for parents includes childcare assistance, extended paternity leave, and pregnancy/parenting courses.
• Wellness perks include Wellhub/TotalPass, gym partnerships, and mental health platforms.
• Professional development is supported via CI&T University and external learning partnerships.
• CI&T provides accommodations for people with disabilities; please provide your assessment during the application process.