[Job-30821] Data Engineer

About the role

Ciandt is looking for a Senior Data Developer to join our team in Brazil. You will manage data systems on Azure and focus on incident resolution, system optimization, and the creation of operational documentation.

Key facts

What you'll do

• Diagnose and resolve Level 3 incidents to maintain system stability.
• Execute rollbacks to restore operations and reduce downtime.
• Develop and update runbooks and Standard Operating Procedures.
• Promote a Shift Left approach by setting documentation standards.
• Conduct corrective maintenance to keep data systems performing well.
• Improve monitoring and observability to increase ecosystem reliability.
• Lead post-mortem reviews to determine incident root causes and implement preventative measures.

Requirements

• Proficiency in Python and PySpark.
• Experience working with Databricks and Azure.
• Advanced SQL capabilities.
• Familiarity with unit testing, Git, and SCM/CI practices.
• Ability to troubleshoot complex system issues.
• Experience writing and implementing SOPs and runbooks.
• Proven background in monitoring and observability practices.
• Advanced English language skills.

Nice to have

• Understanding of data architecture principles.
• Knowledge of data pipeline best practices.

Skills & tools

• Python
• PySpark
• Azure
• Databricks
• SQL
• Git
• SCM/CI
• Monitoring and Observability tools

Practical notes

Ciandt fosters a diverse and inclusive work environment and encourages applications from underrepresented groups.