[Job - 30813] Senior Data Developer
CiandtColombiaHomeoffice2d ago
AIStrategySolutionsremotecurated-jd
Job description
[Job - 30813] Senior Data Developer at Ciandt.
About the role
Ciandt is looking for a Senior Data Developer to manage a critical data platform focused on business analytics and reporting. This role requires a technical expert to oversee the full Databricks medallion architecture while providing leadership and guidance to the development team.
Key facts
What you'll do
- Develop and maintain data pipelines across Bronze, Silver, and Gold layers.
- Design dimensional modeling artifacts including facts, dimensions, and slowly changing dimensions.
- Perform code reviews and ensure architectural consistency across the platform.
- Manage deployments across Dev, QA, UAT, and PROD environments.
- Monitor production jobs and troubleshoot performance issues using platform diagnostic tools.
- Maintain automated testing pipelines and CI/CD workflows.
- Provide technical mentorship and serve as the primary reference for platform expertise.
- Collaborate with stakeholders to translate business requirements into scalable data solutions.
Requirements
- Proven production experience working with the Databricks platform.
- Advanced proficiency in PySpark, including DataFrame API, Spark SQL, and window functions.
- Strong command of Databricks SQL, specifically ANSI SQL, MERGE, and CTEs.
- Experience with Delta Lake features such as ACID transactions, time travel, and table maintenance.
- Background in implementing star schemas and slowly changing dimensions.
- Familiarity with Unity Catalog, notebook-based development, and Azure services like Data Lake Storage and Key Vault.
- Ability to navigate and contribute to large, established codebases of 400+ notebooks.
- C1 level English proficiency for direct communication with US-based stakeholders.
Nice to have
- Experience with Databricks Asset Bundles or Infrastructure-as-Code.
- Knowledge of Delta Live Tables and Databricks Genie.
- Familiarity with data quality frameworks like Great Expectations or Soda Core.
- Proficiency with pytest and databricks-connect.
- Experience with schema migration tools and AI-assisted development tools like GitHub Copilot or Cursor.
Skills & tools
- Databricks
- PySpark
- Delta Lake
- Azure DevOps
- Git
- Dimensional Modeling
- Unity Catalog
- Azure Services
Practical notes
Benefits include premium healthcare, meal vouchers, maternity and parental leave, mobile service subsidies, life insurance, sick pay, access to Ciandt University, Colombian holidays, and paid vacation time.