[Job - 30560] Sênior Data Developer (Dabricks
CiandtBrazilHomeoffice5d ago
PythonAzureCI/CDGitHub ActionsMongoDBMachine LearningAIETLSparkKafkaSQLPR
Job description
[Job - 30560] Sênior Data Developer (Dabricks at Ciandt.
About the role
Ciandt is hiring a Senior Data Developer to join a strategic project focused on large-scale data processing and cloud-based analytics. You will build and maintain data pipelines while evolving the company data platform using distributed processing technologies.
Key facts
What you'll do
- Design and manage data pipelines for ingestion, transformation, and integration across corporate systems.
- Develop solutions using Databricks, Python, PySpark, and SQL.
- Ensure the performance, scalability, and quality of all data processes.
- Handle data manipulation and integration in relational and non-relational environments like MongoDB.
- Monitor operational pipelines to identify and resolve technical issues.
- Support the evolution of data engineering architecture and internal processes.
- Assist in modeling and preparing information for business and technical stakeholders.
Requirements
- Proven professional background as a Senior Data Engineer or similar role.
- Advanced proficiency in Python for data engineering, automation, and AI-related tasks.
- Strong command of SQL for structured data exploration.
- Experience working with MongoDB.
- Hands-on expertise with Databricks, PySpark, and Spark.
- Experience building and optimizing scalable data pipelines.
- Background in cloud environments, specifically Azure Databricks.
- Knowledge of near real-time data processing, preferably with Kafka.
- Experience with MLOps and deploying Machine Learning models within Databricks.
- Proficiency in CI/CD workflows using GitHub and GitHub Actions.
- Familiarity with data engineering best practices including versioning, testing, and code reviews.
Nice to have
- Experience with data modeling and ETL/ELT pipeline construction.
- Understanding of Data Lake concepts and distributed processing.
- Work history in regulated industry environments.
- Practical use of AI tools such as GitHub Copilot, prompt engineering, and automated code review.
Skills & tools
- Databricks
- Python
- PySpark
- SQL
- MongoDB
- Azure
- Kafka
- GitHub Actions
- CI/CD
Practical notes
- Residents of the Campinas Metropolitan Region must work from the local office according to current attendance policies.
- Benefits include health and dental insurance, meal vouchers, daycare assistance, extended parental leave, and life insurance.
- Additional perks include PLR (profit sharing), Wellhub (Gympass/TotalPass), CI&T University access, language learning platforms, and wellness programs.
- Candidates with disabilities should provide a medical report during the selection process to ensure proper support and accommodations.