Staff Data Engineer
Job description
About the role
The Data Engineering team at MongoDB is integral to the development of ETL pipelines that support the Internal Data Platform, which is essential for analytics aimed at improving operational efficiency. This team is dedicated to designing scalable and high-performance systems capable of managing extensive datasets, ensuring they are accessible for effective querying and analysis.
Key facts
What you'll do
- Spearhead the Data Engineering team in designing and implementing efficient ETL pipelines using Spark and various Big Data technologies.
- Play a key role in the architectural design of the Internal Data Platform, focusing on a robust medallion architecture.
- Provide strategic recommendations for optimizing cloud infrastructure costs.
- Create AI-driven agents to automate routine development and support tasks within the team.
- Collaborate closely with Security and Compliance teams to ensure that datasets meet necessary permissions and regulatory standards.
- Work alongside the Data Platform and Governance teams to improve the scalability, usability, and discoverability of data assets.
- Mentor junior engineers, fostering a culture of continuous learning and improvement within the team.
- Analyze and troubleshoot data pipeline issues, ensuring high availability and performance.
- Engage with cross-functional teams to gather requirements and translate them into technical specifications.
- Stay updated with the latest industry trends and technologies to continuously enhance the team's capabilities.
- Document processes and best practices to ensure knowledge sharing and maintain high standards of quality.
- Participate in code reviews to uphold coding standards and improve team productivity.
Requirements
- A minimum of 10 years of experience in managing enterprise data lakes or warehouses.
- At least 5 years of practical experience with Spark and Python programming.
- A solid 5 years of experience working directly with cloud platforms such as AWS or GCP.
- In-depth knowledge of AI technologies, particularly in the context of code generation tools and agentic frameworks.
- Familiarity with big data technologies such as Hive, Iceberg, Glue, or similar tools that facilitate table-like access to large datasets.
- Understanding of various big data file formats, including Parquet, Avro, and JSON.
- Experience with real-time or streaming data technologies is a plus.
- Strong problem-solving skills and the ability to work independently as well as part of a team.
- Excellent communication skills, both verbal and written, to effectively convey complex technical concepts.
Nice to have
- Experience with data governance frameworks and best practices.
- Knowledge of data visualization tools and techniques.
- Familiarity with machine learning concepts and their application in data engineering.
- Previous experience in a leadership or mentoring role within a technical team.
- Understanding of data privacy regulations and compliance standards.
Skills & tools
- Proficient in programming languages such as Python and Scala.
- Extensive experience with ETL tools and frameworks.
- Knowledge of cloud services and infrastructure management.
- Familiarity with containerization technologies like Docker and orchestration tools such as Kubernetes.
- Strong analytical skills and experience with data modeling techniques.
Practical notes
- The position is based in Gurugram, with a hybrid work model that allows for a blend of remote and in-office work.
- Competitive salary and benefits package, commensurate with experience.
- Visa sponsorship may be available for qualified candidates.
- Candidates should be prepared to demonstrate their technical skills through assessments or coding challenges during the interview process.
META
Company: MongoDB
Title: Staff Data Engineer
Listed
location: Gurugram
At MongoDB, we are committed to fostering an inclusive and diverse workplace. Our Leadership Commitment shapes our interactions and decision-making, creating a supportive environment for all employees. We offer various benefits, including employee affinity groups, fertility assistance, and generous parental leave policies, reflecting our dedication to employee well-being. Join us in our mission to drive innovation and make a meaningful impact in the tech industry.
MongoDB is an equal opportunity employer and is dedicated to providing necessary accommodations for individuals with disabilities throughout the application and interview process. If you require assistance due to a disability, please inform your recruiter.
Requisition ID
1273422593