Software Engineer 3
Job description
About the role
MongoDB is leading the charge in transforming data management, empowering developers to craft groundbreaking applications. We are on the lookout for a Software Engineer 3 to become a vital part of our Data Pipelines Engineering team based in Gurugram, India. This position focuses on the development and maintenance of ETL pipelines that are essential for our Internal Data Platform, ensuring that analytics are efficient and data is easily accessible.
Key facts
What you'll do
- Design, implement, and maintain robust ETL/ELT pipelines utilizing Python and Spark, catering to diverse data architectures such as batch processing, file-based systems, and streaming data.
- Guarantee the accuracy and timely delivery of data through pipelines by following established best practices in data engineering.
- Structure and store large datasets using contemporary file formats like Parquet, JSON, and Avro, as well as table formats including Iceberg and Hive.
- Deploy data pipelines on cloud platforms, primarily leveraging AWS, with occasional use of GCP.
- Partner with Data Analysts and Data Scientists to understand their requirements and provide the necessary datasets for their analytical tasks.
- Collaborate with Security and Compliance teams to ensure that datasets are managed in accordance with appropriate permissions and regulatory requirements.
- Work closely with our Data Platform and Governance teams to improve data scalability, usability, and discoverability.
- Participate in code reviews and contribute to team knowledge sharing to foster a culture of continuous improvement.
Requirements
- At least 4 years of experience in creating ETL pipelines for Data Lakes or Data Warehouses.
- Strong proficiency in Python, Spark, SQL, and Airflow.
- In-depth understanding of data warehousing and engineering principles, including analytical data modeling, data quality validation, and monitoring practices.
- Familiarity with big data management technologies such as Hive, Iceberg, and Glue.
- Knowledge of various big data file formats, including Parquet, Avro, and JSON.
- Experience in developing data platforms using cloud services (AWS, GCP, or Azure).
- Exposure to real-time or streaming data technologies is a plus.
- Excellent problem-solving skills and the ability to work collaboratively in a team environment.
Nice to have
- Experience with containerization technologies such as Docker and Kubernetes.
- Familiarity with data governance frameworks and best practices.
- Understanding of machine learning concepts and their application in data engineering.
Skills & tools
- Proficient in programming languages such as Python and SQL.
- Experienced with data processing frameworks like Apache Spark.
- Familiar with cloud services, particularly AWS and GCP.
- Knowledgeable in data modeling and data architecture principles.
- Strong analytical skills and attention to detail.
Practical notes
- This position is based in Gurugram, India, and follows a hybrid work model, allowing flexibility in work arrangements.
- The salary for this role is competitive and commensurate with experience.
- MongoDB is committed to supporting employees with diverse backgrounds and experiences, and we encourage applications from all qualified individuals.
- We provide accommodations for candidates with disabilities throughout the application and interview process. Please inform your recruiter if you require any assistance.
META
Company: MongoDB
Title: Software Engineer 3
Listed
location: Gurugram
About MongoDB
MongoDB empowers both customers and employees to innovate swiftly, reshaping the data platform landscape for the AI era. Our unified data platform aids organizations in modernizing outdated systems and embracing new technologies. MongoDB Atlas, our cloud-native platform, is globally distributed and accessible across major cloud providers, including AWS, Google Cloud, and Microsoft Azure.
With a worldwide footprint and over 67,000 customers, including a substantial number of Fortune 100 companies, MongoDB is at the forefront of the next wave of software development. We prioritize a supportive and enriching workplace culture, offering a variety of employee benefits, including fertility assistance and generous parental leave policies.
MongoDB is an equal opportunity employer, dedicated to fostering an inclusive environment for all employees. We welcome applications from individuals of all backgrounds and experiences.