Senior Lead Data Engineer (BODS)
Brillio 2IndiaEmployee1w ago
Engineeringremotecurated-jd
Job description
Senior Lead Data Engineer (BODS) at Brillio 2.
About the role
This role involves taking full responsibility for Enterprise Data Warehouse (EDW) solutions, from design to optimization. You will build and improve data pipelines using various technologies, ensuring they are scalable and secure. This position requires both technical skill and the ability to guide a team in data engineering practices.
Key facts
What you'll do
- Design and implement data integration and transformation frameworks for the EDW.
- Architect and optimize ETL/ELT pipelines using SAP BODS and IBM DataStage.
- Develop and maintain robust data models, including Star/Snowflake schemas and SCD implementations.
- Ensure high availability, reliability, and performance of data pipelines.
- Implement data governance, security, and compliance standards.
- Develop complex data workflows and transformations.
- Perform performance tuning of ETL jobs and SQL queries.
- Optimize batch processing and scheduling using Redwood.
- Implement error handling, logging, and monitoring mechanisms.
- Manage incremental loads and data reconciliation processes.
- Write and optimize complex SQL queries, stored procedures, and functions.
- Work extensively with Oracle databases and related technologies.
- Design and manage indexing strategies and query optimization.
- Support database performance analysis and tuning.
- Lead and mentor a team of data engineers.
- Conduct code reviews and enforce development standards.
- Drive technical best practices and architecture governance.
- Collaborate with BI, Analytics, and Application teams.
- Participate in sprint planning, estimation, and technical roadmap discussions.
- Work closely with business stakeholders to gather and translate requirements into technical solutions.
- Provide technical guidance and solution recommendations.
- Ensure alignment between enterprise data strategy and business goals.
- Support production issue resolution and root cause analysis.
Requirements
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
- 5+ years of experience in Data Engineering.
- 2+ years of experience in leading technical teams.
- Strong experience with SAP BODS.
- Hands-on experience with IBM DataStage.
- Experience with Redwood scheduling.
- Advanced SQL development skills.
- Strong expertise in Oracle database.
- Deep understanding of Enterprise Data Warehouse architecture.
- Knowledge of data modeling (Star/Snowflake schema, SCD Types).
- Understanding of ETL/ELT best practices.
- Familiarity with data quality frameworks.
- Experience with performance tuning and optimization.
- Knowledge of data security and governance standards.
- Strong architectural and analytical skills.
- Leadership and mentoring capability.
- Excellent communication and stakeholder management skills.
- Problem-solving mindset.
- Ability to drive enterprise-scale data initiatives.
Nice to have
- Experience with modern cloud data platforms (Azure, AWS, GCP).
- Knowledge of Snowflake, Databricks, or Synapse.
- CI/CD implementation for data pipelines.
- Exposure to data cataloging and metadata management tools.
- Experience in Agile/Scrum methodologies.
Skills & tools
- SAP BODS
- IBM DataStage
- Redwood
- SQL
- Oracle
- CI/CD Pipeline
- CSS/SCSS/LESS
- PyTest
- PostgreSQL
- MongoDB
- Redis
- REST API
- GraphQL
- Python Fullstack with Microservices
Practical notes
- This is an L3 support project.
- Flexibility to work in rotational shifts is mandatory.