Senior Data Engineer
Job description
About the role
Chowdeck is seeking a talented and experienced Senior Data Engineer to join our dynamic team in Ikoyi, Lagos. In this role, you will play a crucial part in shaping our data infrastructure and driving data-driven decision-making across the organization. You will collaborate with cross-functional teams to design, build, and maintain scalable data pipelines and architectures that support our business objectives. If you are passionate about data engineering and want to make a significant impact in a fast-paced environment, we would love to hear from you.
Key facts
What you'll do
- Design, develop, and implement robust data pipelines to facilitate the collection, storage, and processing of large datasets from various sources.
- Collaborate with data scientists and analysts to understand their data needs and provide them with the necessary infrastructure to perform their analyses effectively.
- Optimize existing data architectures and workflows to improve performance, reliability, and scalability of data processing systems.
- Ensure data quality and integrity by implementing monitoring and validation processes throughout the data lifecycle.
- Work with cloud-based technologies and services to deploy and manage data solutions in a secure and efficient manner.
- Participate in code reviews and contribute to best practices in data engineering, ensuring high standards of code quality and documentation.
- Develop and maintain ETL (Extract, Transform, Load) processes to ensure timely and accurate data delivery to end-users.
- Stay up-to-date with industry trends and emerging technologies in data engineering, and recommend improvements to our data infrastructure.
- Mentor junior data engineers and provide guidance on technical challenges and career development.
- Collaborate with stakeholders to define data governance policies and ensure compliance with data privacy regulations.
- Participate in the design and implementation of data lakes and warehouses to support advanced analytics and reporting.
- Troubleshoot and resolve data-related issues, ensuring minimal disruption to business operations.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field; a Master's degree is a plus.
- A minimum of 5 years of experience in data engineering or a related role, with a strong focus on building data pipelines and architectures.
- Proficiency in programming languages such as Python, Java, or Scala, with experience in data processing frameworks like Apache Spark or Apache Flink.
- Strong knowledge of SQL and experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).
- Familiarity with cloud platforms such as AWS, Google Cloud, or Azure, particularly in relation to data storage and processing services.
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Understanding of data governance and data quality best practices.
- Excellent problem-solving skills and the ability to work independently as well as part of a team.
- Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
Nice to have
- Experience with data visualization tools such as Tableau, Power BI, or Looker.
- Knowledge of machine learning concepts and frameworks.
- Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes.
- Experience with data streaming technologies such as Apache Kafka or AWS Kinesis.
- Previous experience in a startup or fast-paced environment.
Skills & tools
- Programming Languages: Python, Java, Scala
- Data Processing Frameworks: Apache Spark, Apache Flink
- Databases: PostgreSQL, MySQL, MongoDB, Cassandra
- Cloud Platforms: AWS, Google Cloud, Azure
- ETL Tools: Apache NiFi, Talend, or similar
- Data Visualization: Tableau, Power BI, Looker
Practical notes
This position is based in Ikoyi, Lagos, and offers a competitive salary that reflects your experience and expertise. Chowdeck is committed to fostering a diverse and inclusive workplace and encourages applications from candidates of all backgrounds. We provide visa sponsorship for qualified candidates who may require it to work in Nigeria. If you are excited about the opportunity to contribute to a growing company and have a passion for data engineering, we invite you to apply through our careers page.
META
Company: Chowdeck
Title: Senior Data Engineer
Listed
location: Ikoyi, Lagos
Job type: Full-time
About the company
Order food, groceries, drinks, medicines & everyday essentials from top restaurants, pharmacies, local markets, and stores near you. Fast delivery with Chowdeck.