Data Engineering Manager

About the role

Kami is seeking a skilled Data Engineering Manager to lead our data engineering team in Auckland. This role is pivotal in shaping our data strategy and ensuring that our data infrastructure supports our business objectives. You will be responsible for overseeing the design, development, and maintenance of data pipelines and systems that enable data-driven decision-making across the organization. As a leader in this space, you will mentor a team of data engineers and collaborate with cross-functional teams to enhance our data capabilities.

Key facts

What you'll do

• Lead and manage a team of data engineers, providing guidance and support to foster their professional growth and development.
• Design and implement robust data architectures that facilitate the efficient collection, storage, and processing of large datasets.
• Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and ensure that the data infrastructure meets those requirements.
• Oversee the development of ETL (Extract, Transform, Load) processes to ensure high-quality data is available for analysis and reporting.
• Monitor and optimize data pipelines for performance, reliability, and scalability, ensuring they can handle increasing data volumes.
• Establish best practices for data governance, security, and compliance, ensuring that data handling meets industry standards and regulations.
• Drive the adoption of modern data technologies and tools, evaluating new solutions to enhance our data capabilities.
• Develop and maintain documentation for data processes, architectures, and workflows to ensure transparency and knowledge sharing within the team.
• Participate in strategic planning and decision-making processes related to data initiatives, aligning data engineering efforts with business goals.
• Foster a culture of innovation and continuous improvement within the data engineering team, encouraging experimentation and new ideas.
• Engage with external partners and vendors to explore new technologies and solutions that can enhance our data infrastructure.
• Report on team performance and project progress to senior management, providing insights and recommendations for future initiatives.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field; a Master's degree is a plus.
• A minimum of 5 years of experience in data engineering or a related field, with at least 2 years in a leadership role.
• Strong proficiency in programming languages such as Python, Java, or Scala, and experience with SQL for data manipulation.
• Extensive experience with data warehousing solutions and ETL tools, such as Apache Airflow, Talend, or similar technologies.
• Familiarity with cloud platforms like AWS, Google Cloud, or Azure, and experience in deploying data solutions in a cloud environment.
• Knowledge of data modeling, database design, and data governance best practices.
• Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment.
• Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
• Proven track record of managing projects and delivering results on time and within budget.

Nice to have

• Experience with big data technologies such as Hadoop, Spark, or Kafka.
• Familiarity with machine learning concepts and tools, enabling collaboration with data science teams.
• Knowledge of data visualization tools like Tableau or Power BI for reporting and analysis.
• Experience in Agile methodologies and project management frameworks.
• Previous experience in the education technology sector or similar industries.

Skills & tools

• Data engineering: ETL processes, data warehousing, data modeling
• Programming: Python, Java, Scala, SQL
• Cloud platforms: AWS, Google Cloud, Azure
• Data governance and compliance
• Project management and team leadership

Practical notes

• This position is based in Auckland, and candidates must be willing to work from the office as required.
• Kami offers competitive salary packages and benefits, including opportunities for professional development and growth.
• The role may involve occasional travel for team meetings or conferences, depending on business needs.
• Interested candidates can apply through the provided link, and we encourage applications from diverse backgrounds.

Join Kami and be part of a team that is transforming the education landscape through innovative data solutions. We look forward to your application!