Senior Lead Data Engineer

About the role

Bamboohr is seeking a highly experienced Senior Lead Data Engineer to join our dynamic team. This role is pivotal in shaping our data architecture and driving data-driven decision-making across the organization. As a Senior Lead Data Engineer, you will be responsible for designing and implementing robust data pipelines and systems that support our analytics and business intelligence initiatives. You will collaborate closely with cross-functional teams to ensure that our data infrastructure meets the evolving needs of the business while maintaining high standards of data quality and security.

Key facts

What you'll do

• Design, develop, and maintain scalable data pipelines that facilitate the collection, storage, and processing of large datasets.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical specifications.
• Lead the architecture and implementation of data warehouses and data lakes, ensuring optimal performance and reliability.
• Implement data governance and security best practices to protect sensitive information and ensure compliance with relevant regulations.
• Optimize existing data processes and workflows to improve efficiency and reduce latency in data availability.
• Mentor and guide junior data engineers, fostering a culture of continuous learning and improvement within the team.
• Conduct code reviews and provide constructive feedback to ensure adherence to best practices and coding standards.
• Stay updated with the latest industry trends and technologies in data engineering, and evaluate their potential application within the organization.
• Collaborate with DevOps teams to automate deployment processes and enhance the overall data infrastructure.
• Participate in strategic planning sessions to align data initiatives with business objectives and drive innovation.
• Troubleshoot and resolve data-related issues, ensuring minimal disruption to business operations.
• Document data architecture, processes, and workflows to maintain clear and comprehensive records for future reference.

Requirements

• A minimum of 5 years of experience in data engineering or a related field, with a proven track record of designing and implementing data solutions.
• Strong proficiency in programming languages such as Python, Java, or Scala, with experience in data manipulation and transformation.
• Extensive experience with data warehousing technologies, such as Snowflake, Amazon Redshift, or Google BigQuery.
• Familiarity with ETL tools and frameworks, such as Apache Airflow, Talend, or Informatica.
• Solid understanding of database management systems, including SQL and NoSQL databases.
• Experience with cloud platforms like AWS, Azure, or Google Cloud, particularly in relation to data storage and processing.
• Knowledge of data governance frameworks and best practices for data security and compliance.
• Excellent problem-solving skills and the ability to work independently as well as collaboratively in a team environment.
• Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

Nice to have

• Experience with big data technologies such as Apache Hadoop, Spark, or Kafka.
• Familiarity with machine learning concepts and tools, enabling collaboration with data science teams.
• Knowledge of data visualization tools like Tableau, Power BI, or Looker to support analytics initiatives.
• Previous experience in a leadership or mentoring role within a data engineering team.
• Understanding of Agile methodologies and experience working in an Agile environment.

Skills & tools

• Programming Languages: Python, Java, Scala
• Data Warehousing: Snowflake, Amazon Redshift, Google BigQuery
• ETL Tools: Apache Airflow, Talend, Informatica
• Cloud Platforms: AWS, Azure, Google Cloud
• Databases: SQL, NoSQL
• Big Data Technologies: Apache Hadoop, Spark, Kafka
• Data Visualization: Tableau, Power BI, Looker

Practical notes

• This position is based in either Glasgow or Newbury / Reading, Berkshire, and candidates should be prepared to work on-site as required.
• The role may involve occasional travel to other company locations or client sites.
• Bamboohr is committed to fostering a diverse and inclusive workplace, and we encourage applications from individuals of all backgrounds.
• Interested candidates can apply through our careers page at [Bamboohr Careers](https://fsp.bamboohr.com/careers/310).

META

Company: Bamboohr

Title: Senior Lead Data Engineer

Listed

location: Glasgow or Newbury / Reading, Berkshire

Job type: Full-time