Senior Data Engineer

About the role

As a Senior Data Engineer at Bamboohr, you will play a role in shaping the data architecture and engineering practices that drive our innovative solutions. You will collaborate with cross-functional teams to design, build, and maintain data pipelines that support our analytics and machine learning initiatives. This position is ideal for someone who is about data and has a strong background in engineering principles, eager to tackle complex challenges in a dynamic environment.

Key facts

What you'll do

• Design and implement scalable data pipelines that efficiently process large volumes of data from various sources.
• Collaborate with data scientists and analysts to understand their data needs and translate them into technical specifications.
• Optimize existing data workflows for performance and reliability, ensuring high availability and low latency.
• Develop and maintain data models that support business intelligence and reporting initiatives.
• Monitor data quality and implement validation checks to ensure the integrity of data throughout the pipeline.
• Work with cloud-based data storage solutions, such as AWS, Azure, or Google Cloud, to manage and store data effectively.
• Participate in code reviews and provide mentorship to junior data engineers, fostering a culture of continuous learning and improvement.
• Stay updated on industry trends and emerging technologies in data engineering, recommending best practices and tools for the team.
• Document data processes and architectures to ensure clarity and facilitate knowledge sharing within the team.
• Troubleshoot and resolve data-related issues, providing timely solutions to maintain operational efficiency.
• Collaborate with DevOps teams to integrate data solutions into CI/CD pipelines, enhancing deployment processes.
• Engage in agile methodologies, participating in sprint planning and retrospectives to improve team performance and project outcomes.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree is a plus.
• A minimum of 5 years of experience in data engineering or a related role, with a proven track record of building data pipelines.
• Proficiency in programming languages such as Python, Java, or Scala, with a strong understanding of data structures and algorithms.
• Experience with ETL (Extract, Transform, Load) processes and tools, such as Apache Airflow, Talend, or similar technologies.
• Familiarity with relational and NoSQL databases, including SQL, MongoDB, or Cassandra, and experience in writing complex queries.
• Knowledge of cloud platforms (AWS, Azure, or Google Cloud) and their data services, such as Redshift, BigQuery, or Snowflake.
• Strong understanding of data warehousing concepts and experience in designing data models for analytical purposes.
• Excellent problem-solving skills and the ability to work independently as well as collaboratively within a team.
• Strong communication skills, with the ability to convey technical concepts to non-technical stakeholders.
• Experience with data visualization tools, such as Tableau or Power BI, is a plus.

Nice to have

• Familiarity with machine learning concepts and experience working with data scientists on predictive modeling projects.
• Knowledge of containerization technologies, such as Docker or Kubernetes, to facilitate deployment and scaling of data solutions.
• Experience with streaming data technologies, such as Apache Kafka or AWS Kinesis, for real-time data processing.
• Understanding of data governance and compliance standards, ensuring data privacy and security.

Skills & tools

• Programming Languages: Python, Java, Scala
• Data Processing: Apache Spark, Apache Airflow
• Databases: SQL, NoSQL (MongoDB, Cassandra)
• Cloud Platforms: AWS, Azure, Google Cloud
• Data Warehousing: Redshift, BigQuery, Snowflake
• Data Visualization: Tableau, Power BI
• Version Control: Git

Practical notes

• The exact location for this position is currently unspecified, but candidates should be open to remote work or relocation.
• Competitive salary will be offered based on experience and qualifications.
• Bamboohr is committed to fostering a diverse and inclusive workplace and encourages applicants from all backgrounds to apply.
• Interested candidates can apply through the provided link: https://xscion.bamboohr.com/careers/436.

Join Bamboohr as a Senior Data Engineer and contribute to our mission of leveraging data to drive impactful solutions. We look forward to welcoming a talented individual who is ready to make a difference in our data-driven journey.