Principal Data Processing Engineer

About the role

As a Principal Data Processing Engineer at Bamboohr, you will play a pivotal role in shaping the future of data processing within our organization. This position is designed for an experienced professional who is passionate about leveraging data to drive business decisions and enhance operational efficiency. You will lead a team of engineers and collaborate with cross-functional teams to develop innovative data processing solutions that meet the needs of our clients and stakeholders. Your expertise will be instrumental in optimizing our data architecture and ensuring the integrity and availability of our data systems.

Key facts

What you'll do

• Lead the design and implementation of scalable data processing systems that can handle large volumes of data efficiently.
• Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and translate them into technical requirements.
• Develop and maintain data pipelines to ensure the timely and accurate processing of data from various sources.
• Optimize existing data processing workflows to improve performance and reduce latency.
• Monitor and troubleshoot data processing issues, implementing solutions to prevent future occurrences.
• Establish best practices for data governance, ensuring data quality and compliance with relevant regulations.
• Mentor and guide junior engineers, fostering a culture of continuous learning and improvement within the team.
• Stay updated on industry trends and emerging technologies related to data processing and analytics, and evaluate their potential application within Bamboohr.
• Collaborate with IT and infrastructure teams to ensure the reliability and security of data systems.
• Document processes, architectures, and workflows to maintain clear communication and knowledge sharing across the organization.
• Participate in strategic planning sessions to align data processing initiatives with overall business objectives.
• Contribute to the development of internal tools and frameworks that enhance data processing capabilities.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field; a Master's degree is preferred.
• A minimum of 7 years of experience in data processing, data engineering, or a related role.
• Proficiency in programming languages such as Python, Java, or Scala, with a strong understanding of data structures and algorithms.
• Extensive experience with data processing frameworks such as Apache Spark, Apache Flink, or similar technologies.
• Solid understanding of database technologies, including SQL and NoSQL databases, and experience with data warehousing solutions.
• Familiarity with cloud platforms like AWS, Google Cloud, or Azure, particularly in relation to data storage and processing services.
• Strong analytical and problem-solving skills, with the ability to work independently and as part of a team.
• Excellent communication skills, capable of conveying complex technical concepts to non-technical stakeholders.
• Experience with data visualization tools and techniques is a plus.

Nice to have

• Knowledge of machine learning concepts and frameworks, such as TensorFlow or PyTorch.
• Experience with containerization technologies like Docker and orchestration tools such as Kubernetes.
• Familiarity with data privacy regulations, such as GDPR or CCPA, and their implications for data processing.

Skills & tools

• Programming Languages: Python, Java, Scala
• Data Processing Frameworks: Apache Spark, Apache Flink
• Databases: SQL (PostgreSQL, MySQL), NoSQL (MongoDB, Cassandra)
• Cloud Platforms: AWS, Google Cloud, Azure
• Data Visualization: Tableau, Power BI, or similar tools
• Version Control: Git

Practical notes

This position is based in Mountain View, California, and offers a competitive salary that reflects your experience and expertise. Bamboohr is committed to fostering a diverse and inclusive workplace, and we encourage applications from individuals of all backgrounds. We are open to sponsoring visas for qualified candidates who meet our requirements. If you are passionate about data processing and want to make a significant impact in a dynamic environment, we would love to hear from you.

To apply for this exciting opportunity, please visit our careers page at [Bamboohr Careers](https://datapelago.bamboohr.com/careers/52). We look forward to your application!