Principal Data Processing Engineer-OSS

About the role

As a Principal Data Processing Engineer in the OSS (Operational Support Systems) team at Bamboohr, you will play a pivotal role in shaping the future of our data processing capabilities. This position is designed for an experienced professional who is passionate about leveraging data to drive operational excellence and enhance service delivery. You will collaborate with cross-functional teams to design, implement, and optimize data processing systems that support our innovative solutions in the cloud and data analytics space. This role offers a unique opportunity to influence the architecture and strategy of our data systems while working in a dynamic and fast-paced environment.

Key facts

What you'll do

• Lead the design and implementation of scalable data processing architectures that support high-volume data ingestion and real-time analytics.
• Collaborate with data scientists and software engineers to develop data pipelines that ensure data integrity and availability across various platforms.
• Optimize existing data processing workflows to improve performance and reduce latency, ensuring that our systems can handle increasing data loads efficiently.
• Conduct thorough analysis and troubleshooting of data processing issues, implementing solutions that enhance system reliability and performance.
• Mentor and guide junior engineers, fostering a culture of continuous learning and innovation within the team.
• Engage with stakeholders to gather requirements and translate them into technical specifications for data processing solutions.
• Evaluate and integrate new technologies and tools that can enhance our data processing capabilities, staying ahead of industry trends.
• Document processes, architectures, and best practices to ensure knowledge sharing and maintain high standards of data governance.
• Participate in code reviews and contribute to the development of best practices for data processing and engineering.
• Work closely with the DevOps team to ensure seamless deployment and monitoring of data processing systems in production environments.
• Collaborate with product management to align data processing initiatives with business objectives and customer needs.
• Contribute to the development of strategic roadmaps for data processing initiatives, aligning them with the overall goals of Bamboohr.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field; a Master's degree is preferred.
• A minimum of 7 years of experience in data engineering, data processing, or a related field, with a strong focus on OSS.
• Proficiency in programming languages such as Python, Java, or Scala, with experience in data processing frameworks like Apache Spark or Apache Flink.
• Solid understanding of database technologies, including SQL and NoSQL databases, and experience with data warehousing solutions.
• Familiarity with cloud platforms such as AWS, Google Cloud, or Azure, particularly in relation to data processing services.
• Strong analytical and problem-solving skills, with a proven ability to troubleshoot complex data issues.
• Excellent communication skills, with the ability to convey technical concepts to non-technical stakeholders.
• Experience with data governance and compliance standards, ensuring data quality and security.
• Proven track record of leading projects and working collaboratively in a team-oriented environment.

Nice to have

• Experience with machine learning frameworks and libraries, such as TensorFlow or PyTorch, is a plus.
• Knowledge of containerization technologies like Docker and orchestration tools such as Kubernetes.
• Familiarity with data visualization tools and techniques to present data insights effectively.
• Previous experience in a startup environment, demonstrating adaptability and a proactive approach to problem-solving.

Skills & tools

• Programming languages: Python, Java, Scala
• Data processing frameworks: Apache Spark, Apache Flink
• Database technologies: SQL, NoSQL
• Cloud platforms: AWS, Google Cloud, Azure
• Data governance and compliance standards
• Machine learning frameworks: TensorFlow, PyTorch (nice to have)
• Containerization: Docker, Kubernetes (nice to have)

Practical notes

• This position is based in Mountain View, California, and may require occasional travel for team meetings or conferences.
• The role may involve working outside of standard hours to accommodate project deadlines or system maintenance.
• Candidates must be eligible to work in the United States and may require visa sponsorship depending on their background.

META

Company: Bamboohr

Title: Principal Data Processing Engineer-OSS

Listed

location: Mountain View, California

Job type: Full-time

Apply URL: https://datapelago.bamboohr.com/careers/26

Tags: Engineering