Senior Compute Platform Engineer
Job description
About the role
As a , you will be an integral part of the Data Platform team, focusing on the development and maintenance of the data infrastructure that underpins Zeta's innovative platform. Your role will revolve around enhancing the lakehouse architecture, ensuring that data processing is both efficient and scalable. This will empower engineers and analysts to tackle business challenges effectively, fostering a collaborative environment where data-driven decisions can thrive.
Key facts
What you'll do
- Design and implement new features within the frameworks and services that the team oversees, ensuring they meet high standards of performance and reliability.
- Work closely with data scientists to optimize their workflows, enhancing their productivity and overall experience with our tools.
- Analyze and identify areas for improvement in computational processes, driving efficiency and scalability.
- Actively contribute to open-source initiatives by submitting patches for enhancements or bug fixes in key technologies like Spark, Iceberg, and Hadoop.
- Serve as a subject matter expert in Spark and Scala, providing guidance and support to team members.
- Mentor junior engineers through collaborative coding sessions, design discussions, and knowledge-sharing initiatives to elevate team standards and practices.
- Collaborate with cross-functional teams to ensure seamless integration of data solutions across various platforms.
- Participate in code reviews, ensuring adherence to best practices and high-quality standards in software development.
- Stay updated with industry trends and emerging technologies, bringing innovative ideas to the team.
- Document processes and systems to facilitate knowledge transfer and ensure continuity in operations.
- Troubleshoot and resolve issues in the data infrastructure, maintaining high availability and performance.
- Engage in continuous learning and professional development to keep skills sharp and relevant in a fast-evolving field.
Requirements
- A minimum of 3 years of professional experience in software engineering, demonstrating a solid foundation in coding and system design.
- A bachelor's degree in Computer Science, Software Engineering, Physics, Mathematics, or a closely related field.
- At least 1 year of practical experience working with Scala or other JVM-based programming languages.
- Familiarity with Spark or similar frameworks for large-scale data processing is essential.
- Experience with Kubernetes is a plus, enhancing your ability to manage containerized applications.
- Basic knowledge of Amazon Web Services (AWS), including services like EC2, S3, and Athena.
- A keen interest in back-end technologies and architecture, coupled with a willingness to learn and adapt to new concepts.
- A background in mathematics, statistics, or advertising technology (adtech) is advantageous.
- Strong analytical capabilities and a pragmatic approach to problem-solving are crucial for success in this role.
- Ability to work autonomously in a dynamic environment where priorities may frequently change.
- Excellent communication skills, enabling you to articulate ideas and collaborate effectively with team members.
Nice to have
- Previous experience with Kubernetes, enhancing your ability to manage and deploy applications in a cloud environment.
- A genuine interest in mathematics, statistics, or adtech technology, contributing to a deeper understanding of the data landscape.
- Familiarity with additional data processing tools or languages that complement the existing tech stack.
Skills & tools
- Proficiency in Spark for large-scale data processing.
- Strong command of Scala as a primary programming language.
- Experience with Hadoop for distributed data storage and processing.
- Knowledge of Airflow for orchestrating complex data workflows.
- Familiarity with AWS services, including EC2, S3, and Athena for cloud-based data solutions.
Practical notes
This position is open to candidates who may require visa sponsorship. Zeta Global provides a comprehensive benefits package that includes health insurance and flexible working arrangements to support a healthy work-life balance. Interested applicants are encouraged to submit their applications by [insert application deadline]. Join us at Zeta Global to be part of a dynamic team that is shaping the future of data-driven solutions!
About the company
 Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently. Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform â powered by one of the industryâs largest proprietary databases and AI.