Lead Data Engineer - Healthcare Data & Audience Applications

About the role

Zeta Global is on the lookout for a Lead Data Engineer to spearhead the development and enhancement of applications and data systems tailored for the healthcare sector. This position demands a hands-on approach to technical leadership in a fast-paced environment, focusing on distributed systems and data engineering while ensuring compliance with healthcare regulations. The ideal candidate will play a pivotal role in designing systems that seamlessly integrate audience data with campaign performance metrics, all while upholding stringent privacy and reliability standards.

Key facts

What you'll do

• Design and develop applications aimed at healthcare professionals, as well as direct-to-consumer audience segmentation and activation solutions.
• Construct scalable data pipelines that facilitate the ingestion and processing of extensive healthcare datasets.
• Develop identity resolution and data linkage services that unify diverse data sources effectively.
• Create reporting systems that correlate marketing campaigns with quantifiable outcomes.
• Design and implement APIs and services that support downstream analytics and partner integrations.
• Architect data structures specific to healthcare, including claims data, National Provider Identifier (NPI), and patient datasets.
• Build semantic cubes and governed views tailored for healthcare applications.
• Ensure compliance with HIPAA by implementing identity resolution and medical-code mapping processes.
• Develop core data products that enhance healthcare professional onboarding and analyze patient journeys effectively.

Requirements

• A minimum of 8 years of experience in data engineering, with a track record of progressive technical leadership roles.
• Proficient in SQL and skilled in either Python or Java, with a solid understanding of both batch and streaming data processing techniques.
• Proven experience in constructing and scaling data-intensive systems.
• Familiarity with regulated environments, particularly within the healthcare sector.
• Strong capabilities in system design and architecture.
• Ability to lead technical projects while actively participating in their implementation.
• Excellent collaboration skills, enabling effective work with cross-functional teams, including engineering and product management.

Nice to have

• Experience working with healthcare data providers or identity ecosystems.
• Knowledge of AdTech, MarTech, or platforms focused on audience and data management.
• Understanding of privacy-enhancing technologies, such as tokenization.
• Exposure to machine learning or AI-driven analytics systems would be advantageous.

Skills & tools

• Extensive experience in designing distributed systems, including microservices and event-driven architectures.
• Deep understanding of data modeling and storage systems, both OLTP and OLAP.
• Familiarity with data processing frameworks and technologies such as Kafka, Spark, or Flink.
• Proficient in backend development and API design, utilizing REST or gRPC protocols.
• Knowledge of workflow orchestration tools like Apache Airflow.
• Experience with data warehousing solutions, including Snowflake or Databricks.
• Strong grasp of cloud platforms (AWS, GCP, or Azure) and practices related to infrastructure as code.
• Familiarity with containerization technologies, such as Docker and Kubernetes.
• Experience with observability practices, including logging and metrics collection.
• Understanding of performance optimization and scalability considerations in system design.

Practical notes

The compensation for this role ranges from $180,000 to $200,000, contingent on the candidate's experience and geographical location. Zeta Global provides an array of benefits, including unlimited paid time off, comprehensive medical, dental, and vision insurance, equity options, and various employee perks such as wellness programs and pet insurance.

Zeta Global is committed to being an equal opportunity employer and evaluates applicants without regard to race, color, religion, age, disability, veteran status, or national origin. We strive to cultivate a workplace culture founded on trust and inclusion, encouraging all employees to express their authentic selves at work. For further details regarding our dedication to diversity and inclusion, please visit our website.

About the company

 Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently. Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI.