Program Manager, Quality

About the role

You will architect and own the end-to-end quality strategy for critical human data projects that directly train frontier AI models. The role centers on designing automated evaluation frameworks using LLMs and databases to assess dataset quality and root-cause issues before delivery. You will manage a distributed team of over thirty quality control specialists, coaching them to maintain high standards across all engagements. Your work will translate complex operational findings into clear insights for leadership and cross-functional partners. You will be accountable for key project outcomes from ideation through detailed audit delivery. This position operates at the intersection of technical systems and human judgment in a fast-paced environment. You will collaborate closely with engineering, account operations, and AI companies shaping next-generation systems.

Key facts

Location: USA

Engagement: Full-time

Compensation: Base cash comp from $120K-$200k

Aggressive bi-annual performance bonus structure

Generous equity grant vested over 4 years

$15K relocation bonus (for moving to the Bay Area)

$10K housing bonus (if you live within 0.5 miles of our office)

$1.5K monthly stipend for meals

Free Equinox membership

$200 monthly laundry reimbursement

$200 monthly personal wellness reimbursement

Health, Dental, Vision insurance

What you'll do

Own quality programs for designated accounts or projects across diverse human data domains.

End-to-end ownership of outcomes for quality programs, from initial brainstorming and operational execution to final delivery of audit results and strategic insights.

Develop technical solutions to auto-evaluate the quality of datasets and proactively identify root causes of defects.

Identify opportunities for automation and technical simplification, leveraging LLMs, databases, and scripting to streamline workflows.

Devise systems to evaluate auditor and human data talent performance, ensuring strict adherence to quality standards and highlighting process improvement areas.

Report on quality metrics through regular monitoring and maintenance of key performance indicators critical to client deliverables.

Develop, update, and present leadership-facing reports that inform company operations and strategy on human data deliveries.

Work cross-functionally with engineering, account operations, and other stakeholders to execute on delivering SLAs for high-priority projects.

Hire and maintain a workforce of over thirty auditors, focusing on recruitment, coaching, and development to drive impactful outcomes.

Translate complex operational findings into clear, actionable insights for leadership and cross-functional partners.

Implement scalable solutions to difficult operational problems, often requiring deep engagement with projects to uncover underlying issues.

Champion a data-first approach in problem-solving, balancing qualitative context with quantitative analysis to drive decisions.

Ensure consistent quality across distributed teams while maintaining alignment with client expectations and company standards.

Act as a key liaison between technical teams and domain experts to refine evaluation criteria and improve system accuracy.

Requirements

3+ years of experience owning high-impact technical and operational outcomes in similar quality or operations roles.

A strong bias for being results-driven, with entrepreneurial experience in building systems from scratch under pressure.

Exceptional communication skills tailored to leadership, strategic project leads, cross-functional stakeholders, and a distributed auditor workforce.

Demonstrated ability to develop scalable solutions for complex operational problems, including hands-on approaches to root-cause analysis.

Robust project management experience managing distributed teams, prioritizing ruthlessly, and thriving in high-urgency environments.

A data-first approach to problem-solving, with proven qualitative and quantitative analytical skills in operational contexts.

Commitment to maintaining rigorous quality standards while iterating quickly in fast-paced, evolving project scopes.

Ability to manage multiple concurrent initiatives and deliverables without compromising accuracy or team development.

Nice to have

STEM background that supports technical evaluation of data quality challenges.

Hands-on experience with LLMs, databases, and scripting to build evaluation and automation tools.

Proven experience developing and growing a distributed workforce of 30 or more specialized contractors.

Professional background in high-growth startups or fast-paced technology companies with demanding delivery timelines.

Practical notes

Work is primarily in-person five days a week at offices in San Francisco, New York City, or London.

This role is based in the San Francisco office.

The candidate must relocate to the Bay Area to be considered for the housing bonus.

Applications will be reviewed continuously until the role is filled.

Relocation support is available for qualified candidates moving to the San Francisco area.

Training and onboarding will be provided for domain-specific quality evaluation processes.