Staff Product Manager, AI Foundations
Job description
About the role
At Vanta, we exist to help businesses earn and prove trust through continuous security and compliance. The Staff Product Manager, AI Foundations will own the core AI capabilities that power Vanta's AI product experiences, specifically the agent harness and the quality and evaluation stack. This role is central to making Vanta the intelligence layer for security and compliance work across all customer workflows. You will translate the challenges of building reliable AI into shared foundations that make every team's AI features better and more trustworthy over time. The position requires deep comfort with rapidly evolving AI technologies and a commitment to building with safety and clarity in mind. You will work closely with engineers, designers, and subject-matter experts to define what success looks like for AI features at scale.
Key facts
What you'll do
Define and own the strategy and multi-year roadmap for Vanta's core AI capabilities, focusing on the agent harness and the AI quality and evaluation stack.
Live inside agent traces and production workflows to build intuition for real customer behavior, then translate those insights into high-leverage product improvements.
Build golden datasets and automated evaluators aligned to expert judgment, creating self-serve tooling so PMs, designers, and subject-matter experts can run rigorous evals without engineering bottlenecks.
Shape the foundational capabilities that Vanta's agents are built on, including clear tradeoffs between cost, latency, reliability, and safety across the entire product surface.
Set and evangelize quality standards for evals, launch readiness, and observability, driving broad adoption while maintaining a partner mindset rather than a gatekeeping role.
Partner with EPD teams across Vanta and with the AI pillar to turn proven patterns into shared capabilities that accelerate future AI product development.
Define and shape Vanta's product team culture, mentoring and influencing peers as the organization grows in a fast-moving AI landscape.
Use advanced coding agents in your daily workflow and maintain deep curiosity about emerging model architectures and agent tooling to inform product decisions.
Think in interconnected systems, understanding how evaluation, observability, and infrastructure choices compound across teams and customer experiences over time.
Communicate complex technical tradeoffs with clarity and precision to diverse audiences, from individual contributors to executive stakeholders.
Requirements
Bring 8+ years of product management experience, with a track record in platform, infrastructure, or technically deep product domains.
Have hands-on experience building with large language models and AI agents, including designing prompts, tool use patterns, and agent orchestration strategies.
Understand how evaluation frameworks, observability data, and quality signals combine to drive systematic improvement in AI products and workflows.
Demonstrate strong user empathy, consistently diving deep into customer problems and bringing that clarity back to cross-functional teams.
Show ability to run foundational products end-to-end, with adoption goals, feedback loops, and prioritization grounded in real user and stakeholder needs.
Earn credibility and trust with senior engineers by holding your own in deeply technical design discussions about AI systems and tradeoffs.
Use coding agents daily and stay actively curious about how models, toolchains, and agent frameworks are evolving.
Think in systems, connecting evaluation design, observability practices, and infrastructure decisions to long-term product outcomes across many teams.
Thrive in ambiguous, fast-moving environments, leading with problem definition and disciplined process when answers are not immediately clear.
Communicate effectively in writing and speaking, adapting style and detail level for individual contributors, stakeholders, and executives.
Be open to using AI to amplify your own skills, demonstrating sound judgment and responsibility in applying AI tools to improve efficiency and impact.
Nice to have
Experience defining and scaling quality evaluation frameworks for AI products in production environments.
Background working with compliance, security, or regulated industries where trust and auditability are central.
Practical notes
Office locations include SF, NYC, London, Dublin, Tel Aviv, and Sydney.
16 weeks paid parental leave is offered to all new parents.
Committed to equal opportunity employment and diversity in the workplace.
Final compensation details are determined during the hiring process and may vary by location and qualifications.