Staff Product Manager, Inference

About the role

LiveKit is seeking a Staff Product Manager to lead the development and strategy for LiveKit Inference. This role will define the future of how developers access and utilize voice AI models, establishing LiveKit as the premier inference provider.

Key facts

What you'll do

Define the product vision and roadmap for LiveKit Inference, including model selection, provider partnerships, and strategic evolution.

Build a model access layer that becomes the default choice for developers, offering superior ease of use and performance compared to direct provider integrations.

Stay ahead of the rapidly evolving model landscape by identifying and integrating key models, providers, and modalities.

Drive product growth by consolidating model usage onto the LiveKit platform, enhancing customer value and optimizing costs.

Gain deep customer insights through direct engagement and data analysis to inform product priorities and development.

Requirements

Possess at least 8 years of experience in product management, with a focus on senior or staff-level roles, preferably managing developer-facing APIs, platforms, or AI/ML products.

Demonstrate strong technical understanding of model serving, latency, routing, and quality trade-offs, enabling effective collaboration with engineering teams.

Exhibit experience managing products where cost, performance, and provider choices were critical, and the ability to adapt to shifting market dynamics.

Excel at influencing cross-functional teams through clear communication, trust, and sound judgment, rather than relying on hierarchy.

Communicate effectively in writing and presentations, capable of discussing high-level strategy and detailed technical aspects.

Be comfortable operating with incomplete information and prioritizing effectively in a fast-paced, growing company environment.

Nice to have

Experience building model gateways, inference APIs, or AI/ML platforms.

Familiarity with methods for benchmarking models and measuring performance and quality, such as time-to-first-byte.

Knowledge of the STT, TTS, LLM, and real-time model space, including major providers.

Previous work experience in developer tools, API infrastructure, or AI/ML companies.

Understanding of voice AI, real-time communication, or telephony systems.

Experience with usage-based pricing models and optimizing costs or margins.

Skills & tools

LiveKit platform

AI/ML models and infrastructure

Developer-facing APIs and platforms

Model serving and optimization

Cross-functional collaboration

Practical notes

Visa sponsorship is not available for this position.

This role is fully remote within the U.S.

Benefits include health, dental, and vision insurance, and a flexible vacation policy.

To apply, please demonstrate your understanding of the space and LiveKit's product.