LiveKit Inference PM Role Title
Overview
Senior Product Manager leading LiveKit Inference at LiveKit, a voice AI infrastructure platform. Own the product vision and roadmap while partnering with engineering to ship a developer-centric inference solution. Set the strategic direction for model offerings and stay ahead of the rapidly evolving voice AI landscape. This role offers remote flexibility or SF office collaboration.
What You'll Do9
- 1Own the LiveKit Inference roadmap and define a sequenced plan for product development
- 2Ship a developer-facing model layer that becomes the default choice for inference
- 3Make accessing top-tier models through LiveKit more seamless than direct provider integration
- 4Maintain competitive edge by deciding which models and providers to add
- 5Consolidate model spend onto LiveKit while preserving customer value and cost efficiency
- 6Deepen understanding of customer model usage patterns to drive product priorities
- 7Influence cross-functionally within a small, autonomous engineering team
- 8Communicate effectively across strategy and technical domains with clarity and precision
- 9Navigate ambiguity in a fast-growing startup environment with limited information
Requirements11
- 18+ years in product management at senior or staff level
- 2Proven ownership of developer-facing APIs platforms or AI/ML products
- 3Technical depth in model serving routing latency and quality tradeoffs
- 4Experience managing product decisions around cost performance and vendor tradeoffs
- 5Cross-functional influence without hierarchical authority
- 6Strong written and verbal communication skills
- 7Comfort with ambiguity and rapid learning in evolving technology spaces
- 8Background in developer tools API infrastructure or AI/ML platforms
- 9Familiarity with model benchmarking metrics like TTFT
- 10Knowledge of STT TTS LLM and real-time model ecosystems
- 11Previous experience with usage-based pricing or cost optimization models
Salary Insight
$225 - $265k per year
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
Livekit
VerifiedSenior Product Engineer Robotics LiveKit
LiveKit builds infrastructure for the agentic era enabling developers to create physical AI applications. This role focuses on designing developer surfaces for robotics applications on web and CLI platforms. The position requires strong technical expertise and product instinct to ship features that empower users.
David Joseph & Company
VerifiedVoice AI Infrastructure Engineer
You will architect and build the simulation, observability, and evaluation layer for Voice AI agents, serving millions of calls monthly for enterprise clients across banking, healthcare, and food service. You'll design resilient AWS infrastructure for real-time conversations and own technical execution end to end. As part of a ~10-person team, you'll work directly with customers to deploy the product. This role stands out for its full ownership and the complexity of real-time voice AI.
Bain & Co.
VerifiedSenior AI/ML Engineer
Senior AI/ML Engineer builds and operates the serving, deployment, and LLMOps infrastructure that carries models, prompts, and retrieval pipelines from prototype to governed production at Bain's Private Equity Group Innovation team. You own the model and prompt lifecycle end-to-end, from packaging and registry to promotion and rollback, and build evaluation harnesses, inference services, and observability that keep production ML measurable and reliable. Partnering with Data Scientists, Data Engineers, and the Agent/AI squad, you set the standard for production ML systems and mentor mid-level engineers. This hands-on role demands deploying, measuring, and operating models and pipelines at scale in a hybrid work environment.
AppFolio
VerifiedSenior Machine Learning Engineer AppFolio Chicago
Design and ship next generation voice and conversational AI agents within Realm-X. Define production voice and chat agent pipelines. Work at intersection of LLM agent frameworks real-time voice technology and streaming infrastructure. Collaborate with Product Voice channel and ML Platform teams to translate research into reliable low-latency multi-channel experiences.
AppFolio
VerifiedSenior Machine Learning Engineer AppFolio
Design and ship next generation voice and conversational AI agents within Realm-X. Define production voice and chat agent pipelines at intersection of LLM agent frameworks, real-time voice technology, and streaming infrastructure. Work with Product Voice channel and ML Platform teams to translate cutting-edge agent research into reliable low-latency multi-channel experiences.
AppFolio
VerifiedSenior Machine Learning Engineer AppFolio
Design and ship next generation voice and conversational AI agents within Realm-X. Define production voice and chat agent pipelines while collaborating with Product Voice and ML Platform teams. Translate cutting edge agent research into reliable low latency multi channel experiences.