Voice AI Infrastructure Engineer
Overview
You will architect and build the simulation, observability, and evaluation layer for Voice AI agents, serving millions of calls monthly for enterprise clients across banking, healthcare, and food service. You'll design resilient AWS infrastructure for real-time conversations and own technical execution end to end. As part of a ~10-person team, you'll work directly with customers to deploy the product. This role stands out for its full ownership and the complexity of real-time voice AI.
What You'll Do8
- 1Architect simulation, analysis, and evaluation systems for conversational AI agents, including voice and multimodal interactions.
- 2Design resilient, scalable AWS infrastructure (Lambda, EC2, Websockets, SIP) to handle millions of real-time conversations.
- 3Build algorithms and pipelines that surface insights, detect failure modes, and keep agents safe and aligned.
- 4Lead technical execution of projects end to end, from design to deployment.
- 5Work directly with customers to build and deploy the product, ensuring it meets their needs.
- 6Optimize Python services and FastAPI endpoints for low-latency voice processing.
- 7Integrate voice-AI tooling such as LiveKit, Deepgram, and Gemini to enhance agent capabilities.
- 8Implement observability with Sentry, PostHog, Grafana, and Datadog to monitor system health and performance.
Requirements7
- 16+ years of senior-level engineering experience.
- 2Deep full-stack proficiency, with real strength in databases, AWS, and AI engineering.
- 3Hands-on experience with modern voice-AI tooling (e.g., LiveKit, Deepgram).
- 4Track record of building high-traffic systems at scale and owning technical execution end to end.
- 5Strong undergraduate degree and/or time at a top fast-growing startup.
- 6Excellent communication skills and genuine comfort in customer-facing settings.
- 7Ability to work on-site in San Francisco five days a week.
Salary Insight
$225 - $300k per year
Location
Required Skills
Similar open positions
Explore active roles that match your skills and interests.
David Joseph & Company
VerifiedMember of Technical Staff at David Joseph & Company
Lead architecture and development of simulation analysis and evaluation systems for conversational AI. Build resilient scalable AWS infrastructure to support millions of real-time conversations. Design and ship end-to-end solutions while collaborating directly with enterprise clients.
AppFolio
VerifiedSenior Machine Learning Engineer, Voice AI Agents
You will own the design and deployment of voice and text AI agents within Realm-X, AppFolio's AI-native platform for real estate. You'll lead a small pod of engineers to ship real-time, multi-turn conversational experiences that handle millions of interactions across our customer base. Working with Product, Voice channel, and ML Platform teams, you'll translate cutting-edge agent research into reliable, low-latency pipelines. This role is for engineers who think in systems, not just models, and value pragmatic trade-offs between reasoning depth and latency. You'll be part of a collaborative, low-ego culture that prioritizes work-life balance as a foundation for sustained high performance.
AppFolio
VerifiedSenior Machine Learning Engineer, Voice & Conversational AI
You will lead the development of Realm-X's voice and text AI agent pipelines, serving real-time, multi-turn interactions for AppFolio's property management platform. You will architect systems that balance LLM reasoning depth with latency, driving production agents that handle millions of customer conversations. As a technical lead, you'll guide a small pod of engineers, define quality metrics, and collaborate with Product and Voice teams. This role uniquely combines deep LLM agent frameworks, Twilio telephony, and AWS streaming, placing you at the core of AI-native property management transformation. We're looking for a senior engineer with a track record of shipping production agents, strong Python expertise, and a pragmatic mindset for real-world performance.
Clera
VerifiedFounding Full Stack Engineer - AI Sales Automation
You will own the end-to-end technical vision for an AI-powered sales automation platform, building self-improving conversational agents that run product demos 24/7. As the first founding engineer alongside the CTO, you will shape the architecture, tooling, and culture from day one. The stack centers on Python, React, and LLM orchestration, with infrastructure on AWS or GCP. You will directly impact a product that has tripled month-over-month, working in a high-velocity, ambiguous environment where your decisions define the future of the company.
AppFolio
VerifiedSenior Machine Learning Engineer AppFolio
Design and ship next generation voice and conversational AI agents within Realm-X. Define production voice and chat agent pipelines at intersection of LLM agent frameworks, real-time voice technology, and streaming infrastructure. Work with Product Voice channel and ML Platform teams to translate cutting-edge agent research into reliable low-latency multi-channel experiences.
AppFolio
VerifiedSenior Machine Learning Engineer AppFolio Chicago
Design and ship next generation voice and conversational AI agents within Realm-X. Define production voice and chat agent pipelines. Work at intersection of LLM agent frameworks real-time voice technology and streaming infrastructure. Collaborate with Product Voice channel and ML Platform teams to translate research into reliable low-latency multi-channel experiences.