Real-Time Voice AI Phone Ordering Agent
An ultra-low latency conversational AI voice assistant answering live phone calls, conducting multi-turn food ordering in Hindi/English, and executing real-time catalog lookups and automated cart building.
- ●Achieved sub-400ms end-to-end roundtrip latency over telephone lines using streaming WebSockets and async event loops
- ●Integrated Sarvam AI Indic STT with custom phonetic consonant-matching algorithms for Hindi and regional food terms
- ●Constructed an automated 10-call evaluation test harness (gate6.py) validating pricing and order integrity against a 221-dish catalog
- ●Designed an inverted fail-safe human handoff architecture ensuring zero dropped customer calls on unexpected edge cases
Live Phone Call
Real-time ordering · Sub-400ms
FastAPI + Deepgram + ElevenLabs