Building Real-Time Voice AI Experiences | Agora's Patrick Ferriter | Internet of Things Podcast
Patrick Ferriter, SVP of Product at Agora, discusses the architecture and challenges of building real-time voice AI for physical devices, such as AI companions and plush toys. He explains how Agora’s SD-RTN network and orchestration layer handle high latency, packet loss, and network degradation to maintain natural conversation flows. Ferriter details the split between edge processing (wake word, noise suppression) and cloud processing (LLMs, memory), and highlights issues like voice cloning drift and privacy concerns in multi-user environments.




