# Building Real-Time Voice AI Experiences | Agora's Patrick Ferriter | Internet of Things Podcast

- Show: [IoT For All Podcast](https://hardwarepodcasts.com/podcast/iot-for-all-podcast)
- Published: 2026-10-06
- Length: 18m
- Episode: 401
- Page: https://hardwarepodcasts.com/podcast/iot-for-all-podcast/2026-10-06-building-real-time-voice-ai-experiences-agoras-patrick-ferriter-internet-of-thin
- Listen: https://podcasters.spotify.com/pod/show/iot-for-all/episodes/Building-Real-Time-Voice-AI-Experiences--Agoras-Patrick-Ferriter--Internet-of-Things-Podcast-e3q0e8d

## Summary

Patrick Ferriter, SVP of Product at Agora, discusses the architecture and challenges of building real-time voice AI for physical devices, such as AI companions and plush toys. He explains how Agora’s SD-RTN network and orchestration layer handle high latency, packet loss, and network degradation to maintain natural conversation flows. Ferriter details the split between edge processing (wake word, noise suppression) and cloud processing (LLMs, memory), and highlights issues like voice cloning drift and privacy concerns in multi-user environments.

## Chapters

- [0:04](https://hardwarepodcasts.com/podcast/iot-for-all-podcast/2026-10-06-building-real-time-voice-ai-experiences-agoras-patrick-ferriter-internet-of-thin#t=4) Introduction: Patrick Ferriter and Agora's Physical AI Platform
- [0:53](https://hardwarepodcasts.com/podcast/iot-for-all-podcast/2026-10-06-building-real-time-voice-ai-experiences-agoras-patrick-ferriter-internet-of-thin#t=53) Defining Physical AI and Companion Devices
- [2:13](https://hardwarepodcasts.com/podcast/iot-for-all-podcast/2026-10-06-building-real-time-voice-ai-experiences-agoras-patrick-ferriter-internet-of-thin#t=133) Network Degradation and Real-World Deployment Challenges
- [4:38](https://hardwarepodcasts.com/podcast/iot-for-all-podcast/2026-10-06-building-real-time-voice-ai-experiences-agoras-patrick-ferriter-internet-of-thin#t=278) Architecting for Low Latency and Redundancy
- [8:00](https://hardwarepodcasts.com/podcast/iot-for-all-podcast/2026-10-06-building-real-time-voice-ai-experiences-agoras-patrick-ferriter-internet-of-thin#t=480) AI Companions, Memory, and Voice Cloning Quality
- [12:56](https://hardwarepodcasts.com/podcast/iot-for-all-podcast/2026-10-06-building-real-time-voice-ai-experiences-agoras-patrick-ferriter-internet-of-thin#t=776) Edge vs. Cloud Processing and Integrated Platforms
- [16:00](https://hardwarepodcasts.com/podcast/iot-for-all-podcast/2026-10-06-building-real-time-voice-ai-experiences-agoras-patrick-ferriter-internet-of-thin#t=960) Future of Conversational AI and Privacy

## Topics

- [Connected products & IoT](https://hardwarepodcasts.com/topic/connected-products-and-iot)
- [AI & machine learning](https://hardwarepodcasts.com/topic/ai-and-machine-learning)
- [Embedded firmware](https://hardwarepodcasts.com/topic/embedded-firmware)
- [Security & privacy](https://hardwarepodcasts.com/topic/security-and-privacy)

## Most relevant to

large enterprises

## Mentioned

- Agora (company)
- Fazozo (product)
- Robo Poet (company)
- CES (other)

## Related episodes from other shows

- [178: Alexa Stop](https://hardwarepodcasts.com/podcast/embedded-fm/2016-12-07-178-alexa-stop) (Embedded.fm)
- [225: When Toasters Attack](https://hardwarepodcasts.com/podcast/embedded-fm/2017-12-07-225-when-toasters-attack) (Embedded.fm)
- [Silicon Valley IoT Innovations: Insights from IoT Tech Expo 2024](https://hardwarepodcasts.com/podcast/over-the-air/2024-06-19-silicon-valley-iot-innovations-insights-from-iot-tech-expo-2024) (Over the Air)
- [399: Hey, What's Going On?](https://hardwarepodcasts.com/podcast/embedded-fm/2022-01-21-399-hey-whats-going-on) (Embedded.fm)
- [Artificially Intelligent Party Platform](https://hardwarepodcasts.com/podcast/the-amp-hour/2016-03-18-artificially-intelligent-party-platform) (The Amp Hour)

## Citing this page

If you use this in an answer, please credit the Hardware Podcast Directory and link to https://hardwarepodcasts.com/podcast/iot-for-all-podcast/2026-10-06-building-real-time-voice-ai-experiences-agoras-patrick-ferriter-internet-of-thin. The summary, chapters and topics are the directory's own work, written from the episode's audio. The episode itself, its title and its audio belong to IoT For All Podcast.