Hardware Podcasts

Building Real-Time Voice AI Experiences | Agora's Patrick Ferriter | Internet of Things Podcast

IoT For All Podcast · 6 Oct 2026 · 18m · Episode 401

What this episode covers

Patrick Ferriter, SVP of Product at Agora, discusses the architecture and challenges of building real-time voice AI for physical devices, such as AI companions and plush toys. He explains how Agora’s SD-RTN network and orchestration layer handle high latency, packet loss, and network degradation to maintain natural conversation flows. Ferriter details the split between edge processing (wake word, noise suppression) and cloud processing (LLMs, memory), and highlights issues like voice cloning drift and privacy concerns in multi-user environments.

Most relevant to

large enterprises

Topics

Mentioned

Companies
Agora, Robo Poet
Products
Fazozo
Also
CES

Related episodes from other shows

Other shows on the same ground, closest first.

  • Embedded.fm · 1h 09m

    178: Alexa Stop

    Chris Maury, founder of Conversant Labs, discusses the design and engineering of voice-based applications, contrasting the natural language understanding of Alexa and Google Assistant with Siri's limitations. He explains the critical role of user testing in collecting diverse utterances for intent recognition and introduces TinCan.ai as a prototyping tool for non-visual interfaces. Maury also addresses the challenges of on-device speech recognition, privacy concerns, and the future of voice computing for developers and the visually impaired.

    AI & machine learningIndustrial & consumer product design
    6 chapters

  • Embedded.fm · 1h 03m

    225: When Toasters Attack

    Maria Gorlatova, a research scholar at Princeton University, discusses the shift from centralized cloud computing to 'fog' and 'edge' computing architectures. She explains how the OpenFog Consortium is standardizing these distributed systems to handle the data avalanche from IoT devices, improve security through local processing, and enable low-latency applications like augmented reality and autonomous driving. Gorlatova highlights the role of federated learning in preserving privacy and the convergence of cloud and edge capabilities provided by major tech companies.

    Connected products & IoTAI & machine learning
    8 chapters

  • Over the Air · 52m

    Silicon Valley IoT Innovations: Insights from IoT Tech Expo 2024

    Ryan Prosser and Bill Brock interview a diverse range of founders and executives at the IoT Tech Expo 2024, including Jason from Prion, Alan Bain from Key Factor, Ken Cowell from RAD AI, Spencer from Edge Impulse, Charles from Adam Beam, Virginia from Fuel AI, Tomer from Autorise, Eric from M. Fly, Josh from Sesame Software, Lee House from IoT 83, Rick from Contron, Brian from National Grid, Renee from Hardware IL, and D Paul from Innoface. They discuss specific products like Prion's RAG engine, RAD AI's Continuity tool, Edge Impulse's ML platform, and Innoface's Matter 1.2 certified modules, highlighting the industry's shift toward edge computing, security, and AI integration.

    Connected products & IoTAI & machine learning
    16 chapters

  • Embedded.fm · 1h 11m

    399: Hey, What's Going On?

    Jen Costillo, a firmware engineer and co-host of the Unnamed Reverse Engineering Podcast, discusses her transition into voiceover artistry and her work with Cat Machines Dance. She details the technical nuances of recording for educational toys, such as handling concatenated speech and memory constraints, and explains how voiceover skills enhance her engineering communication. The conversation also covers the business of voiceover, including platforms like Voice123 and Sweetwater, and the importance of reverse engineering for understanding product security.

    Embedded firmwareIndustrial & consumer product design
    8 chapters

  • The Amp Hour · 1h 05m

    Artificially Intelligent Party Platform

    Chris Gammell and Dave Jones discuss the state of physical product development, with Gammell sharing insights from his time in Austin's tech scene and his recent experience at South by Southwest. They critique the current state of IoT, arguing that cloud-dependent smart home devices lack natural user interfaces and usability, proposing instead that hardware should integrate intuitive physical controls like pressure-sensitive switches. The conversation also covers the challenges of robotics, the nuances of AI in games like Go, and the practicalities of prototyping, including using generic part values and leveraging tools like Oshpark for BGA fabrication.

    Connected products & IoTPrototyping & iteration
    9 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by IoT For All Podcast. The episode itself belongs to its publisher.