Hardware Podcasts

AI at the Edge: Justin Schneck on the Future of Embedded Devices

Over the Air · 29 May 2025 · 24m

What this episode covers

Justin Schneck, co-founder and CPO of Peridio, discusses the evolution of AI from cloud to edge, introducing Peridio's upcoming 'Avocado' OS designed to simplify embedded product development. He and host Ryan Prosser of Very explore the spectrum from cloud AI to embedded AI, noting how specialized silicon and miniaturized models are enabling practical applications like Garmin's radar-enabled bike lights. Schneck argues that while cloud AI handles massive compute, the real value lies in robust, self-initializing embedded systems that reduce hardware complexity for developers.

Most relevant to

early-stage companies

Topics

Mentioned

Companies
Peridio, Very, NVIDIA, CoreWeave, Qualcomm, Shimano, SRAM
Products
Avocado, Garmin

Related episodes from other shows

Other shows on the same ground, closest first.

  • EE Times Current · 29m

    AI and Connectivity at the Edge and Endpoint

    Kaushal Vora and Mo Dogar from Renesas discuss the convergence of AI and IoT (AIoT) at the edge, distinguishing between resource-intensive generative AI and predictive AI suited for constrained endpoint devices. They highlight Renesas' acquisition of Reality AI and its AutoML toolchain, which allows embedded engineers to optimize machine learning models for microcontrollers without adding hardware sensors, as demonstrated in washer and battery management use cases. The guests explain how decentralizing intelligence reduces latency, power consumption, and security risks by performing inference locally on devices like the RH850 microcontroller.

    Embedded firmwareMicrocontrollers & dev platforms
    8 chapters

  • Coredump Sessions · 58m

    #004: The Future of Edge AI and What it Means for Device Makers

    Alex Samuelson, CTO and co-founder of Imagimob, joins Memfault founders Francois Baldassari and Chris Coleman to discuss the practical implementation of Edge AI on embedded devices. They highlight how hardware accelerators like the Cortex-M55 and U55 have enabled GPU-like performance on microcontrollers, allowing for real-time inference in applications such as welding quality monitoring and fall detection. The conversation emphasizes that data collection, labeling, and memory constraints are the primary bottlenecks, requiring device makers to build data acquisition firmware early in the development process. Finally, they discuss the shift toward 'AI as a Service' business models, where hardware companies generate recurring revenue by updating models over the device's lifecycle.

    AI & machine learningMicrocontrollers & dev platforms
    8 chapters

  • The Circuit · 34m

    Episode 19: The On-Device AI Debate

    Ben Bajarin and Jay Goldberg discuss the economic and technical drivers shifting AI workloads from the cloud to on-device processing, highlighting companies like Qualcomm, Apple, and NVIDIA. They analyze the trade-offs between cloud-based model size and accuracy versus edge-based privacy and cost, noting that models like Llama and Stable Diffusion are being optimized for devices like the iPhone and Raspberry Pi. The hosts argue that while cloud AI offers superior capability, the high cost of inference and privacy concerns are pushing developers to adopt hybrid approaches and optimize silicon for power efficiency rather than raw throughput.

    Connected products & IoTMicrocontrollers & dev platforms
    10 chapters

  • The Next Byte Podcast · 46m

    235. Arm’s Vince Jesaitis on How AI Is Moving from the Cloud to Your Pocket

    Vince Jesaitis, Head of Global Government Affairs at Arm, explains how AI is shifting from cloud-based inference to local edge processing on devices like smartphones, earbuds, and cars. He details Arm's strategy of providing efficient CPU building blocks that enable high performance-per-watt, addressing energy and water constraints in data centers while enhancing user privacy and security. Jesaitis also discusses the critical role of government relations, including workforce development initiatives, the US Chips Act, and navigating divergent global regulations like the EU AI Act and GDPR.

    Connected products & IoTSecurity & privacy
    8 chapters

  • EE Times Current · 22m

    Embedded World 2023 Recap

    Nitin Dahad, Francoise Pelle, and Sally Ward Foxton of EE Times recap Embedded World 2023, highlighting the shift toward edge AI, tiny ML, and software-defined vehicles. They discuss specific implementations from companies like Renaissance, STMicroelectronics, and Silicon Labs, focusing on running AI models on Cortex-M85 and STM32 microcontrollers with low power consumption. The episode also covers security initiatives from Kudosip and Trust In Software, as well as neuromorphic computing demos from InnerTense and Brain Chip.

    Embedded firmwareSecurity & privacy
    8 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by Over the Air. The episode itself belongs to its publisher.