AI and Connectivity at the Edge and Endpoint

EE Times Current · 19 Oct 2023 · 29m

What this episode covers

Kaushal Vora and Mo Dogar from Renesas discuss the convergence of AI and IoT (AIoT) at the edge, distinguishing between resource-intensive generative AI and predictive AI suited for constrained endpoint devices. They highlight Renesas' acquisition of Reality AI and its AutoML toolchain, which allows embedded engineers to optimize machine learning models for microcontrollers without adding hardware sensors, as demonstrated in washer and battery management use cases. The guests explain how decentralizing intelligence reduces latency, power consumption, and security risks by performing inference locally on devices like the RH850 microcontroller.

Other shows on the same ground, closest first.

  • IoT For All Podcast · 29m

    Revolutionizing IoT with Machine Learning at the Edge | Perceive's Steve Teig

    Perceive Founder and CEO Steve Teig explains how his company is bringing data-center-class machine learning to edge IoT devices through their new chip, Ergo. He details the decision to build a custom silicon and software stack from first principles to achieve 20 to 100 times greater power efficiency than existing solutions, enabling battery-powered devices like doorbell cameras to perform complex inference locally. Teig discusses the strategic choice to keep raw data on-device to address privacy and security concerns, contrasting Perceive's approach with cloud-dependent competitors that suffer from high latency and false positives. The episode highlights Perceive's early-stage commercialization, noting they are currently in production with several unnamed consumer and enterprise customers.

  • Coredump Sessions · 58m

    #004: The Future of Edge AI and What it Means for Device Makers

    Alex Samuelson, CTO and co-founder of Imagimob, joins Memfault founders Francois Baldassari and Chris Coleman to discuss the practical implementation of Edge AI on embedded devices. They highlight how hardware accelerators like the Cortex-M55 and U55 have enabled GPU-like performance on microcontrollers, allowing for real-time inference in applications such as welding quality monitoring and fall detection. The conversation emphasizes that data collection, labeling, and memory constraints are the primary bottlenecks, requiring device makers to build data acquisition firmware early in the development process. Finally, they discuss the shift toward 'AI as a Service' business models, where hardware companies generate recurring revenue by updating models over the device's lifecycle.

  • Over the Air · 24m

    AI at the Edge: Justin Schneck on the Future of Embedded Devices

    Justin Schneck, co-founder and CPO of Peridio, discusses the evolution of AI from cloud to edge, introducing Peridio's upcoming 'Avocado' OS designed to simplify embedded product development. He and host Ryan Prosser of Very explore the spectrum from cloud AI to embedded AI, noting how specialized silicon and miniaturized models are enabling practical applications like Garmin's radar-enabled bike lights. Schneck argues that while cloud AI handles massive compute, the real value lies in robust, self-initializing embedded systems that reduce hardware complexity for developers.

  • The Next Byte Podcast · 46m

    235. Arm’s Vince Jesaitis on How AI Is Moving from the Cloud to Your Pocket

    Vince Jesaitis, Head of Global Government Affairs at Arm, explains how AI is shifting from cloud-based inference to local edge processing on devices like smartphones, earbuds, and cars. He details Arm's strategy of providing efficient CPU building blocks that enable high performance-per-watt, addressing energy and water constraints in data centers while enhancing user privacy and security. Jesaitis also discusses the critical role of government relations, including workforce development initiatives, the US Chips Act, and navigating divergent global regulations like the EU AI Act and GDPR.

  • Coredump Sessions · 57m

    #013: Prepping Your AI Model for the Wild: Building Edge AI Models That Work in the Real World

    David Tischler and Alessandro Grande from Edge Impulse discuss the practical realities of deploying Edge AI models on constrained devices, emphasizing that customization and fine-tuning are the primary value propositions over raw model complexity. They explain how effective Edge AI requires a combination of traditional DSP pre-processing and ML models, and why hardware selection must balance compute power with software ecosystem usability. The conversation highlights the critical need for observability and OTA updates to monitor model drift and push fixes in the field, as models rarely work perfectly out of the box.

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by EE Times Current. The episode itself belongs to its publisher.