Hardware Podcasts

#013: Prepping Your AI Model for the Wild: Building Edge AI Models That Work in the Real World

Coredump Sessions · 23 Jul 2025 · 57m · Episode 14

What this episode covers

David Tischler and Alessandro Grande from Edge Impulse discuss the practical realities of deploying Edge AI models on constrained devices, emphasizing that customization and fine-tuning are the primary value propositions over raw model complexity. They explain how effective Edge AI requires a combination of traditional DSP pre-processing and ML models, and why hardware selection must balance compute power with software ecosystem usability. The conversation highlights the critical need for observability and OTA updates to monitor model drift and push fixes in the field, as models rarely work perfectly out of the box.

Most relevant to

companies scaling up

Topics

Mentioned

Companies
Edge Impulse, Qualcomm, Memfault, ARM, Pebble, Oculus, Nordic
Products
NVIDIA Jetson, Thingy:53, Raspberry Pi Pico, Arduino, ChatGPT
Tools
TensorFlow, PyTorch
Also
TinyML

Related episodes from other shows

Other shows on the same ground, closest first.

  • EE Times Current · 29m

    AI and Connectivity at the Edge and Endpoint

    Kaushal Vora and Mo Dogar from Renesas discuss the convergence of AI and IoT (AIoT) at the edge, distinguishing between resource-intensive generative AI and predictive AI suited for constrained endpoint devices. They highlight Renesas' acquisition of Reality AI and its AutoML toolchain, which allows embedded engineers to optimize machine learning models for microcontrollers without adding hardware sensors, as demonstrated in washer and battery management use cases. The guests explain how decentralizing intelligence reduces latency, power consumption, and security risks by performing inference locally on devices like the RH850 microcontroller.

    Embedded firmwareMicrocontrollers & dev platforms
    8 chapters

  • OnTrack · 41m

    Edge Devices and LLMs: What's Ahead for AI

    Jan Jongboom, co-founder of Edge Impulse, discusses the feasibility of running Large Language Models (LLMs) on edge devices by reducing their size through knowledge distillation and synthetic data generation. He explains that while general-purpose MCUs can handle small, specialized models, RAM capacity is often the primary constraint rather than compute power. Jongboom highlights techniques like using GPT-4 to label data for training smaller, hyper-specific models that fit on microcontrollers like the Cortex-M4.

    AI & machine learningMicrocontrollers & dev platforms
    5 chapters

  • Embedded.fm · 1h 23m

    327: A Little Bit of Human Knowledge

    Daniel Situnayake, author of 'TinyML' and engineer at Edge Impulse, explains how to run machine learning models on ultra-low-power microcontrollers using TensorFlow Lite for Microcontrollers. He details the workflow of using Google Colab to train models and deploying them to boards like the Arduino Nano 33 BLE Sense and SparkFun Edge. Situnayake emphasizes that success depends on data quality and scoping, noting that while the technology is shippable, it requires careful handling of diverse datasets to avoid poor performance in real-world conditions.

    Embedded firmwareAI & machine learning
    8 chapters

  • The Circuit · 34m

    Episode 19: The On-Device AI Debate

    Ben Bajarin and Jay Goldberg discuss the economic and technical drivers shifting AI workloads from the cloud to on-device processing, highlighting companies like Qualcomm, Apple, and NVIDIA. They analyze the trade-offs between cloud-based model size and accuracy versus edge-based privacy and cost, noting that models like Llama and Stable Diffusion are being optimized for devices like the iPhone and Raspberry Pi. The hosts argue that while cloud AI offers superior capability, the high cost of inference and privacy concerns are pushing developers to adopt hybrid approaches and optimize silicon for power efficiency rather than raw throughput.

    Connected products & IoTMicrocontrollers & dev platforms
    10 chapters

  • Embedded.fm · 1h 05m

    437: Chirping With the Experts

    Daniel Situnayake, Head of Machine Learning at Edge Impulse and co-author of the O'Reilly book 'AI at the Edge', discusses the practical application of embedded machine learning. He explains the BLERP framework (Bandwidth, Latency, Economics, Reliability, Privacy) for deciding when to deploy AI on edge devices and emphasizes the importance of responsible AI, including hiring ethicists and using diverse datasets. The conversation also covers the current state of large language models like ChatGPT, noting their utility as creative tools with human-in-the-loop oversight rather than autonomous agents.

    AI & machine learningEmbedded firmware
    10 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by Coredump Sessions. The episode itself belongs to its publisher.