477: One Thousand New Instructions

Embedded.fm · 16 May 2024 · 1h 24m · Episode 477

What this episode covers

Kwabena Agyeman, founder of OpenMV, explains how SIMD optimization and new Arm Cortex-M55 processors enable complex computer vision and machine learning on low-cost microcontrollers. He details specific algorithmic improvements, such as a 16x speedup in median filters, and discusses the shift from Linux-based systems like NVIDIA Jetson to tinyML for cost and power efficiency. Agyeman also shares his experience scaling OpenMV through the chip shortage and his previous career at Embark Trucks.

Mentioned

Companies
Edge Impulse, Embark Trucks, Prophesee, Opticom
Products
OpenMV
Chips
STM32H7, i.MX RT, Cortex-M55, NVIDIA Jetson Orin, Alif Ensemble
Tools
TensorFlow Lite for microcontrollers, ulab
Also
Arm Helium, FOMO, AprilTags

Other shows on the same ground, closest first.

  • EE Times Current · 22m

    Embedded World 2023 Recap

    Nitin Dahad, Francoise Pelle, and Sally Ward Foxton of EE Times recap Embedded World 2023, highlighting the shift toward edge AI, tiny ML, and software-defined vehicles. They discuss specific implementations from companies like Renaissance, STMicroelectronics, and Silicon Labs, focusing on running AI models on Cortex-M85 and STM32 microcontrollers with low power consumption. The episode also covers security initiatives from Kudosip and Trust In Software, as well as neuromorphic computing demos from InnerTense and Brain Chip.

  • EE Times Current · 41m

    Live! From Embedded World, ISSCC, and (sorta) Mobile World Congress

    EE Times editors discuss the impact of the coronavirus on major tech conferences like Embedded World and Mobile World Congress, highlighting the resilience of the industry. They cover Cartesium's technology for on-device machine learning training on ARM Cortex-M microcontrollers, Soitec's development of Silicon-on-Insulator (SOI) and compound material wafers for 5G, and Ferric's ferromagnetic thin-film inductors for power conversion. The episode also features Texas Instruments' Jacinto 7 processor for automotive AI and concludes with a historical look at magnetic core memory and the first NYC subway.

  • Coredump Sessions · 58m

    #004: The Future of Edge AI and What it Means for Device Makers

    Alex Samuelson, CTO and co-founder of Imagimob, joins Memfault founders Francois Baldassari and Chris Coleman to discuss the practical implementation of Edge AI on embedded devices. They highlight how hardware accelerators like the Cortex-M55 and U55 have enabled GPU-like performance on microcontrollers, allowing for real-time inference in applications such as welding quality monitoring and fall detection. The conversation emphasizes that data collection, labeling, and memory constraints are the primary bottlenecks, requiring device makers to build data acquisition firmware early in the development process. Finally, they discuss the shift toward 'AI as a Service' business models, where hardware companies generate recurring revenue by updating models over the device's lifecycle.

  • The Electromaker Show · 24m

    On the floor of Maker Faire Shenzhen, Neuton.AI on Nordic hardware, Win a HuskyLens2!

    The host discusses Nordic Semiconductor's acquisition of Neuton.AI, highlighting how Neuton's tiny ML models (under 5KB) enable edge AI on microcontrollers like the nRF52 series without cloud dependency. The episode features the HuskyLens2, a Seeed Studio computer vision module with a built-in screen, speaker, and one-button training interface, powered by a Kendryte K53 processor. Finally, the host reflects on Electromaker's coverage of Maker Faire Shenzhen, noting the strong maker community and the pervasive theme of 'AI without Borders'.

  • EE Times Current · 38m

    Taming the Wild Edge

    Chris Catterton, head of solution engineering at Micro AI (formerly OneTech), explains how their Adam ML technology enables lightweight AI training and inference on resource-constrained microcontrollers at the extreme edge of IoT. He details how this approach solves high data transmission costs by processing data locally and only sending insights to the cloud, using examples from oil rigs and manufacturing lines. Catterton also describes how the same behavioral profiling technology provides endpoint security by detecting anomalies in CPU and memory usage to prevent ransomware attacks and other threats.

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by Embedded.fm. The episode itself belongs to its publisher.