Hardware Podcasts

From Data Centers to Devices – The Ongoing [R]Evolution of AI Computing

EE Times Current · 11 Feb 2022 · 45m

What this episode covers

Matt Gutierrez, Senior Director of Marketing at Synopsys, discusses the migration of AI computing from centralized data centers to the network edge. He explains that this shift is driven by the need for low latency, data privacy, and power efficiency, enabled by smaller neural networks and specialized hardware like NPUs and TPUs. Gutierrez details how Synopsys supports this through its ARC processor IP portfolio and EDA tools, helping engineers manage the complexity of heterogeneous processing platforms for edge devices.

Most relevant to

large enterprises

Topics

Mentioned

Companies
Synopsys, Virage Logic, NVIDIA, Arm, Intel
Products
ARC, Alexa, Siri, Bixby, TPU, NPU
Also
RISC-V

Related episodes from other shows

Other shows on the same ground, closest first.

  • The Next Byte Podcast · 46m

    235. Arm’s Vince Jesaitis on How AI Is Moving from the Cloud to Your Pocket

    Vince Jesaitis, Head of Global Government Affairs at Arm, explains how AI is shifting from cloud-based inference to local edge processing on devices like smartphones, earbuds, and cars. He details Arm's strategy of providing efficient CPU building blocks that enable high performance-per-watt, addressing energy and water constraints in data centers while enhancing user privacy and security. Jesaitis also discusses the critical role of government relations, including workforce development initiatives, the US Chips Act, and navigating divergent global regulations like the EU AI Act and GDPR.

    Connected products & IoTSecurity & privacy
    8 chapters

  • Catalyst · 47m

    Will inference move to the edge?

    Dr. Ben Lee, a professor at the University of Pennsylvania and visiting researcher at Google, discusses the potential shift of AI inference compute from centralized hyperscale data centers to the edge and on-device. He explains that while training remains centralized due to massive GPU coordination needs, inference is amenable to distributed locations because it lacks the frequent inter-GPU communication spikes that cause power grid instability. Lee predicts that by 2035, up to 80% of inference could occur locally, primarily at edge data centers (10-50 MW) rather than on consumer devices, due to the trade-off between latency/privacy and the hardware constraints of shrinking model capabilities for mobile silicon.

    Energy & climate techAI & machine learning
    6 chapters

  • The Circuit · 51m

    Episode 70!!! NPUs!!!!!!!!

    Ben Bajarin and Jay Goldberg host Austin Lyons and Paul Karazuba to discuss the architecture, market, and future of Neural Processing Units (NPUs). The group debunks the metric 'TOPS per watt' as meaningless, arguing that real-world performance depends on specific network workloads and latency. They explore how chipmakers like Qualcomm, Intel, and Apple are designing NPUs, often by licensing IP or evolving DSPs, and predict that NPUs will become ubiquitous in devices from smartphones to microcontrollers within three to four years.

    Microcontrollers & dev platformsChips, FPGAs & semiconductors
    8 chapters

  • Moore's Lobby · 43m

    Ep. 29 | NVIDIA CTO Michael Kagan on the New Age of AI and Supercomputers

    Michael Kagan, CTO of NVIDIA, discusses the evolution of high-performance computing, tracing his career from Intel and the 860 processor to co-founding Mellanox and its eventual acquisition by NVIDIA. He explains how NVIDIA has shifted from a graphics company to an accelerated computing platform, integrating GPUs, CPUs, and DPUs to support AI workloads. Kagan emphasizes that modern data centers function as unified computing units, delivering processing as a service rather than standalone hardware, driven by the massive computational demands of training neural networks.

    Chips, FPGAs & semiconductorsConnected products & IoT
    8 chapters

  • IoT For All Podcast · 19m

    The Evolution of AI in IoT | BrainChip's Nandan Nayampally | Internet of Things Podcast

    Nandan Nayampally, CMO at BrainChip, discusses the evolution of AIoT and the shift of AI processing from the cloud to the edge. He explains how neuromorphic computing enables real-time, private, and efficient inference on billions of devices, citing PwC's $15 trillion GDP impact estimate. Nayampally highlights key adoption markets like healthcare, agriculture, and infrastructure, and advises companies to focus on solving acute pain points ('headaches') rather than nice-to-have features ('vitamins') to gain traction.

    AI & machine learningConnected products & IoT
    5 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by EE Times Current. The episode itself belongs to its publisher.