235. Arm’s Vince Jesaitis on How AI Is Moving from the Cloud to Your Pocket

The Next Byte Podcast · 9 Dec 2025 · 46m

What this episode covers

Vince Jesaitis, Head of Global Government Affairs at Arm, explains how AI is shifting from cloud-based inference to local edge processing on devices like smartphones, earbuds, and cars. He details Arm's strategy of providing efficient CPU building blocks that enable high performance-per-watt, addressing energy and water constraints in data centers while enhancing user privacy and security. Jesaitis also discusses the critical role of government relations, including workforce development initiatives, the US Chips Act, and navigating divergent global regulations like the EU AI Act and GDPR.

Mentioned

Companies
Arm, TSMC, Intel Foundry Services, Global Foundries, NVIDIA, AWS, Microsoft, Google, Meta, Anthropic, NIST, SCSP
Products
Meta Glasses, Chat GPT, Microsoft 365
Also
Matter, EU AI Act, GDPR, US Chips Act

Other shows on the same ground, closest first.

  • EE Times Current · 45m

    From Data Centers to Devices – The Ongoing [R]Evolution of AI Computing

    Matt Gutierrez, Senior Director of Marketing at Synopsys, discusses the migration of AI computing from centralized data centers to the network edge. He explains that this shift is driven by the need for low latency, data privacy, and power efficiency, enabled by smaller neural networks and specialized hardware like NPUs and TPUs. Gutierrez details how Synopsys supports this through its ARC processor IP portfolio and EDA tools, helping engineers manage the complexity of heterogeneous processing platforms for edge devices.

  • The Circuit · 36m

    Episode 46: A Discussion with Arm CEO Rene Haas

    Rene Haas, CEO of Arm, explains that Arm is the 'brain' powering 70% of the world's electronic devices, operating through a licensing model rather than manufacturing chips. He details a strategic shift from generic CPU designs to productized, purpose-built solutions like Neoverse for data centers and automotive subsystems, which command higher royalties and accelerate time-to-market. Haas highlights growth drivers in cloud AI, PCs, and automotive, while noting that US sanctions on China have limited impact due to Arm's non-US design origin, though RISC-V gains traction in simple IoT applications. The conversation concludes with Arm's close partnership with Intel Foundry Services and the potential for Arm to deliver verified chiplet designs.

  • The Circuit · 34m

    Episode 19: The On-Device AI Debate

    Ben Bajarin and Jay Goldberg discuss the economic and technical drivers shifting AI workloads from the cloud to on-device processing, highlighting companies like Qualcomm, Apple, and NVIDIA. They analyze the trade-offs between cloud-based model size and accuracy versus edge-based privacy and cost, noting that models like Llama and Stable Diffusion are being optimized for devices like the iPhone and Raspberry Pi. The hosts argue that while cloud AI offers superior capability, the high cost of inference and privacy concerns are pushing developers to adopt hybrid approaches and optimize silicon for power efficiency rather than raw throughput.

  • EE Times Current · 29m

    AI and Connectivity at the Edge and Endpoint

    Kaushal Vora and Mo Dogar from Renesas discuss the convergence of AI and IoT (AIoT) at the edge, distinguishing between resource-intensive generative AI and predictive AI suited for constrained endpoint devices. They highlight Renesas' acquisition of Reality AI and its AutoML toolchain, which allows embedded engineers to optimize machine learning models for microcontrollers without adding hardware sensors, as demonstrated in washer and battery management use cases. The guests explain how decentralizing intelligence reduces latency, power consumption, and security risks by performing inference locally on devices like the RH850 microcontroller.

  • EE Times Current · 25m

    Chips at the Edge: Innovation for AI at Edge and Automotive

    Hezzy Tzar, Executive Director at Synopsys, discusses the shift of AI workloads from the cloud to the edge, highlighting the critical balance of power, performance, and cost in devices like smartphones and automotive systems. He explains that memory bandwidth, specifically involving LPDDR6 and UFS, is the primary bottleneck for on-device AI, necessitating flexible multi-die architectures and standards like UCIe to manage scalability and reliability in automotive applications. Tzar emphasizes the importance of 'shift left' methodologies, using emulation and FPGA prototyping to handle rapid model changes, and predicts a future where hardware must support continuous software upgrades and subscription-based models for physical AI devices like robotics.

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by The Next Byte Podcast. The episode itself belongs to its publisher.