Hardware Podcasts

Episode 120: NVIDIA Earnings, The Future of AI inference, China AI and more

The Circuit · 2 Jun 2025 · 43m · Episode 121

What this episode covers

Austin Lyons joins Jay Goldberg to analyze NVIDIA's recent earnings, highlighting the shift from training to inference workloads and the impact of US export bans on China revenue. They discuss the competitive landscape for AI inference, including on-device processing, enterprise AI factories, and the strategic moves by competitors like Google and Dell. The conversation explores the challenges of realizing ROI from massive AI infrastructure investments and the evolving consumer and enterprise use cases for generative AI.

Most relevant to

large enterprises

Topics

Mentioned

Companies
NVIDIA, Dell, Google, Microsoft, OpenAI, HPE, Qualcomm
Products
Blackwell, H20, B200, DGX Spark, RTX Pro, Humane, Rabbit, Perplexity, ChatGPT
Chips
TPU
Also
MCP

Related episodes from other shows

Other shows on the same ground, closest first.

  • EE Times Current · 49m

    Can the Nvidia Monopoly on AI Chips Be Broken?

    Sally Ward-Foxton of EE Times discusses the AI chip market with hosts Dr. Sunny Bains and Dr. Giulia D’Angelo, analyzing the dominance of Nvidia and the potential for neuromorphic and specialized inference chips to break its monopoly. The conversation covers the spectrum of AI hardware from data center GPUs to ultra-low-power edge devices, highlighting the critical role of software stacks and latency in determining adoption. Professor Ralph Etienne-Cummings joins to critique the industry's focus on power versus learning capabilities and to discuss the future of neuromorphic computing, including memristors and photonic integration.

    Chips, FPGAs & semiconductorsAI & machine learning
    9 chapters

  • Built 2 Scale · 1h 14m

    Is ARR a Myth?

    Hosts Matt Perrott and Scott Wilcox discuss the implications of massive talent acquisitions like Meta's purchase of Scale AI, the rapid transformation of Shenzhen's manufacturing sector, and the quality of viral ARR growth in the AI software market. They analyze Jensen Huang's full-stack strategy at NVIDIA's Paris conference, the potential of ChatGPT Projects for client pitches, and the economic divergence between Tesla's vision-based robotaxi and Waymo's LIDAR-heavy approach. The episode concludes with a look at autonomous drone technology and a proposal for Australia to build its own innovation hub.

    AI & machine learningManufacturing partners & offshoring
    7 chapters

  • Catalyst · 47m

    Will inference move to the edge?

    Dr. Ben Lee, a professor at the University of Pennsylvania and visiting researcher at Google, discusses the potential shift of AI inference compute from centralized hyperscale data centers to the edge and on-device. He explains that while training remains centralized due to massive GPU coordination needs, inference is amenable to distributed locations because it lacks the frequent inter-GPU communication spikes that cause power grid instability. Lee predicts that by 2035, up to 80% of inference could occur locally, primarily at edge data centers (10-50 MW) rather than on consumer devices, due to the trade-off between latency/privacy and the hardware constraints of shrinking model capabilities for mobile silicon.

    Energy & climate techAI & machine learning
    6 chapters

  • EE Times Current · 40m

    CEO Interview: Flex Logix’ Geoff Tate on AI | Open Source Hits Hardware

    Geoff Tate, CEO of Flex Logix, explains the distinction between AI training and inference, arguing that engineers must benchmark their specific neural network models on target chips rather than relying on generic metrics like TOPS, which he demonstrates can be misleading compared to real-world performance on models like YOLO V3. Industry analyst Kevin Krewell discusses the rise of open technologies in hardware, tracing the evolution from open source software like Linux to open RAN in networking and the growing ecosystem around the open-source RISC-V architecture as an alternative to proprietary instruction sets like ARM and x86.

    AI & machine learningChips, FPGAs & semiconductors
    6 chapters

  • EE Times Current · 45m

    CEO Interview: Mike Henry of Mythic | The Biggest Chip Deal Ever | Do Androids Dream of Electric Smartphones?

    Mythic co-founder and CEO Mike Henry explains how the company's analog AI accelerator chips use onboard flash memory to achieve best-in-class performance-per-watt for inference tasks like security video analytics and drone depth estimation, avoiding the high power and cost of digital GPUs. Nvidia analyst Kevin Krewell discusses the $40 billion acquisition of Arm by Nvidia, analyzing Jensen Huang's strategic move to control the CPU/GPU ecosystem and the significant regulatory hurdles regarding Arm's monopoly in the smartphone market.

    Chips, FPGAs & semiconductorsPolicy, trade & tariffs
    8 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by The Circuit. The episode itself belongs to its publisher.