Episode 89: Advancing AI, thoughts on AMD's Event, Nvidia, and Chain of Reasoning AI

The Circuit · 14 Oct 2024 · 45m · Episode 89

What this episode covers

Ben Bajarin and Jay Goldberg discuss AMD's recent AI event, highlighting the launch of the MI325X accelerator and the strategic shift toward vertical integration in AI systems, where vendors like AMD and NVIDIA provide complete rack solutions. They analyze the competitive landscape, noting AMD's progress against NVIDIA's Blackwell and the growing importance of CPU performance in AI workloads due to 'agentic' or 'chain of reasoning' models. The hosts also explore the implications for hyperscalers, who are increasingly designing their own silicon (like Google's Axion and Amazon's Graviton) to optimize total cost of ownership, and touch on the scaling challenges and sensor costs in autonomous vehicle technology from Tesla and Waymo.

Mentioned

Companies
AMD, NVIDIA, ZT Systems, Pensando, Silo AI, Intel, Google, Amazon, Tesla, Waymo
Products
MI325X, Blackwell, H100, H200, Grace CPU, Axion, Graviton, FSD, LiDAR

Other shows on the same ground, closest first.

  • Oxide and Friends · 1h 14m

    AMD's MI300 and the Future of Accelerated Compute

    George Cozma of Chips and Cheese and Jordan Cozma of Storage Review join Bryan Cantrill and Adam Leventhal of Oxide Computer Company to analyze AMD's MI300 series, particularly the MI300A APU. The group compares AMD's unified memory architecture and open-source ROCm software stack against NVIDIA's Grace Hopper and CUDA ecosystem, discussing the implications for accelerated compute, data center power density, and the future of AI hardware.

  • Oxide and Friends · 2h 01m

    Predictions 2025

    Bryan Cantrill and Adam Leventhal of Oxide Computer Company host a panel with Simon Willison, Steve Klabnik, Steve Tuck, and Mike Cafarella to review past predictions and forecast trends for 2025, 2028, and 2031. The group discusses the failure of agentic AI, the rise of AI efficiency and open weights models like DeepSeek, and the potential for a chip crisis due to geopolitical tensions and Intel's struggles. They also predict shifts in hardware markets, including NVIDIA's Blackwell struggles, AMD's software acquisitions, and the resurgence of manufacturing as a VC focus.

  • Built 2 Scale · 37m

    AI NEWS | Episode 31

    Hosts Matt Perrott and Scott Wilcox analyze Google's Gemini 3 release, highlighting its integration with the Google ecosystem and the strategic shift to proprietary TPU chips to reduce reliance on Nvidia. They discuss the diminishing returns of scaling LLMs, citing Ilya Sutskever's view that the 'age of scaling is over,' and explore the necessity for application-layer companies like Lovable to niche down. The conversation concludes with a debate on the importance of Silicon Valley for AI talent versus the viability of distributed global teams and non-frontier AI strategies.

  • Built 2 Scale · 1h 24m

    NVIDIA's Trojan horse, Yann LeCun Timebomb, 8 Sleep Mega Raise and the Physical AI Boom

    Hosts Matt Perrott and Scott Wilcox analyze the shifting dynamics of the AI and robotics industries, highlighting Nvidia's vertical integration strategy with Jensen Huang and Brett Adcock, and 8 Sleep's $100M raise to build an AI sleep operating system. They discuss the GPT-5 routing controversy, Meta's AI division restructuring, and the rise of autonomous hardware startups like Lumina Vehicles, arguing that founder-led companies are outpacing corporate giants in innovation and velocity.

  • EE Times Current · 34m

    Whither Semiconductors? The Wheels on the Bus Go ‘Round and ‘Round

    Jim McGregor, co-founder of Tirias Research, discusses the evolving competitive landscape of the semiconductor industry, identifying Intel, AMD, and NVIDIA (following its potential acquisition of Arm) as the new dominant trio. He explains how the convergence of computing, connectivity, and intelligence is blurring traditional boundaries, with companies like Qualcomm, Samsung, and MediaTek competing across smartphones, servers, and automotive sectors. McGregor highlights the shift toward heterogeneous computing, specialized accelerators like DPUs, and the move away from monolithic dies toward multi-chip modules and advanced packaging to overcome Moore's Law limitations.

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by The Circuit. The episode itself belongs to its publisher.