Hardware Podcasts

Episode 63: The Continued March of Custom Silicon, is it Sustainable?

The Circuit · 15 Apr 2024 · 44m · Episode 64

What this episode covers

Ben Baharan and Jay Goldberg discuss the accelerating trend of hyper-scalers like Google, Amazon, and Microsoft developing custom silicon, including Google's Axion CPU and Meta's accelerator, to reduce reliance on NVIDIA. They analyze the strategic trade-offs between internal efficiency and third-party adoption, noting that while custom accelerators like TPUs succeed for Google, others like AWS Inferentia have struggled with external market penetration. The hosts also critique the industry's unreliable market sizing forecasts and highlight the ongoing uncertainty regarding whether enterprises will stick with NVIDIA or shift to custom solutions as they scale AI deployments.

Most relevant to

large enterprises

Topics

Mentioned

Companies
Google, Amazon, Meta, Intel, NVIDIA, Marvell, Global Unichip, TSMC, CoreWeave
Products
Axion, TPU, Graviton, Inferentia, Gaudi 3

Related episodes from other shows

Other shows on the same ground, closest first.

  • EE Times Current · 29m

    How Much is Enough for Hyperscale Companies?

    Brian Santo hosts a discussion on how hyperscale companies like Google, Facebook, Amazon, and Microsoft are reshaping the semiconductor industry by demanding extreme power efficiency and designing custom AI accelerators. Experts Rick Merritt, Gary Hilson, and Dylan McGrath explain that these giants are pushing beyond standard roadmaps, collaborating directly with equipment vendors like Applied Materials, and leveraging their vast capital to drive innovation in memory and process technology. The episode concludes with Wally Rhines' insight that these companies' ultimate goal is owning the data and systems rather than just selling silicon, raising concerns about their growing societal power.

    Chips, FPGAs & semiconductorsSourcing & supply chain
    6 chapters

  • Built 2 Scale · 1h 08m

    Google TPU vs Nvidia GPUs: Token Per Watt Dominance, or the Era of Scaling Is Over?

    Founders Matt Perrott and Scott Wilcox discuss Google's Gemini 3.0 training on TPUs, which bypasses Nvidia's hardware to achieve a structural cost advantage, and the resulting threat to 'vibe coding' startups like Lovable. They analyze the 'age of scaling is over' consensus among researchers like Ilya Sutskever, arguing that future breakthroughs require real-world spatial intelligence rather than just more compute. The hosts also debate office culture, remote work dynamics, and the three critical roles founders must hire early: product, brand, and sales.

    Chips, FPGAs & semiconductorsAI & machine learning
    6 chapters

  • Built 2 Scale · 37m

    AI NEWS | Episode 31

    Hosts Matt Perrott and Scott Wilcox analyze Google's Gemini 3 release, highlighting its integration with the Google ecosystem and the strategic shift to proprietary TPU chips to reduce reliance on Nvidia. They discuss the diminishing returns of scaling LLMs, citing Ilya Sutskever's view that the 'age of scaling is over,' and explore the necessity for application-layer companies like Lovable to niche down. The conversation concludes with a debate on the importance of Silicon Valley for AI talent versus the viability of distributed global teams and non-frontier AI strategies.

    AI & machine learningChips, FPGAs & semiconductors
    8 chapters

  • EE Times Current · 49m

    Can the Nvidia Monopoly on AI Chips Be Broken?

    Sally Ward-Foxton of EE Times discusses the AI chip market with hosts Dr. Sunny Bains and Dr. Giulia D’Angelo, analyzing the dominance of Nvidia and the potential for neuromorphic and specialized inference chips to break its monopoly. The conversation covers the spectrum of AI hardware from data center GPUs to ultra-low-power edge devices, highlighting the critical role of software stacks and latency in determining adoption. Professor Ralph Etienne-Cummings joins to critique the industry's focus on power versus learning capabilities and to discuss the future of neuromorphic computing, including memristors and photonic integration.

    Chips, FPGAs & semiconductorsAI & machine learning
    9 chapters

  • Built 2 Scale · 1h 14m

    Is ARR a Myth?

    Hosts Matt Perrott and Scott Wilcox discuss the implications of massive talent acquisitions like Meta's purchase of Scale AI, the rapid transformation of Shenzhen's manufacturing sector, and the quality of viral ARR growth in the AI software market. They analyze Jensen Huang's full-stack strategy at NVIDIA's Paris conference, the potential of ChatGPT Projects for client pitches, and the economic divergence between Tesla's vision-based robotaxi and Waymo's LIDAR-heavy approach. The episode concludes with a look at autonomous drone technology and a proposal for Australia to build its own innovation hub.

    AI & machine learningManufacturing partners & offshoring
    7 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by The Circuit. The episode itself belongs to its publisher.