Hardware Podcasts

A skeptic’s take on AI electricity load growth

Catalyst · 6 Mar 2025 · 54m

What this episode covers

Jonathan Koomey, founder of Koomey Analytics, challenges the prevailing narrative of explosive AI-driven electricity load growth, arguing that historical data shows efficiency gains typically outpace demand increases. He explains that current forecasts often rely on Nvidia’s sales projections rather than actual service demand, ignoring the potential for significant efficiency improvements in software, algorithms, and specialized hardware. Koomey suggests that infrastructure constraints, such as transformer and labor shortages, will force the industry to prioritize efficiency, leading to a growth pattern similar to the 2010-2018 period where compute output surged while electricity use remained modest.

Most relevant to

early-stage companies

Topics

Mentioned

Companies
Koomey Analytics, Lawrence Berkeley National Laboratory, Nvidia, International Energy Agency, EnergyHub
Products
Deep Seek

Related episodes from other shows

Other shows on the same ground, closest first.

  • The Circuit · 41m

    Episode 75: The AI Big $$$ Question

    Ben Bajarin and Jay Goldberg discuss the skepticism surrounding the monetization of the massive $600 billion investment in AI infrastructure, citing reports from Sequoia and Goldman Sachs. They analyze why current AI applications, such as Microsoft Copilot and coding assistants, offer only modest productivity gains that do not justify the capital expenditure. The hosts also examine the critical constraints of power generation, noting the need for 47 gigawatts of new capacity by 2030, and compare the current AI build-out to historical infrastructure bubbles like railroads and fiber optics.

    Pricing, margins & unit economicsEnergy & climate tech
    7 chapters

  • The Amp Hour · 1h 05m

    All Heat, No Useful Work

    Dave Jones and Chris Gammell discuss the massive energy demands and infrastructure challenges of AI data centers, noting that 100% of input power becomes heat and requiring extensive cooling and diesel backup. They cover supply chain constraints, including a three-year backlog for transformers and a 40% surge in bareboard PCB prices driven by AI server demand. The conversation shifts to practical electronics work, where Chris details building a power-injecting Tag-Connect debug board and using Claude to implement SMP firmware updates over web serial, while Dave shares his frustration with a solar monitoring service's price hike and his son's struggles with Linux at school.

    PCB design & layoutEmbedded firmware
    7 chapters

  • The Circuit · 1h 04m

    EP 186: Mobile Bottlenecks, Skyrocketing AI CapEx, and the Compute Crunch

    Hosts Ben Bajarin and Jay Goldberg analyze recent earnings from Apple, Qualcomm, ARM, and MediaTek, highlighting severe mobile supply chain bottlenecks and soft demand driven by elevated memory costs and foundry capacity constraints. They discuss skyrocketing hyperscaler CapEx from Amazon, Microsoft, and Meta, focusing on the transition from AI training to inference, the rise of behind-the-meter power solutions like Bloom Energy, and critical labor shortages in electrical trades. The episode concludes with an examination of market volatility linked to hedge fund unwinds and the increasing reliance on debt financing for data center expansion.

    Sourcing & supply chainEnergy & climate tech
    10 chapters

  • The Circuit · 38m

    Episode 8: AI Infrastructure and Silicon Demands

    Ben Bajarin and Jay Goldberg discuss the immense compute demands of training large foundational models like GPT-3 and GPT-4, noting that Nvidia’s A100 and H100 GPUs dominate this $300 billion infrastructure market due to CUDA’s software moat. They analyze the bottleneck in inference scalability, arguing that while training is a small fraction of the market, inference costs will drop as incumbents like Google, Amazon, and Apple leverage their own silicon, leaving little room for new AI accelerator startups. The hosts conclude that generative AI represents a powerful new category of productivity software rather than a fundamental shift in human-computer interaction, driving data center Capex through natural upgrade cycles rather than complete rebuilds.

    Chips, FPGAs & semiconductorsConnected products & IoT
    8 chapters

  • The Circuit · 52m

    EP 147: Talking All Things AI with Benedict Evans

    Benedict Evans, a technology analyst and author, discusses the current state of AI with hosts Ben Bajarin and Jay Goldberg, comparing the industry's early uncertainty to the internet in 1997. Evans argues that while general-purpose models are becoming commodities, value will accrue to companies that productize these models into specific workflows rather than relying on blank prompts. He draws a parallel between Nvidia and Sun Microsystems, suggesting that Nvidia's current dominance may face long-term pressure from Moore's Law and commoditization, similar to how Sun was eventually squeezed by general-purpose PCs.

    AI & machine learningValidation & product-market fit
    6 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by Catalyst. The episode itself belongs to its publisher.