Hardware Podcasts

The state of play of data center development

Catalyst · 12 Jun 2025 · 36m

What this episode covers

Chris Sharp, CTO of Digital Realty, explains that AI inference workloads are clustering in existing availability zones like Northern Virginia due to latency and throughput requirements, creating 'data gravity' that drives regional growth. He details how grid interconnection delays and equipment bottlenecks, such as 50-week transformer lead times, are extending project timelines beyond the standard two years. Sharp also discusses the role of 'bridge power' and diesel generators as necessary short-term solutions to meet SLAs while waiting for grid upgrades, noting that liquid cooling increases reliability demands rather than reducing them.

Most relevant to

large enterprises

Topics

Mentioned

Companies
Digital Realty, EnergyHub, Nvidia, Novo Nordisk
Products
DGX pods, Gemini, VO3
Also
Anza

Related episodes from other shows

Other shows on the same ground, closest first.

  • The Amp Hour · 1h 05m

    All Heat, No Useful Work

    Dave Jones and Chris Gammell discuss the massive energy demands and infrastructure challenges of AI data centers, noting that 100% of input power becomes heat and requiring extensive cooling and diesel backup. They cover supply chain constraints, including a three-year backlog for transformers and a 40% surge in bareboard PCB prices driven by AI server demand. The conversation shifts to practical electronics work, where Chris details building a power-injecting Tag-Connect debug board and using Claude to implement SMP firmware updates over web serial, while Dave shares his frustration with a solar monitoring service's price hike and his son's struggles with Linux at school.

    PCB design & layoutEmbedded firmware
    7 chapters

  • Manufacturing Happy Hour · 36m

    259: Data Centers, Modularity, and Mission Critical Manufacturing featuring Keith Hutchens of BW Design Group

    Keith Hutchens, Partner at BW Design Group (part of Barry-Wehmiller), discusses the transformative impact of AI-driven data center construction on the manufacturing supply chain, noting that capacity is doubling every 3-4 years and creating severe strain on components like transformers and PLCs. He explains how modularity allows builders to manufacture units in parallel before site selection, a critical strategy for hyperscalers racing for speed to market. Hutchens also details BW Design Group's shift from commercial DDC controls to industrial PLCs for mission-critical redundancy and outlines their 'truly human leadership' philosophy, which includes formal principal engineer tracks and flexible relocation programs to manage large, dispersed site teams.

    Scaling productionEmbedded firmware
    7 chapters

  • The Circuit · 1h 04m

    EP 186: Mobile Bottlenecks, Skyrocketing AI CapEx, and the Compute Crunch

    Hosts Ben Bajarin and Jay Goldberg analyze recent earnings from Apple, Qualcomm, ARM, and MediaTek, highlighting severe mobile supply chain bottlenecks and soft demand driven by elevated memory costs and foundry capacity constraints. They discuss skyrocketing hyperscaler CapEx from Amazon, Microsoft, and Meta, focusing on the transition from AI training to inference, the rise of behind-the-meter power solutions like Bloom Energy, and critical labor shortages in electrical trades. The episode concludes with an examination of market volatility linked to hedge fund unwinds and the increasing reliance on debt financing for data center expansion.

    Sourcing & supply chainEnergy & climate tech
    10 chapters

  • The Circuit · 40m

    Episode 79: Not Your Grandfathers Data Center

    Ben Bajarin and Jay Goldberg discuss the recent volatility in the semiconductor stock market, attributing it to a 'bubble over' rather than fundamental shifts, while noting that AI's benefits are unevenly distributed. They analyze the evolving architecture of AI data centers, arguing that power constraints and liquid cooling requirements are forcing a shift from air-cooled racks to new designs with higher GPU-to-CPU ratios. The hosts also examine the automotive semiconductor sector, highlighting weak demand driven by high EV inventory in China and the divergence between analog and digital cyclicality.

    Chips, FPGAs & semiconductorsScaling production
    5 chapters

  • Over the Air · 25m

    Industrial Digital Transformation with Aravind Yarlagadda, Chief Digital Officer at Eaton

    Aravind Yarlagadda, Chief Digital Officer at Eaton, discusses the company's transformation into an 'intelligent power management' provider, moving beyond hardware to offer data-driven solutions for utilities, data centers, and industrial processes. He outlines a three-phase maturity model for industrial digital transformation, categorizing companies as legacy, software-focused, or fully digitalized, and argues that most industrials are stuck in the early stages. Yarlagadda also addresses the looming 'infrastructure apocalypse' for EV charging grids, emphasizing the need for advanced modeling tools to manage grid capacity and reliability as electrification scales.

    Connected products & IoTEnergy & climate tech
    6 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by Catalyst. The episode itself belongs to its publisher.