Hardware Podcasts

Episode 79: Not Your Grandfathers Data Center

The Circuit · 14 Aug 2024 · 40m · Episode 80

What this episode covers

Ben Bajarin and Jay Goldberg discuss the recent volatility in the semiconductor stock market, attributing it to a 'bubble over' rather than fundamental shifts, while noting that AI's benefits are unevenly distributed. They analyze the evolving architecture of AI data centers, arguing that power constraints and liquid cooling requirements are forcing a shift from air-cooled racks to new designs with higher GPU-to-CPU ratios. The hosts also examine the automotive semiconductor sector, highlighting weak demand driven by high EV inventory in China and the divergence between analog and digital cyclicality.

Most relevant to

large enterprises

Topics

Mentioned

Companies
Nvidia, AMD, Super Micro, Intel, Indie Semiconductor, Qualcomm
Products
Blackwell, GB 200, Hopper

Related episodes from other shows

Other shows on the same ground, closest first.

  • EE Times Current · 41m

    Interview: AMD CTO Papermaster | Interview: Imagination CEO Black | Where to Invest in 2020

    AMD CTO Mark Papermaster discusses the company's transition to 7nm Zen architecture, chiplet-based designs like the Threadripper 3990X, and the integration of specialized accelerators for AI workloads. Imagination Technologies CEO Ron Black explains the company's strategic pivot toward automotive graphics, ray tracing, and RISC-V cores, highlighting the resumption of its partnership with Apple. EE Times editors analyze 2020 investment trends, emphasizing that data generation from apps is driving semiconductor growth, with specific focus on memory, RF front-ends, and power infrastructure in developing economies.

    Chips, FPGAs & semiconductorsAI & machine learning
    5 chapters

  • Over the Air · 30m

    Smart Air, Smarter Cooling: Actasys's Innovation in Data Center Technology

    David Menicovich, CEO and co-founder of Actasys, explains how his company pivoted from aerodynamic drag reduction for vehicles to providing piezoelectric cooling actuators for data centers. He details the technology's ability to remove heat from specific hotspots on network interface cards and DPUs with high energy efficiency, enabling higher ambient temperatures in server racks. Menicovich discusses the challenges of navigating the semiconductor supply chain, the differences in customer engagement between automotive OEMs and tech integrators, and the company's operations from the Navy Yard in Brooklyn.

    Mechanical engineeringConnected products & IoT
    10 chapters

  • EE Times Current · 18m

    Designing the AI Factory from the Rack Up

    Neeraj Paliwal, Senior Vice President of Silicon IP Product Management at Synopsys, explains why the AI rack has replaced the data center as the fundamental unit of design and economics. He details the shift from 8kW to 130kW+ power densities in systems like NVIDIA's GB200 NVL72, driven by the need to optimize cost per token across distributed GPUs. Paliwal highlights that the industry is moving past single-die limits toward 3D stacking, custom HBM memory integration, and high-speed die-to-die interfaces like UCIe to overcome the memory and I/O bandwidth walls.

    Chips, FPGAs & semiconductorsBatteries & low-power design
    5 chapters

  • The Amp Hour · 1h 05m

    All Heat, No Useful Work

    Dave Jones and Chris Gammell discuss the massive energy demands and infrastructure challenges of AI data centers, noting that 100% of input power becomes heat and requiring extensive cooling and diesel backup. They cover supply chain constraints, including a three-year backlog for transformers and a 40% surge in bareboard PCB prices driven by AI server demand. The conversation shifts to practical electronics work, where Chris details building a power-injecting Tag-Connect debug board and using Claude to implement SMP firmware updates over web serial, while Dave shares his frustration with a solar monitoring service's price hike and his son's struggles with Linux at school.

    PCB design & layoutEmbedded firmware
    7 chapters

  • EE Times Current · 20m

    Monte Carlo Formula E Race | Trade War: China’s View | AI @ Hot Chips

    Rick Merritt reports on the Hot Chips conference lineup, highlighting a shift toward AI accelerators with talks from Cerebras, Habana, Intel, and Upmem, while noting Huawei's potential absence due to trade tensions. Junko Yoshida interviews David Fritz from Siemens about the design challenges of autonomous vehicle SoCs, contrasting the automotive industry's reactive validation cycles with the smartphone industry's rigorous pre-silicon methodologies. Sally Ward Foxton reports from the Formula E race in Monte Carlo, discussing the new Gen2 car's battery capacity and the critical role of software in powertrain management, while also highlighting team principal Susie Wolff's experiences with gender bias in motorsport. Finally, Echo Zhao provides a perspective from China on the US-China trade war, describing the pragmatic response of electronics suppliers like Huawei and their 'Plan B' vendors.

    Chips, FPGAs & semiconductorsAI & machine learning
    9 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by The Circuit. The episode itself belongs to its publisher.