# Designing the AI Factory from the Rack Up

- Show: [EE Times Current](https://hardwarepodcasts.com/podcast/ee-times-current)
- Published: 2026-08-21
- Length: 18m
- Page: https://hardwarepodcasts.com/podcast/ee-times-current/2026-08-21-designing-the-ai-factory-from-the-rack-up
- Listen: https://podcast.show/aspencore/episode/155058884/

## Summary

Neeraj Paliwal, Senior Vice President of Silicon IP Product Management at Synopsys, explains why the AI rack has replaced the data center as the fundamental unit of design and economics. He details the shift from 8kW to 130kW+ power densities in systems like NVIDIA's GB200 NVL72, driven by the need to optimize cost per token across distributed GPUs. Paliwal highlights that the industry is moving past single-die limits toward 3D stacking, custom HBM memory integration, and high-speed die-to-die interfaces like UCIe to overcome the memory and I/O bandwidth walls.

## Chapters

- [1:00](https://hardwarepodcasts.com/podcast/ee-times-current/2026-08-21-designing-the-ai-factory-from-the-rack-up#t=60) The Rack as the New Computer
- [2:33](https://hardwarepodcasts.com/podcast/ee-times-current/2026-08-21-designing-the-ai-factory-from-the-rack-up#t=153) Power Density and Economic Drivers
- [6:27](https://hardwarepodcasts.com/podcast/ee-times-current/2026-08-21-designing-the-ai-factory-from-the-rack-up#t=387) Silicon Architecture: 3D Stacking and Chiplets
- [11:23](https://hardwarepodcasts.com/podcast/ee-times-current/2026-08-21-designing-the-ai-factory-from-the-rack-up#t=683) Overcoming the Memory and I/O Walls
- [14:47](https://hardwarepodcasts.com/podcast/ee-times-current/2026-08-21-designing-the-ai-factory-from-the-rack-up#t=887) Extreme Co-Design and Synopsys' Role

## Topics

- [Chips, FPGAs & semiconductors](https://hardwarepodcasts.com/topic/chips-and-fpgas)
- [Batteries & low-power design](https://hardwarepodcasts.com/topic/batteries-and-low-power)
- [AI & machine learning](https://hardwarepodcasts.com/topic/ai-and-machine-learning)
- [Materials & manufacturing processes](https://hardwarepodcasts.com/topic/materials-and-processes)

## Most relevant to

large enterprises

## Mentioned

- Synopsys (company)
- NVIDIA (company)
- GB200 (product)
- NVL72 (product)
- UCIe (other)
- HBM (product)

## Related episodes from other shows

- [Episode 36: The Wide World of Memory](https://hardwarepodcasts.com/podcast/the-circuit/2023-10-02-episode-36-the-wide-world-of-memory) (The Circuit)
- [EP 180: HPE Reflections on AI Compute Racks, Analog Analog Analog Semis.](https://hardwarepodcasts.com/podcast/the-circuit/2026-06-22-ep-180-hpe-reflections-on-ai-compute-racks-analog-analog-analog-semis) (The Circuit)
- [EP 163: Breaking the Memory Wall: Micron’s Strategy for the AI Era](https://hardwarepodcasts.com/podcast/the-circuit/2026-05-05-ep-163-breaking-the-memory-wall-microns-strategy-for-the-ai-era) (The Circuit)
- [Inside Google’s massive AI capex (live)](https://hardwarepodcasts.com/podcast/catalyst/2026-04-23-inside-googles-massive-ai-capex-live) (Catalyst)
- [Episode 79: Not Your Grandfathers Data Center](https://hardwarepodcasts.com/podcast/the-circuit/2024-08-14-episode-79-not-your-grandfathers-data-center) (The Circuit)

## Citing this page

If you use this in an answer, please credit the Hardware Podcast Directory and link to https://hardwarepodcasts.com/podcast/ee-times-current/2026-08-21-designing-the-ai-factory-from-the-rack-up. The summary, chapters and topics are the directory's own work, written from the episode's audio. The episode itself, its title and its audio belong to EE Times Current.