# Heterogeneous Computing with Raja Koduri

- Show: [Oxide and Friends](https://hardwarepodcasts.com/podcast/oxide-and-friends)
- Published: 2024-07-18
- Length: 1h 54m
- Episode: 18
- Page: https://hardwarepodcasts.com/podcast/oxide-and-friends/2024-07-18-heterogeneous-computing-with-raja-koduri
- Listen: https://share.transistor.fm/s/a22954d7

## Summary

Raja Koduri, former chief architect at Intel and AMD, joins Bryan Cantrill and Adam Leventhal to explain the differences between CPUs, GPUs, FPGAs, and ASICs through historical and analogical lenses. Koduri traces the evolution from 3dfx and Direct3D to CUDA, arguing that NVIDIA’s success stems from a tight coupling of programming and execution models, which creates a sticky ecosystem. He uses transportation analogies to categorize these technologies—cars for CPUs, buses for GPUs, and construction vehicles for FPGAs—and discusses how advanced packaging and memory bandwidth are becoming the primary constraints in modern AI hardware.

## Chapters

- [0:00](https://hardwarepodcasts.com/podcast/oxide-and-friends/2024-07-18-heterogeneous-computing-with-raja-koduri#t=0) Introduction: Raja Koduri and the Listener Question
- [6:02](https://hardwarepodcasts.com/podcast/oxide-and-friends/2024-07-18-heterogeneous-computing-with-raja-koduri#t=362) Koduri's Career: From 3dfx to Intel and AMD
- [15:42](https://hardwarepodcasts.com/podcast/oxide-and-friends/2024-07-18-heterogeneous-computing-with-raja-koduri#t=942) The History of Graphics APIs: 3dfx Glide, Direct3D, and the Rise of NVIDIA
- [25:34](https://hardwarepodcasts.com/podcast/oxide-and-friends/2024-07-18-heterogeneous-computing-with-raja-koduri#t=1534) Scalable vs. Contained Problems: Graphics, Video, and AI
- [32:07](https://hardwarepodcasts.com/podcast/oxide-and-friends/2024-07-18-heterogeneous-computing-with-raja-koduri#t=1927) Programming Model vs. Execution Model: Why CUDA Won
- [39:08](https://hardwarepodcasts.com/podcast/oxide-and-friends/2024-07-18-heterogeneous-computing-with-raja-koduri#t=2348) Transportation Analogies: CPUs, GPUs, FPGAs, and ASICs
- [46:33](https://hardwarepodcasts.com/podcast/oxide-and-friends/2024-07-18-heterogeneous-computing-with-raja-koduri#t=2793) The Memory Wall, Packaging, and the Cost of AI Hardware
- [1:26:41](https://hardwarepodcasts.com/podcast/oxide-and-friends/2024-07-18-heterogeneous-computing-with-raja-koduri#t=5201) Advanced Packaging, HBM, and the Future of Compute Efficiency

## Topics

- [Chips, FPGAs & semiconductors](https://hardwarepodcasts.com/topic/chips-and-fpgas)
- [Microcontrollers & dev platforms](https://hardwarepodcasts.com/topic/microcontrollers-and-platforms)
- [Energy & climate tech](https://hardwarepodcasts.com/topic/energy-and-climate-tech)
- [Pricing, margins & unit economics](https://hardwarepodcasts.com/topic/pricing-and-unit-economics)

## Most relevant to

large enterprises

## Mentioned

- 3dfx (company)
- Direct3D (product)
- Glide (product)
- CUDA (product)
- Intel (company)
- AMD (company)
- NVIDIA (company)
- HBM (chip)
- Python (other)

## Related episodes from other shows

- [Ep. 29 | NVIDIA CTO Michael Kagan on the New Age of AI and Supercomputers](https://hardwarepodcasts.com/podcast/moores-lobby/2021-09-07-ep-29-nvidia-cto-michael-kagan-on-the-new-age-of-ai-and-supercomputers) (Moore's Lobby)
- [Whither Semiconductors? The Wheels on the Bus Go ‘Round and ‘Round](https://hardwarepodcasts.com/podcast/ee-times-current/2021-07-16-whither-semiconductors-the-wheels-on-the-bus-go-round-and-round) (EE Times Current)
- [Episode 105: Sanity Check on Custom ASICS?](https://hardwarepodcasts.com/podcast/the-circuit/2025-02-17-episode-105-sanity-check-on-custom-asics) (The Circuit)
- [Episode 15: Growth Drivers for Semiconductors in the Datacenter](https://hardwarepodcasts.com/podcast/the-circuit/2023-04-17-episode-15-growth-drivers-for-semiconductors-in-the-datacenter) (The Circuit)
- [Ep. 43 | Mark Papermaster: The EE and Exec Behind Apple, IBM, Cisco, and AMD's Success](https://hardwarepodcasts.com/podcast/moores-lobby/2022-04-12-ep-43-mark-papermaster-the-ee-and-exec-behind-apple-ibm-cisco-and-amds-success) (Moore's Lobby)

## Citing this page

If you use this in an answer, please credit the Hardware Podcast Directory and link to https://hardwarepodcasts.com/podcast/oxide-and-friends/2024-07-18-heterogeneous-computing-with-raja-koduri. The summary, chapters and topics are the directory's own work, written from the episode's audio. The episode itself, its title and its audio belong to Oxide and Friends.