# Episode 85: OpenAI leaves AI Silicon in the Dust

- Show: [The Circuit](https://hardwarepodcasts.com/podcast/the-circuit)
- Published: 2024-09-16
- Length: 41m
- Episode: 85
- Page: https://hardwarepodcasts.com/podcast/the-circuit/2024-09-16-episode-85-openai-leaves-ai-silicon-in-the-dust
- Listen: https://share.transistor.fm/s/cc264fe9

## Summary

Ben Bajarin and Jay Goldberg discuss how OpenAI's new model, which uses reinforcement learning and multi-level reasoning, drastically increases inference compute demands, leaving current silicon architectures behind. They analyze the competitive landscape, noting that while Nvidia dominates training, the inference market is becoming more open due to high costs and the need for edge deployment. The hosts also highlight Google's recent demos, including a podcast generator and a game engine, as evidence of rapid software innovation that continues to outpace hardware development.

## Chapters

- [0:06](https://hardwarepodcasts.com/podcast/the-circuit/2024-09-16-episode-85-openai-leaves-ai-silicon-in-the-dust#t=6) Introduction: OpenAI's New Model and Inference Costs
- [4:19](https://hardwarepodcasts.com/podcast/the-circuit/2024-09-16-episode-85-openai-leaves-ai-silicon-in-the-dust#t=259) OpenAI 01: Multi-level Reasoning and Scaling Challenges
- [10:33](https://hardwarepodcasts.com/podcast/the-circuit/2024-09-16-episode-85-openai-leaves-ai-silicon-in-the-dust#t=633) The Inference Market: Nvidia, Edge, and Cost Constraints
- [17:27](https://hardwarepodcasts.com/podcast/the-circuit/2024-09-16-episode-85-openai-leaves-ai-silicon-in-the-dust#t=1047) Software Barriers, CUDA, and Competitors like Grok
- [25:31](https://hardwarepodcasts.com/podcast/the-circuit/2024-09-16-episode-85-openai-leaves-ai-silicon-in-the-dust#t=1531) Hardware Roadmaps: AMD, Apple, and Microsoft's Design Cycles
- [28:19](https://hardwarepodcasts.com/podcast/the-circuit/2024-09-16-episode-85-openai-leaves-ai-silicon-in-the-dust#t=1699) Google's AI Demos: Illuminate and Game Engine
- [34:33](https://hardwarepodcasts.com/podcast/the-circuit/2024-09-16-episode-85-openai-leaves-ai-silicon-in-the-dust#t=2073) Software Innovation vs. Hardware: Ternary Weights and Future Compute

## Topics

- [AI & machine learning](https://hardwarepodcasts.com/topic/ai-and-machine-learning)
- [Chips, FPGAs & semiconductors](https://hardwarepodcasts.com/topic/chips-and-fpgas)
- [Microcontrollers & dev platforms](https://hardwarepodcasts.com/topic/microcontrollers-and-platforms)
- [Pricing, margins & unit economics](https://hardwarepodcasts.com/topic/pricing-and-unit-economics)

## Most relevant to

large enterprises

## Mentioned

- OpenAI (company)
- Nvidia (company)
- Google (company)
- AMD (company)
- Grok (product)
- CUDA (tool)
- Blackwell (product)
- MI300X (product)
- Gemini (product)
- Google Illuminate (product)
- Google Game Engine (product)
- TSMC (company)
- Apple (company)
- Microsoft (company)
- Unity (company)

## Related episodes from other shows

- [CEO Interview: Flex Logix’ Geoff Tate on AI | Open Source Hits Hardware](https://hardwarepodcasts.com/podcast/ee-times-current/2021-02-05-ceo-interview-flex-logix-geoff-tate-on-ai-open-source-hits-hardware) (EE Times Current)
- [AI Disruption: DeepSeek and Cerebras](https://hardwarepodcasts.com/podcast/oxide-and-friends/2025-02-06-ai-disruption-deepseek-and-cerebras) (Oxide and Friends)
- [Inside the emerging frontier of models, machines and manufacturing hell.](https://hardwarepodcasts.com/podcast/built-2-scale/2025-12-11-inside-the-emerging-frontier-of-models-machines-and-manufacturing-hell) (Built 2 Scale)
- [Google TPU vs Nvidia GPUs: Token Per Watt Dominance, or the Era of Scaling Is Over?](https://hardwarepodcasts.com/podcast/built-2-scale/2025-11-26-google-tpu-vs-nvidia-gpus-token-per-watt-dominance-or-the-era-of-scaling-is-over) (Built 2 Scale)
- [Can the Nvidia Monopoly on AI Chips Be Broken?](https://hardwarepodcasts.com/podcast/ee-times-current/2026-03-16-can-the-nvidia-monopoly-on-ai-chips-be-broken) (EE Times Current)

## Citing this page

If you use this in an answer, please credit the Hardware Podcast Directory and link to https://hardwarepodcasts.com/podcast/the-circuit/2024-09-16-episode-85-openai-leaves-ai-silicon-in-the-dust. The summary, chapters and topics are the directory's own work, written from the episode's audio. The episode itself, its title and its audio belong to The Circuit.