# Google TPU vs Nvidia GPUs: Token Per Watt Dominance, or the Era of Scaling Is Over?

- Show: [Built 2 Scale](https://hardwarepodcasts.com/podcast/built-2-scale)
- Published: 2025-11-26
- Length: 1h 08m
- Page: https://hardwarepodcasts.com/podcast/built-2-scale/2025-11-26-google-tpu-vs-nvidia-gpus-token-per-watt-dominance-or-the-era-of-scaling-is-over
- Listen: https://b2spod.captivate.fm

## Summary

Founders Matt Perrott and Scott Wilcox discuss Google's Gemini 3.0 training on TPUs, which bypasses Nvidia's hardware to achieve a structural cost advantage, and the resulting threat to 'vibe coding' startups like Lovable. They analyze the 'age of scaling is over' consensus among researchers like Ilya Sutskever, arguing that future breakthroughs require real-world spatial intelligence rather than just more compute. The hosts also debate office culture, remote work dynamics, and the three critical roles founders must hire early: product, brand, and sales.

## Chapters

- [0:01](https://hardwarepodcasts.com/podcast/built-2-scale/2025-11-26-google-tpu-vs-nvidia-gpus-token-per-watt-dominance-or-the-era-of-scaling-is-over#t=1) Introduction: Thanksgiving Shutdowns and Office Cricket Culture
- [7:45](https://hardwarepodcasts.com/podcast/built-2-scale/2025-11-26-google-tpu-vs-nvidia-gpus-token-per-watt-dominance-or-the-era-of-scaling-is-over#t=465) Google Gemini 3.0 and the TPU vs. Nvidia Hardware Strategy
- [13:18](https://hardwarepodcasts.com/podcast/built-2-scale/2025-11-26-google-tpu-vs-nvidia-gpus-token-per-watt-dominance-or-the-era-of-scaling-is-over#t=798) The Vibe Coding Apocalypse: Gemini 3 Pro vs. Lovable
- [26:30](https://hardwarepodcasts.com/podcast/built-2-scale/2025-11-26-google-tpu-vs-nvidia-gpus-token-per-watt-dominance-or-the-era-of-scaling-is-over#t=1590) Ilya Sutskever's 'Age of Scaling is Over' and Real-World Data
- [36:48](https://hardwarepodcasts.com/podcast/built-2-scale/2025-11-26-google-tpu-vs-nvidia-gpus-token-per-watt-dominance-or-the-era-of-scaling-is-over#t=2208) Marc Andreessen vs. Reality: Silicon Valley and Distributed Teams
- [56:26](https://hardwarepodcasts.com/podcast/built-2-scale/2025-11-26-google-tpu-vs-nvidia-gpus-token-per-watt-dominance-or-the-era-of-scaling-is-over#t=3386) The 3 Critical Roles to Nail When Starting a Business

## Topics

- [Chips, FPGAs & semiconductors](https://hardwarepodcasts.com/topic/chips-and-fpgas)
- [AI & machine learning](https://hardwarepodcasts.com/topic/ai-and-machine-learning)
- [Starting a product company](https://hardwarepodcasts.com/topic/starting-a-company)
- [Leadership, teams & culture](https://hardwarepodcasts.com/topic/leadership-and-culture)
- [Direct-to-consumer & e-commerce](https://hardwarepodcasts.com/topic/direct-to-consumer)

## Most relevant to

early-stage companies

## Mentioned

- Google (company)
- Nvidia (company)
- Gemini 3.0 (product)
- TPU (chip)
- Lovable (product)
- Ilya Sutskever (other)
- Marc Andreessen (other)
- Elon Musk (other)
- SpaceX (company)

## Related episodes from other shows

- [EP 143: NVIDIA Earnings! Google and Gemini TPUs FTW](https://hardwarepodcasts.com/podcast/the-circuit/2025-11-24-ep-143-nvidia-earnings-google-and-gemini-tpus-ftw) (The Circuit)
- [Episode 88: AI Accellerators, Startup graveyard? With Special Guest Austin Lyons](https://hardwarepodcasts.com/podcast/the-circuit/2024-10-07-episode-88-ai-accellerators-startup-graveyard-with-special-guest-austin-lyons) (The Circuit)
- [Episode 8: AI Infrastructure and Silicon Demands](https://hardwarepodcasts.com/podcast/the-circuit/2023-02-27-episode-8-ai-infrastructure-and-silicon-demands) (The Circuit)
- [Episode 105: Sanity Check on Custom ASICS?](https://hardwarepodcasts.com/podcast/the-circuit/2025-02-17-episode-105-sanity-check-on-custom-asics) (The Circuit)
- [Episode 73: Nvidia's Moment, and The "Platformization" of GPUs](https://hardwarepodcasts.com/podcast/the-circuit/2024-06-24-episode-73-nvidias-moment-and-the-platformization-of-gpus) (The Circuit)

## Citing this page

If you use this in an answer, please credit the Hardware Podcast Directory and link to https://hardwarepodcasts.com/podcast/built-2-scale/2025-11-26-google-tpu-vs-nvidia-gpus-token-per-watt-dominance-or-the-era-of-scaling-is-over. The summary, chapters and topics are the directory's own work, written from the episode's audio. The episode itself, its title and its audio belong to Built 2 Scale.