Hardware Podcasts

Episode 26: A Thesis on AI's Impact on Semi Segments

The Circuit · 23 Jul 2023 · 34m · Episode 28

What this episode covers

Ben Bajarin and Jay Goldberg discuss Jay's thesis on how AI impacts various semiconductor segments, focusing on the shift from training to inference and the competitive landscape. They analyze NVIDIA's dominance in training via CUDA and its 'accelerated computing' stack, while arguing that inference will become the majority of spend, driving growth in edge devices like PCs and phones. The hosts conclude that AI is additive to the total addressable market (TAM) for semiconductors, driven by new data center capacity and on-device processing, rather than simply cannibalizing existing CPU sales.

Most relevant to

large enterprises

Topics

Mentioned

Companies
NVIDIA, TSMC, ASML, AMD, Google, Apple, Qualcomm, MediaTek, Intel
Products
Grace Hopper, MI 300, iPhone
Also
CUDA, PyTorch, Triton, Windows

Related episodes from other shows

Other shows on the same ground, closest first.

  • EE Times Current · 49m

    Can the Nvidia Monopoly on AI Chips Be Broken?

    Sally Ward-Foxton of EE Times discusses the AI chip market with hosts Dr. Sunny Bains and Dr. Giulia D’Angelo, analyzing the dominance of Nvidia and the potential for neuromorphic and specialized inference chips to break its monopoly. The conversation covers the spectrum of AI hardware from data center GPUs to ultra-low-power edge devices, highlighting the critical role of software stacks and latency in determining adoption. Professor Ralph Etienne-Cummings joins to critique the industry's focus on power versus learning capabilities and to discuss the future of neuromorphic computing, including memristors and photonic integration.

    Chips, FPGAs & semiconductorsAI & machine learning
    9 chapters

  • EE Times Current · 34m

    Whither Semiconductors? The Wheels on the Bus Go ‘Round and ‘Round

    Jim McGregor, co-founder of Tirias Research, discusses the evolving competitive landscape of the semiconductor industry, identifying Intel, AMD, and NVIDIA (following its potential acquisition of Arm) as the new dominant trio. He explains how the convergence of computing, connectivity, and intelligence is blurring traditional boundaries, with companies like Qualcomm, Samsung, and MediaTek competing across smartphones, servers, and automotive sectors. McGregor highlights the shift toward heterogeneous computing, specialized accelerators like DPUs, and the move away from monolithic dies toward multi-chip modules and advanced packaging to overcome Moore's Law limitations.

    Chips, FPGAs & semiconductorsMechanical engineering
    8 chapters

  • IoT For All Podcast · 19m

    The Evolution of AI in IoT | BrainChip's Nandan Nayampally | Internet of Things Podcast

    Nandan Nayampally, CMO at BrainChip, discusses the evolution of AIoT and the shift of AI processing from the cloud to the edge. He explains how neuromorphic computing enables real-time, private, and efficient inference on billions of devices, citing PwC's $15 trillion GDP impact estimate. Nayampally highlights key adoption markets like healthcare, agriculture, and infrastructure, and advises companies to focus on solving acute pain points ('headaches') rather than nice-to-have features ('vitamins') to gain traction.

    AI & machine learningConnected products & IoT
    5 chapters

  • Oxide and Friends · 1h 54m

    Heterogeneous Computing with Raja Koduri

    Raja Koduri, former chief architect at Intel and AMD, joins Bryan Cantrill and Adam Leventhal to explain the differences between CPUs, GPUs, FPGAs, and ASICs through historical and analogical lenses. Koduri traces the evolution from 3dfx and Direct3D to CUDA, arguing that NVIDIA’s success stems from a tight coupling of programming and execution models, which creates a sticky ecosystem. He uses transportation analogies to categorize these technologies—cars for CPUs, buses for GPUs, and construction vehicles for FPGAs—and discusses how advanced packaging and memory bandwidth are becoming the primary constraints in modern AI hardware.

    Chips, FPGAs & semiconductorsMicrocontrollers & dev platforms
    8 chapters

  • Built 2 Scale · 1h 08m

    Google TPU vs Nvidia GPUs: Token Per Watt Dominance, or the Era of Scaling Is Over?

    Founders Matt Perrott and Scott Wilcox discuss Google's Gemini 3.0 training on TPUs, which bypasses Nvidia's hardware to achieve a structural cost advantage, and the resulting threat to 'vibe coding' startups like Lovable. They analyze the 'age of scaling is over' consensus among researchers like Ilya Sutskever, arguing that future breakthroughs require real-world spatial intelligence rather than just more compute. The hosts also debate office culture, remote work dynamics, and the three critical roles founders must hire early: product, brand, and sales.

    Chips, FPGAs & semiconductorsAI & machine learning
    6 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by The Circuit. The episode itself belongs to its publisher.