Hardware Podcasts

Episode 23: Emerging Competitive Dynamics in Silicon Thanks AI

The Circuit · 19 Jun 2023 · 33m · Episode 24

What this episode covers

Ben Bajarin and Jay Goldberg discuss the emerging competitive dynamics in the semiconductor industry driven by AI, debating whether AI spending is additive to data center capital expenditure or cannibalizes traditional cloud processor budgets. They analyze AMD's recent AI and Datacenter event, highlighting the MI300X chip and its modular chiplet architecture as a strategic response to NVIDIA's dominance in training workloads. The hosts also examine the shift toward Total Cost of Ownership (TCO) and performance-per-watt metrics in the 'cloud native' segment, where AMD and Intel are competing with ARM-based designs like those from Ampere and Amazon Graviton.

Most relevant to

large enterprises

Topics

Mentioned

Companies
NVIDIA, AMD, Qualcomm, Ampere, Intel
Products
MI300X, Amazon Graviton

Related episodes from other shows

Other shows on the same ground, closest first.

  • EE Times Current · 34m

    Whither Semiconductors? The Wheels on the Bus Go ‘Round and ‘Round

    Jim McGregor, co-founder of Tirias Research, discusses the evolving competitive landscape of the semiconductor industry, identifying Intel, AMD, and NVIDIA (following its potential acquisition of Arm) as the new dominant trio. He explains how the convergence of computing, connectivity, and intelligence is blurring traditional boundaries, with companies like Qualcomm, Samsung, and MediaTek competing across smartphones, servers, and automotive sectors. McGregor highlights the shift toward heterogeneous computing, specialized accelerators like DPUs, and the move away from monolithic dies toward multi-chip modules and advanced packaging to overcome Moore's Law limitations.

    Chips, FPGAs & semiconductorsMechanical engineering
    8 chapters

  • Oxide and Friends · 1h 14m

    AMD's MI300 and the Future of Accelerated Compute

    George Cozma of Chips and Cheese and Jordan Cozma of Storage Review join Bryan Cantrill and Adam Leventhal of Oxide Computer Company to analyze AMD's MI300 series, particularly the MI300A APU. The group compares AMD's unified memory architecture and open-source ROCm software stack against NVIDIA's Grace Hopper and CUDA ecosystem, discussing the implications for accelerated compute, data center power density, and the future of AI hardware.

    Chips, FPGAs & semiconductorsAI & machine learning
    6 chapters

  • EE Times Current · 41m

    Interview: AMD CTO Papermaster | Interview: Imagination CEO Black | Where to Invest in 2020

    AMD CTO Mark Papermaster discusses the company's transition to 7nm Zen architecture, chiplet-based designs like the Threadripper 3990X, and the integration of specialized accelerators for AI workloads. Imagination Technologies CEO Ron Black explains the company's strategic pivot toward automotive graphics, ray tracing, and RISC-V cores, highlighting the resumption of its partnership with Apple. EE Times editors analyze 2020 investment trends, emphasizing that data generation from apps is driving semiconductor growth, with specific focus on memory, RF front-ends, and power infrastructure in developing economies.

    Chips, FPGAs & semiconductorsAI & machine learning
    5 chapters

  • EE Times Current · 49m

    Can the Nvidia Monopoly on AI Chips Be Broken?

    Sally Ward-Foxton of EE Times discusses the AI chip market with hosts Dr. Sunny Bains and Dr. Giulia D’Angelo, analyzing the dominance of Nvidia and the potential for neuromorphic and specialized inference chips to break its monopoly. The conversation covers the spectrum of AI hardware from data center GPUs to ultra-low-power edge devices, highlighting the critical role of software stacks and latency in determining adoption. Professor Ralph Etienne-Cummings joins to critique the industry's focus on power versus learning capabilities and to discuss the future of neuromorphic computing, including memristors and photonic integration.

    Chips, FPGAs & semiconductorsAI & machine learning
    9 chapters

  • EE Times Current · 18m

    Designing the AI Factory from the Rack Up

    Neeraj Paliwal, Senior Vice President of Silicon IP Product Management at Synopsys, explains why the AI rack has replaced the data center as the fundamental unit of design and economics. He details the shift from 8kW to 130kW+ power densities in systems like NVIDIA's GB200 NVL72, driven by the need to optimize cost per token across distributed GPUs. Paliwal highlights that the industry is moving past single-die limits toward 3D stacking, custom HBM memory integration, and high-speed die-to-die interfaces like UCIe to overcome the memory and I/O bandwidth walls.

    Chips, FPGAs & semiconductorsBatteries & low-power design
    5 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by The Circuit. The episode itself belongs to its publisher.