Hardware Podcasts

99. AI Learns How To Be Curious

The Next Byte Podcast · 6 Dec 2022 · 25m

What this episode covers

Hosts Daniel and Forbode discuss a research paper from MIT on 'Extrinsic Intrinsic Policy Optimization' (EIPO), an AI model that balances exploration and exploitation to learn faster. They explain how this approach, validated on 61 Atari games, allows AI to fluctuate between being curious and optimizing known strategies, potentially accelerating development in fields like drug discovery and generative hardware design. The hosts also touch on Microsoft Copilot and GPT-3 as examples of AI assisting developers, and mention Elon Musk's hiring strategy regarding video game engineers.

Most relevant to

large enterprises

Topics

Mentioned

Companies
Mouser, Microsoft, OpenAI, DeepMind, MIT
Products
GitHub Copilot, GPT-3, EIPO
Also
Elon Musk

Related episodes from other shows

Other shows on the same ground, closest first.

  • The Circuit · 42m

    Episode 102: Deeeeeepseeeeeeek!

    Ben Bajarin and Jay Goldberg analyze the market reaction to DeepSeek's new AI model, discussing its training efficiency, the skepticism surrounding its GPU usage claims, and the implications for AI infrastructure spending. They examine the 'Stargate' partnership between OpenAI, Oracle, SoftBank, and MGX, questioning the $100-500 billion valuation and the strategic shift away from Microsoft Azure. The hosts also explore the future of 'ambient agents' and the long-term economic thesis for AI compute demand.

    AI & machine learningPricing, margins & unit economics
    6 chapters

  • The Circuit · 41m

    Episode 85: OpenAI leaves AI Silicon in the Dust

    Ben Bajarin and Jay Goldberg discuss how OpenAI's new model, which uses reinforcement learning and multi-level reasoning, drastically increases inference compute demands, leaving current silicon architectures behind. They analyze the competitive landscape, noting that while Nvidia dominates training, the inference market is becoming more open due to high costs and the need for edge deployment. The hosts also highlight Google's recent demos, including a podcast generator and a game engine, as evidence of rapid software innovation that continues to outpace hardware development.

    AI & machine learningChips, FPGAs & semiconductors
    7 chapters

  • Catalyst · 36m

    Inside a $300 million bet on AI for physical R&D

    Ekin Dogus Cubuk, co-founder of Periodic Labs, explains how his company combines frontier AI models with automated physical labs to accelerate materials discovery. Cubuk argues that recent advances in reasoning models like OpenAI's O1 and improved lab automation allow AI to overcome its reliance on limited training data by generating synthetic data and running high-throughput experiments. The company is targeting breakthrough materials, specifically high-temperature superconductors, using a hybrid approach where humans provide initial hypotheses and AI handles execution and iteration. With a $300 million seed round, Periodic Labs aims to build a generalized scientific intelligence platform that serves both its own discovery goals and external partners' R&D needs.

    AI & machine learningMaterials & manufacturing processes
    10 chapters

  • Embedded.fm · 1h 03m

    326: Wrong in the Right Way

    Erin Talvitie, an associate professor at Harvey Mudd College, discusses the challenges of model-based reinforcement learning, using the Atari game Pong to illustrate how small prediction errors can lead to catastrophic planning failures. She explains her research on 'hallucinated replay' and designing models that are 'wrong in the right way' to mitigate these issues. The conversation also covers the distinction between machine learning and artificial intelligence, recommended textbooks for learning the field, and the immediate ethical concerns of AI surveillance and bias.

    AI & machine learningEmbedded firmware
    6 chapters

  • How I Built This · 58m

    ICYMI... HIBT Lab! OpenAI: Sam Altman

    Sam Altman, co-founder of OpenAI and former president of Y Combinator, discusses the evolution of artificial intelligence from narrow tasks to the pursuit of Artificial General Intelligence (AGI). He details OpenAI's structural shift from a nonprofit to a hybrid model to secure necessary capital, the strategic decision to keep powerful models like GPT-3 behind an API for safety control, and his vision for AI as a ubiquitous, helpful companion rather than just a job-replacing tool.

    AI & machine learningStarting a product company
    7 chapters

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by The Next Byte Podcast. The episode itself belongs to its publisher.