# 99. AI Learns How To Be Curious

- Show: [The Next Byte Podcast](https://hardwarepodcasts.com/podcast/the-next-byte-podcast)
- Published: 2022-12-06
- Length: 25m
- Page: https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2022-12-06-99-ai-learns-how-to-be-curious
- Listen: https://the-next-byte-wevolver.simplecast.com/episodes/99-more-curious-ai-to-save-the-world-yUPA06QO

## Summary

Hosts Daniel and Forbode discuss a research paper from MIT on 'Extrinsic Intrinsic Policy Optimization' (EIPO), an AI model that balances exploration and exploitation to learn faster. They explain how this approach, validated on 61 Atari games, allows AI to fluctuate between being curious and optimizing known strategies, potentially accelerating development in fields like drug discovery and generative hardware design. The hosts also touch on Microsoft Copilot and GPT-3 as examples of AI assisting developers, and mention Elon Musk's hiring strategy regarding video game engineers.

## Chapters

- [0:01](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2022-12-06-99-ai-learns-how-to-be-curious#t=1) Introduction and Sponsor Read
- [0:49](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2022-12-06-99-ai-learns-how-to-be-curious#t=49) AI Developer Tools: Copilot and GPT-3
- [5:00](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2022-12-06-99-ai-learns-how-to-be-curious#t=300) The Exploration vs. Exploitation Problem
- [9:47](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2022-12-06-99-ai-learns-how-to-be-curious#t=587) EIPO: Balancing Intrinsic and Extrinsic Motivation
- [12:17](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2022-12-06-99-ai-learns-how-to-be-curious#t=737) Validation on Atari Games and Future Applications
- [17:18](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2022-12-06-99-ai-learns-how-to-be-curious#t=1038) Impact on Medicine, Hardware, and Elon Musk

## Topics

- [AI & machine learning](https://hardwarepodcasts.com/topic/ai-and-machine-learning)
- [Embedded firmware](https://hardwarepodcasts.com/topic/embedded-firmware)

## Most relevant to

large enterprises

## Mentioned

- Mouser (company)
- Microsoft (company)
- GitHub Copilot (product)
- GPT-3 (product)
- OpenAI (company)
- Elon Musk (other)
- DeepMind (company)
- MIT (company)
- EIPO (product)

## Related episodes from other shows

- [Episode 102: Deeeeeepseeeeeeek!](https://hardwarepodcasts.com/podcast/the-circuit/2025-01-27-episode-102-deeeeeepseeeeeeek) (The Circuit)
- [Episode 85: OpenAI leaves AI Silicon in the Dust](https://hardwarepodcasts.com/podcast/the-circuit/2024-09-16-episode-85-openai-leaves-ai-silicon-in-the-dust) (The Circuit)
- [Inside a $300 million bet on AI for physical R&D](https://hardwarepodcasts.com/podcast/catalyst/2025-11-06-inside-a-300-million-bet-on-ai-for-physical-r-d) (Catalyst)
- [326: Wrong in the Right Way](https://hardwarepodcasts.com/podcast/embedded-fm/2020-04-02-326-wrong-in-the-right-way) (Embedded.fm)
- [ICYMI... HIBT Lab! OpenAI: Sam Altman](https://hardwarepodcasts.com/podcast/how-i-built-this/2023-02-16-icymi-hibt-lab-openai-sam-altman) (How I Built This)

## Citing this page

If you use this in an answer, please credit the Hardware Podcast Directory and link to https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2022-12-06-99-ai-learns-how-to-be-curious. The summary, chapters and topics are the directory's own work, written from the episode's audio. The episode itself, its title and its audio belong to The Next Byte Podcast.