Episode 136: Making driverless vehicles smarter - Shimon Whiteson

Robot Talk · 5 Dec 2025 · 33m · Episode 136

What this episode covers

Shimon Whiteson, a Professor at the University of Oxford and Senior Staff Research Scientist at Waymo, explains how deep reinforcement learning and imitation learning are used to make driverless vehicles smarter. He details the acquisition of his spinout company, Latent Logic, by Waymo in 2019 to improve simulation realism by modeling human road users. Whiteson discusses Waymo's multimodal sensor architecture (cameras, lidar, radar), the importance of data curation for rare safety-related conflicts, and the company's patient, capital-intensive strategy that has led to its commercial robotaxi leadership.

Other shows on the same ground, closest first.

  • How I Built This · 41m

    The future of driving is autonomous with Dmitri Dolgov of Waymo

    Dmitri Dolgov, co-CEO of Waymo, recounts the company's decade-long journey from a secret Google project to the world's first fully autonomous ride-hailing service. He details the technical evolution from the early DARPA Challenge vehicles to the current Jaguar I-PACE fleet, explaining why Waymo chose a multi-sensor approach with LiDAR and radar over Tesla's camera-only vision. Dolgov also discusses the strategic pivot to full autonomy, the safety framework that underpins their operations, and the business model involving Waymo One, Uber partnerships, and future personal vehicle ownership.

  • Moore's Lobby · 53m

    Ep. 22 | Cruise's Sr. VP of Engineering, Mo ElShenawy, on Developing Autonomous Vehicles

    Mo ElShenawy, Senior VP of Engineering at Cruise (a GM subsidiary), discusses the engineering challenges of developing fully autonomous vehicles (L4/L5). He explains why Cruise targets San Francisco's complex environment to accelerate learning and details the hardware stack, including LiDAR, radar, and cameras, fused for perception and prediction. ElShenawy emphasizes that because state-of-the-art literature cannot yet solve L4/L5 driving, Cruise is inventing new algorithms and building a massive simulation and data infrastructure to ensure safety and scale.

  • Embedded.fm · 1h 01m

    397: Owl

    Elecia White discusses her recent contract work on autonomous off-road trucks, where she implemented reinforcement learning for a safety system and debugged a critical color-space issue in TensorFlow. She also details her preparation for the second cohort of her Making Embedded Systems course, focusing on firmware update security and IoT management. Christopher White shares his experience building a radar data collection system using an NVIDIA Xavier and Python GUIs, and reflects on the importance of practice and exercise.

  • Moore's Lobby · 40m

    From the Ground Up—Zoox Turns a Corner with New AV and Sensor System Designs

    Ryan McMichael, Director of Sensors and Systems at Zoox, discusses the company's purpose-built, driverless robotaxi designed for mobility-as-a-service. He details the sensor suite—including LIDAR, radar, cameras, thermal imaging, and microphones—and the strategy of using diversity and redundancy to ensure safety and uptime. McMichael also reflects on his transition from aerospace instrumentation at Johns Hopkins APL to automotive, highlighting the shift from low-volume, high-stakes systems to high-volume manufacturing with rigorous reliability standards.

  • The Next Byte Podcast · 21m

    189. Stanford & Toyota Drift Cars With AI

    Hosts Daniel and Forbode discuss a collaboration between Stanford University and the Toyota Research Institute, where Professor Christian Gerits' team used AI to achieve autonomous tandem drifting in Toyota Supras. They explain that training neural networks on these extreme boundary cases—specifically the 'feel' of friction and inertia rather than rigid physics models—aims to make Level 3-5 autonomous vehicles safer in unpredictable, low-friction scenarios like icy roads. The hosts highlight the technical details, such as 50Hz route replanning and sensor instrumentation, while noting the technology's potential portability to standard consumer vehicles.

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by Robot Talk. The episode itself belongs to its publisher.