86. The Autonomous Race & Drift Cars Of The Not So Distant Future

The Next Byte Podcast · 6 Sept 2022 · 30m

AI in practice: 3 real uses of AI described

What this episode covers

Daniel and Farbod discuss how autonomous racing technology is advancing, focusing on a Toyota Research Institute and Stanford University project that uses machine learning to enable a vehicle to autonomously drift. They detail how expert driver Ken Gushi's inputs were used to train an AI model for non-linear model predictive control (NMPC) on a Toyota Supra. The hosts also cover the Technical University of Munich's autonomous Formula 1 challenge, led by Professor Marcus Lienkamp, which aims to compete with human drivers by 2025 using open-source software and complex path planning.

AI in practice

Where this conversation describes AI being used to build or deliver a product. Part of the AI in practice tracker.

Engineering & simulation

An AI model was trained on data from an expert driver to predict vehicle responses and inputs, creating a control model that allows a vehicle to autonomously drift around obstacles.

“what they did is they had a car and they drove it around. It was super instrumented, um, and they had this expert drifter, Ken Gucci, drive it around. And I didn't know who Ken Gushi was, but I looked him up and he's got, like, probably one of the most impressive drifting driver resumes.”

Speaker 1 · Hear it at 8:05

Engineering & simulationnonlinear model predictive control (NMPC) with AI model

The system used an AI model to generate expert driver inputs and ran forecasts on vehicle states 20 times per second to apply computer-controlled steering, throttle, and braking on a Toyota Supra.

“So step one, it understands the situation. Step 2 it uses the AI model to generate what would an expert driver do if they were in this in this situation. Step 3 is to run forecasts on the effects to the future state based on the AI model. So remember, we said the AI model is also well versed in the outputs, and then step 4 is to actually go apply that to the system.”

Speaker 1 · Hear it at 10:13

Engineering & simulationTechnical University of Munich autonomous racing system

The team developed an AI system that processes sensor data (lasers, cameras, radar) to predict the trajectory of other cars and compute optimal paths for autonomous racing at high speeds.

“So it has whatever map they're racing in. It has a digital understanding of that layout. But what he's really trying to do is predict the trajectory of the cars around it that it's racing with as precisely as possible so that he can find the most optimum path for the next movement to make, right?”

Speaker 2 · Hear it at 23:06

Mentioned

Companies
Toyota Research Institute, Stanford University, Technical University of Munich, Volkswagen, Mouser Electronics
Products
Toyota Supra
Also
DARPA grand challenge, Ken Gushi, Marcus Lienkamp, Sebastian Thrun

Other shows on the same ground, closest first.

  • The Robot Report Podcast · 56m

    Interview with IAC race winner Team TUM

    Alex Wischnewski, team lead for the Technical University of Munich (TUM) Autonomous Motorsports team, discusses winning the 2021 Indy Autonomous Challenge. He details the logistical challenges of operating a remote team across time zones during the pandemic, the technical difficulties of driving identical chassis at 136 mph, and the critical role of sensor synchronization and GPS reliability in autonomous racing.

  • Hackaday Podcast · 58m

    Ep 215: Autonomous Race Car, Espresso Robot, and Vintage Computers

    Hosts Elliot Williams and Dan Maloney review a week of hacks, including Lawrence Trat’s open API integration for a Milo washing machine, Jeff Lau’s Bluetooth adapter for a 1993 Mitsubishi 3000 GT analog phone, and Stephen Gong’s autonomous F1/10th scale racing car using a Jetson and LiDAR. The episode also covers Denny’s microwave-powered forge using silicon carbide crucibles, Nicholas Depatri’s automated Gaggia espresso machine, and Patrick Williams’ social engineering of Bing Chat. Finally, they discuss the Vintage Computer Festival East and grid capacity issues with renewable energy.

  • Moore's Lobby · 1h 29m

    Ep. 13 | How Motorsports Are Accelerating Product Development for Next-Gen Automotive Applications

    Lucas di Grassi, former CEO of Roborace and Formula E champion, and Bryn Balcombe, Chief Strategy Officer of Roborace, discuss how their autonomous electric racing series serves as an R&D incubator for automotive AI and sensor technologies. They detail the technical challenges of hardening electronics for high-G motorsport environments, the shift from hardware competition to software-defined racing, and the critical role of open-source data in accelerating industry-wide innovation. The conversation also covers the broader implications of autonomous mobility, battery energy density constraints, and di Grassi's environmental advocacy regarding urban air pollution.

  • Moore's Lobby · 53m

    Ep. 22 | Cruise's Sr. VP of Engineering, Mo ElShenawy, on Developing Autonomous Vehicles

    Mo ElShenawy, Senior VP of Engineering at Cruise (a GM subsidiary), discusses the engineering challenges of developing fully autonomous vehicles (L4/L5). He explains why Cruise targets San Francisco's complex environment to accelerate learning and details the hardware stack, including LiDAR, radar, and cameras, fused for perception and prediction. ElShenawy emphasizes that because state-of-the-art literature cannot yet solve L4/L5 driving, Cruise is inventing new algorithms and building a massive simulation and data infrastructure to ensure safety and scale.

  • The Robot Report Podcast · 1h 04m

    APEX.AI discusses autonomous vehicle OS's; Nearly $1B in funding announcements

    Jan Becker, founder and CEO of APEX.AI, and Joe Speed, CTO of APEX.AI, discuss the evolution of real-time operating systems for autonomous vehicles, specifically how APEX.AI built a safety-certified, real-time version of ROS 2. They detail the company's involvement in the Indy Autonomous Challenge, explaining how their software stack enables high-speed sensor fusion and processing for race cars reaching speeds over 175 mph. The episode also covers APEX.AI's recent Series B funding and its expansion beyond automotive into agriculture and aerial robotics.

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by The Next Byte Podcast. The episode itself belongs to its publisher.