# 192. Karsten Roscher & The Need For Safe AI (Interview)

- Show: [The Next Byte Podcast](https://hardwarepodcasts.com/podcast/the-next-byte-podcast)
- Published: 2024-09-17
- Length: 1h 02m
- Page: https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2024-09-17-192-karsten-roscher-the-need-for-safe-ai-interview
- Listen: https://the-next-byte-wevolver.simplecast.com/episodes/192-karsten-roscher-the-need-for-safe-ai-cMz3VDPs

## Summary

Karsten Roscher, Head of the Certifiable AI department at the Fraunhofer Institute for Cognitive Systems (IKS), discusses the critical need for safety in AI development, particularly in autonomous driving. He explains the challenges of out-of-distribution detection, where models fail on unseen data like e-scooters or horse carriages, and introduces Robuscope, a free tool for evaluating model robustness without sharing proprietary data. Roscher also critiques the industry's over-reliance on benchmarks and highlights a new SAE International course designed to bridge the gap between machine learning engineers and safety experts.

## Chapters

- [0:00](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2024-09-17-192-karsten-roscher-the-need-for-safe-ai-interview#t=0) Introduction: Karsten Roscher and Fraunhofer IKS
- [18:35](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2024-09-17-192-karsten-roscher-the-need-for-safe-ai-interview#t=1115) The Challenge of Out-of-Distribution Detection
- [28:08](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2024-09-17-192-karsten-roscher-the-need-for-safe-ai-interview#t=1688) Robuscope: Free AI Testing Tool
- [34:23](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2024-09-17-192-karsten-roscher-the-need-for-safe-ai-interview#t=2063) Critique of Benchmark-Driven Development
- [41:09](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2024-09-17-192-karsten-roscher-the-need-for-safe-ai-interview#t=2469) Trust and Safety in Autonomous Vehicles
- [55:40](https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2024-09-17-192-karsten-roscher-the-need-for-safe-ai-interview#t=3340) SAE International Machine Learning Course

## Topics

- [AI & machine learning](https://hardwarepodcasts.com/topic/ai-and-machine-learning)
- [Debugging & failure analysis](https://hardwarepodcasts.com/topic/debugging-and-failure-analysis)
- [Certification & compliance](https://hardwarepodcasts.com/topic/certification-and-compliance)
- [Careers & education](https://hardwarepodcasts.com/topic/engineering-careers-and-education)

## Most relevant to

established companies

## Mentioned

- Fraunhofer Institute for Cognitive Systems IKS (company)
- Robuscope (tool)
- OpenAI (company)
- Tesla (company)

## Related episodes from other shows

- [Arm’s bold new path | Teenage autonomous drivers | Dealing with the data deluge](https://hardwarepodcasts.com/podcast/ee-times-current/2019-10-18-arms-bold-new-path-teenage-autonomous-drivers-dealing-with-the-data-deluge) (EE Times Current)
- [APEX.AI discusses autonomous vehicle OS's; Nearly $1B in funding announcements](https://hardwarepodcasts.com/podcast/the-robot-report-podcast/2022-01-21-apex-ai-discusses-autonomous-vehicle-oss-nearly-1b-in-funding-announcements) (The Robot Report Podcast)
- [421: Paint the Iceberg Yellow](https://hardwarepodcasts.com/podcast/embedded-fm/2022-07-21-421-paint-the-iceberg-yellow) (Embedded.fm)
- [Episode Eleven – Self-Driving Cars: behind the wheel](https://hardwarepodcasts.com/podcast/robot-talk/2021-10-29-episode-eleven-self-driving-cars-behind-the-wheel) (Robot Talk)
- [A Disaster Waiting to Happen | Get Up, Stand Up](https://hardwarepodcasts.com/podcast/ee-times-current/2021-04-02-a-disaster-waiting-to-happen-get-up-stand-up) (EE Times Current)

## Citing this page

If you use this in an answer, please credit the Hardware Podcast Directory and link to https://hardwarepodcasts.com/podcast/the-next-byte-podcast/2024-09-17-192-karsten-roscher-the-need-for-safe-ai-interview. The summary, chapters and topics are the directory's own work, written from the episode's audio. The episode itself, its title and its audio belong to The Next Byte Podcast.