192. Karsten Roscher & The Need For Safe AI (Interview)
Karsten Roscher, Head of the Certifiable AI department at the Fraunhofer Institute for Cognitive Systems (IKS), discusses the critical need for safety in AI development, particularly in autonomous driving. He explains the challenges of out-of-distribution detection, where models fail on unseen data like e-scooters or horse carriages, and introduces Robuscope, a free tool for evaluating model robustness without sharing proprietary data. Roscher also critiques the industry's over-reliance on benchmarks and highlights a new SAE International course designed to bridge the gap between machine learning engineers and safety experts.