Practical AI
AI incidents, audits, and the limits of benchmarks
Sponsors in this episode
No sponsor reads found in this episode's notes.
Host-read ads that the notes don't mention can't be found this way.
Show notes
AI is moving fast from research to real-world deployment, and when things go wrong, the consequences are no longer hypothetical. In this episode, Sean McGregor, co-founder of the AI Verification & Evaluation Research Institute and also the founder of the AI Incident Database, joins Chris and Dan to discuss AI safety, verification, evaluation, and auditing. They explore why benchmarks often fall short, what red-teaming at DEFCON reveals about machine learning risks, and how organizations can better assess and manage AI systems in practice.
Featuring:
Sean McGregor– LinkedIn
Chris Benson – Website, LinkedIn, Bluesky, GitHub, X
Daniel Whitenack – Website, GitHub, X
Links:
AI Verification & Evaluation Research Institute
AI Incident Database
38th convening of IAAI
BenchRisk
State of Global AI Incident Reporting
Upcoming Events:
Register for upcoming webinars here!
From the show's RSS feed.
Hosts
-
Daniel Whitenack
-
Chris Benson