Beyond the Hype: Dr. Xiao Liu on Evaluating Medical AI

The promise of medical AI is not simply better performance — it is better care grounded in evidence patients and clinicians can trust. Dr. Xiao Liu, a clinician and medical AI researcher affiliated with the University of Birmingham and Microsoft AI, has spent her career asking what rigorous evaluation should look like as new technologies move from publications into practice. She describes reporting guidelines as tools for transparency rather than prescriptions and explains why seeing product development from inside industry changed her understanding of implementation. Looking ahead, Liu imagines a medical profession in which readily available knowledge shifts physicians toward a more interpersonal role: accompanying patients through uncertainty, deterioration, treatment failure, recovery, and life-changing diagnoses. At the same time, she sees AI opening new scientific possibilities by revealing biomarkers, disease phenotypes, and treatment-response patterns that current medical categories may miss. The challenge is to preserve rigor without letting familiar methods prevent medicine from learning something genuinely new.
Transcript.