BMJ Quality & Safety · 2025 · 11 citations · 9 references
ComputingComputer ScienceHealth InformaticsArtificial IntelligenceNatural Language ProcessingPatient SafetyClinical Natural Language ProcessingDiagnostic Error DetectionAmbient Clinical DocumentationClassification System DesignClassification System EvaluationError Classification SystemsLarge Language ModelsMedical Incident ClassificationPatient Risk ClassificationSafety Classification
Generative artificial intelligence (AI) technologies have the potential to revolutionise healthcare delivery but require classification and monitoring of patient safety risks. To address this need, we developed and evaluated a preliminary classification system for categorising generative AI patient safety errors. Our classification system is organised around two AI system stages (input and output) with specific error types by stage. We applied our classification system to two generative AI applications to assess its effectiveness in categorising safety issues: patient-facing conversational large language models (LLMs) and an ambient digital scribe (ADS) system for clinical documentation. In the LLM analysis, we identified 45 errors across 27 patient medical queries, with omission being the most common (42% of errors). Of the identified errors, 50% were categorised as low clinical significance, 25% as moderate clinical significance and 25% as high clinical significance. Similarly, in the ADS simulation, we identified 66 errors across 11 patient visits, with omission being the most common (83% of errors). Of the identified errors, 55% were categorised as low clinical significance and 45% were categorised as moderate clinical significance. These findings demonstrate the classification system's utility in categorising output errors from two different AI healthcare applications, providing a starting point for developing a robust process to better understand AI-enabled errors.
9
Avedis Donabedian · JAMA · 1988 · 5.1K citations
Capabilities of GPT-4 on Medical Challenge Problems
Harsha Nori, Nicholas King, Scott Mayer McKinney et al. · arXiv (Cornell University) · 2023 · 510 citations · Full text
Towards Expert-Level Medical Question Answering with Large Language Models
Karan Singhal, Tao Tu, Juraj Gottweis et al. · arXiv (Cornell University) · 2023 · 334 citations · Full text
Farah Magrabi, Mei‐Sing Ong, W. B. Runciman et al. · Journal of the American Medical Informatics Association · 2010 · 162 citations · Full text
Computing, Health Informatics, Clinical Classification Systems +12