Concepedia

Chatbot vs Medical Student Performance on Free-Response Clinical Reasoning Examinations

Eric Strong, Alicia DiGiammarino, Yingjie Weng, Andre Kumar, Poonam Hosamani, Jason Hom, Jonathan H. Chen

JAMA Internal Medicine · 2023 · 169 citations · 2 references

Open access

Concepts

EducationEducational TechnologyMedical EducationClinical MedicineDiagnostic ReasoningIntelligent Tutoring SystemsClinical Decision-makingClinical ReasoningDialogue Systems For LearningEducational ChatbotsQuestion AnsweringTutorial Dialogue SystemsChatbot SystemsChatbotsClinical Diagnostic ReasoningClinical Question AnsweringClinical Question Answering SystemsClinical Reasoning QuestionsClinical Reasoning Support

Abstract

This study compares performance on free-response clinical reasoning examinations of first- and second-year medical students vs 2 models of a popular chatbot.

References

2

Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine

Peter Lee, Sébastien Bubeck, Joseph Petro · New England Journal of Medicine · 2023 · 1.6K citations

Computing, Biomedical Informatics, Health Informatics +15

Capabilities of GPT-4 on Medical Challenge Problems

Harsha Nori, Nicholas King, Scott Mayer McKinney et al. · arXiv (Cornell University) · 2023 · 510 citations · Full text

Computing, Health Informatics, Medical Education +17