npj Digital Medicine · 2025 · 23 citations · 41 references
ComputingEducational TechnologyMedical EducationClinical InformaticsElectronic Health RecordsResidency TrainingHistory TakingMedical Education ApplicationsMedical HistoryMedical History TakingPractice-based LearningVirtual Clinical EncountersAdaptive Feedback GenerationAdaptive Feedback SystemsClinical LearningDialog SystemsLarge Language ModelsRetrieval-augmented Language ModelsTrainingVirtual Patients
Clinical trainees face limited opportunities to practice medical history-taking skills due to scarce case diversity and access to real patients. To address this, we developed a large language model-based digital patient (LLMDP) system that transforms de‑identified electronic health records into voice‑enabled virtual patients capable of free‑text dialog and adaptive feedback, based on our previously established open-source retrieval-augmented framework. In a single‑center randomized controlled trial (ClinicalTrials.gov: NCT06229379; N = 84), students trained with LLMDP achieved a 10.50-point increase in medical history-taking assessment scores (95% CI: 4.66-16.33, p < 0.001) compared to those using traditional methods. LLMDP-trained students also demonstrated greater empathy. Participants reported high satisfaction with LLMDP, emphasizing its role in reducing training costs and boosting confidence for real patient interactions. These findings provide evidence that LLM-driven digital patients enhance medical history-taking skills and offer a scalable, low-risk pathway for integrating generative AI into ophthalmology education.
41
Standards for Reporting Qualitative Research
Bridget C. OʼBrien, Ilene Harris, Thomas J. Beckman et al. · Academic Medicine · 2014 · 11.7K citations
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Nils Reimers, Iryna Gurevych · 2019 · 10.9K citations · Full text
Large language models encode clinical knowledge
Karan Singhal, Shekoofeh Azizi, Tao Tu et al. · Nature · 2023 · 3.2K citations · Full text
Computing, Health Informatics, Computational Linguistics +16
Aidan Gilson, Conrad Safranek, Thomas Huang et al. · JMIR Medical Education · 2023 · 2K citations · Full text