International Journal of Gynecology & Obstetrics · 2023 · 34 citations · 10 references
MedicineGynecologyObstetricsGeneral GynecologyInfertilityReproductive MedicineEndometriosisInfertility EvaluationGrade LevelMethod Reproducibility
OBJECTIVE: To evaluate the accuracy and reproducibility of ChatGPT's free version answers about endometriosis for the first time. METHODS: Detailed internet searches to identify frequently asked questions (FAQs) about endometriosis have been performed. Scientific questions were prepared in accordance with the European Society of Human Reproduction and Embryology (ESHRE) endometriosis guidelines. An experienced gynecologist gave a score of 1-4 for each ChatGPT answer. The repeatability of ChatGPT answers about endometriosis was analyzed by asking each question twice, and the reproducibility of ChatGPT was accepted as scoring the answer to the same question in the same score category. RESULTS: A total of 91.4% (n = 71) of all FAQs were answered completely, accurately, and sufficiently. ChatGPT had the highest accuracy in the symptom and diagnosis category (94.1%, 16/17 questions) and the lowest accuracy in the treatment category (81.3%, 13/16 questions). Furthermore, of the 40 questions based on the ESHRE endometriosis guidelines, 27 (67.5%) were classified as grade 1, seven (17.5%) as grade 2, and six (15.0%) as grade 3. The reproducibility rate of FAQs in the prevention, symptoms, and diagnosis, and complications categories was the highest (100% for all categories). The reproducibility rate was the lowest for questions based on the ESHRE endometriosis guidelines (70.0%). CONCLUSION: ChatGPT accurately and satisfactorily responded to more than 90% of the questions about endometriosis, but to only 67.5% of questions based on the ESHRE endometriosis guidelines.
10
Aidan Gilson, Conrad Safranek, Thomas Huang et al. · JMIR Medical Education · 2023 · 2K citations · Full text
Evaluating the Performance of ChatGPT in Ophthalmology
Fares Antaki, Samir Touma, Daniel Milad et al. · Ophthalmology Science · 2023 · 494 citations · Full text
Evaluating ChatGPT as an Adjunct for Radiologic Decision-Making
Arya Rao, John Kim, Meghana Kamineni et al. · medRxiv · 2023 · 273 citations · Full text