Capabilities of GPT-4 in ophthalmology: an analysis of model entropy and progress towards human-level medical question answering

Abstract

GPT-4, an LLM trained on non-ophthalmology-specific data, performs significantly better than its predecessor on simulated ophthalmology board-style exams. Remarkably, its performance tended to be superior to historical human performance, but that difference was not statistically significant in our study.