Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5

Abstract

<b>Introduction:</b> This study aims to evaluate the performance of ChatGPT-4, an advanced artificial intelligence (AI) language model, on the Ophthalmology Knowledge Assessment Program (OKAP) examination compared to its predecessor, ChatGPT-3.5. <b>Methods:</b> Both models were tested on 180 OKAP practice questions covering various ophthalmology subject categories. <b>Results:</b> ChatGPT-4 significantly outperformed ChatGPT-3.5 (81% vs. 57%; <i>p</i> <0.001), indicating improvements in medical knowledge assessment. <b>Discussion:</b> The superior performance of ChatGPT-4 suggests potential applicability in ophthalmologic education and clinical decision support systems. Future research should focus on refining AI models, ensuring a balanced representation of fundamental and specialized knowledge, and determining the optimal method of integrating AI into medical education and practice.