Llama 3 Challenges Proprietary State-of-the-Art Large Language Models in Radiology Board–style Examination Questions

Abstract

Meta’s Llama 3, an open-source large language model, performed on par with larger proprietary models, such as OpenAI’s GPT-4 and Anthropic’s Claude 3 Opus, on a subset of radiology board-style examination questions, highlighting the potential of open-source artificial intelligence in radiology.