Large language models are less effective at clinical prediction tasks than locally trained machine learning models

Abstract

These findings suggest that non-fine-tuned LLMs are less effective and robust than locally trained ML for clinical prediction tasks, but they are improving across releases.