Evaluation of ChatGPT-supported diagnosis, staging and treatment planning for the case of lung cancer

Abstract

In this paper, we evaluate the validity, accuracy, usefulness, and specificity of medical diagnoses related to lung cancer and its staging provided by ChatGPT based on symptoms described by humans. The evaluation is grounded on three main pillars: the validity and accuracy of answers in relation to context and associated references. The specificity and usefulness of the information for both doctors and patients. The economic value added to the healthcare system, determined by several weighted factors derived from the provided answers. The system’s responses are expected to return proposed diagnoses and diagnostic steps, ranked by probability and importance. A specialist conducts the review process.