Improving the accuracy of medical diagnosis with causal machine learning

Jonathan G. Richens, Ciarán M. Lee, Saurabh Johri

Nature Communications · 2020 · 601 citations · 55 references

DOIFull text

Open access

Concepts

TL;DR

Machine learning promises to revolutionize clinical decision making, yet current diagnostic models are purely associative and cannot disentangle correlation from causation, limiting their effectiveness. The study aims to reformulate diagnosis as a counterfactual inference task and develop counterfactual diagnostic algorithms. The authors compare their counterfactual algorithms to a standard associative algorithm and 44 doctors using a test set of clinical vignettes. The counterfactual algorithm outperforms the associative model, ranking in the top 25% of doctors and achieving expert‑level accuracy, demonstrating that causal reasoning is essential for medical diagnosis.

Abstract

Machine learning promises to revolutionize clinical decision making and diagnosis. In medical diagnosis a doctor aims to explain a patient's symptoms by determining the diseases causing them. However, existing machine learning approaches to diagnosis are purely associative, identifying diseases that are strongly correlated with a patients symptoms. We show that this inability to disentangle correlation from causation can result in sub-optimal or dangerous diagnoses. To overcome this, we reformulate diagnosis as a counterfactual inference task and derive counterfactual diagnostic algorithms. We compare our counterfactual algorithms to the standard associative algorithm and 44 doctors using a test set of clinical vignettes. While the associative algorithm achieves an accuracy placing in the top 48% of doctors in our cohort, our counterfactual algorithm places in the top 25% of doctors, achieving expert clinical accuracy. Our results show that causal reasoning is a vital missing ingredient for applying machine learning to medical diagnosis.

References

55