Machine learning models in electronic health records can outperform conventional survival models for predicting patient mortality in coronary artery disease

Andrew J. Steele, Sera Aylin Cakiroglu, Anoop D Shah, Spiros Denaxas, Harry Hemingway, Nicholas M. Luscombe

bioRxiv (Cold Spring Harbor Laboratory) · 2018 · 30 citations · 37 references

DOIFull text

Open access

Concepts

TL;DR

Prognostic modeling is crucial for patient management, yet conventional approaches to EHR data are labor‑intensive and prone to bias due to extensive variable selection, preprocessing, and missing‑value handling. The study compared conventional and machine‑learning survival models on 80,000 CALIBER patients to assess predictive performance. The authors fitted Cox models, random survival forests, and elastic‑net regression to both a 27‑variable expert‑selected set (with/without imputation) and an extended 586‑variable set without prior expert input. Data‑driven models on the extended dataset outperformed conventional models, achieving a C‑index of 0.801 versus 0.793 for the traditional Cox model, and revealed novel prognostic variables, meaningful missingness, and nonlinear associations that machine‑learning methods could capture.

Abstract

Prognostic modelling is important in clinical practice and epidemiology for patient management and research. Electronic health records (EHR) provide large quantities of data for such models, but conventional epidemiological approaches require significant researcher time to implement. Expert selection of variables, fine-tuning of variable transformations and interactions, and imputing missing values are time-consuming and could bias subsequent analysis, particularly given that missingness in EHR is both high, and may carry meaning. Using a cohort of 80,000 patients from the CALIBER programme, we compared traditional modelling and machine-learning approaches in EHR. First, we used Cox models and random survival forests with and without imputation on 27 expert-selected, preprocessed variables to predict all-cause mortality. We then used Cox models, random forests and elastic net regression on an extended dataset with 586 variables to build prognostic models and identify novel prognostic factors without prior expert input. We observed that data-driven models used on an extended dataset can outperform conventional models for prognosis, without data preprocessing or imputing missing values. An elastic net Cox regression based with 586 unimputed variables with continuous values discretised achieved a C-index of 0.801 (bootstrapped 95% CI 0.799 to 0.802), compared to 0.793 (0.791 to 0.794) for a traditional Cox model comprising 27 expert-selected variables with imputation for missing values. We also found that data-driven models allow identification of novel prognostic variables; that the absence of values for particular variables carries meaning, and can have significant implications for prognosis; and that variables often have a nonlinear association with mortality, which discretised Cox models and random forests can elucidate. This demonstrates that machine-learning approaches applied to raw EHR data can be used to build models for use in research and clinical practice, and identify novel predictive variables and their effects to inform future research.

References

37