Annals of Neurology · 2020 · 59 citations · 24 references
ComputingData ScienceHealth InformaticsForecastingMachine LearningPredictive AnalyticsDeep LearningPredictive Health ModelingRisk PredictionSeizure ClassificationTime Series ForecastingTime Series PredictionBrier ScoreForecast CalibrationMultilayer PerceptronRecurrent Neural NetworksSeizure DiariesSeizure Diary UseSeizure ForecastingSeizure Prediction
OBJECTIVE: There are no validated methods for predicting the timing of seizures. Using machine learning, we sought to forecast 24-hour risk of self-reported seizure from e-diaries. METHODS: Data from 5,419 patients on SeizureTracker.com (including seizure count, type, and duration) were split into training (3,806 patients/1,665,215 patient-days) and testing (1,613 patients/549,588 patient-days) sets with no overlapping patients. An artificial intelligence (AI) program, consisting of recurrent networks followed by a multilayer perceptron ("deep learning" model), was trained to produce risk forecasts. Forecasts were made from a sliding window of 3-month diary history for each day of each patient's diary. After training, the model parameters were held constant and the testing set was scored. A rate-matched random (RMR) forecast was compared to the AI. Comparisons were made using the area under the receiver operating characteristic curve (AUC), a measure of binary discrimination performance, and the Brier score, a measure of forecast calibration. The Brier skill score (BSS) measured the improvement of the AI Brier score compared to the benchmark RMR Brier score. Confidence intervals (CIs) on performance statistics were obtained via bootstrapping. RESULTS: The AUC was 0.86 (95% CI = 0.85-0.88) for AI and 0.83 (95% CI = 0.81-0.85) for RMR, favoring AI (p < 0.001). Overall (all patients combined), BSS was 0.27 (95% CI = 0.23-0.31), also favoring AI (p < 0.001). INTERPRETATION: The AI produced a valid forecast superior to a chance forecaster, and provided meaningful forecasts in the majority of patients. Future studies will be needed to quantify the clinical value of these forecasts for patients. ANN NEUROL 2020;88:588-595.
24
VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY
Glenn W. Brier · Monthly Weather Review · 1950 · 5.3K citations
Business, Mathematics, Meteorology +10
Karel G.M. Moons, Douglas G. Altman, Johannes B. Reitsma et al. · Annals of Internal Medicine · 2015 · 5.2K citations · Full text
Multi-day rhythms modulate seizure risk in epilepsy
Maxime O. Baud, Jonathan K. Kleen, Emily A. Mirro et al. · Nature Communications · 2018 · 559 citations · Full text
Medicine, Neurology, Neuroscience +14
Gary S. Collins, Johannes B. Reitsma, Douglas G. Altman et al. · European Urology · 2015 · 444 citations · Full text