2019 · 96 citations · 20 references
ComputingBiomedical InformaticsHealth InformaticsClinical Decision SupportClinical InformaticsElectronic Health RecordsDeep LearningDisease Progression ModelingElectronic Health Record AnalyticsPredictive Health ModelingTemporal Disease PatternsAttention-aware SystemsElectronic Health Record PredictionHealth Event PredictionIrregular Time Series AnalysisLong Short-term Memory NetworksShock Progression PredictionTime-aware Diagnostic ModelingTime-varying Attention
Modeling patient disease progression using Electronic Health Records (EHRs) is critical to assist clinical decision making. Long-Short Term Memory (LSTM) is an effective model to handle sequential data, such as EHRs, but it encounters two major limitations when applied to EHRs: it is unable to interpret the prediction results and it ignores the irregular time intervals between consecutive events. To tackle these limitations, we propose an attention-based time-aware LSTM Networks (ATTAIN), to improve the interpretability of LSTM and to identify the critical previous events for current diagnosis by modeling the inherent time irregularity. We validate ATTAIN on modeling the progression of an extremely challenging disease, septic shock, by using real-world EHRs. Our results demonstrate that the proposed framework outperforms the state-of-the-art models such as RETAIN and T-LSTM. Also, the generated interpretative time-aware attention weights shed some lights on the progression behaviors of septic shock.
20
R. Phillip Dellinger, Mitchell M. Levy, Andrew Rhodes et al. · Critical Care Medicine · 2013 · 9.7K citations
Veterinary Medicine, Infectious Diseases, Internal Medicine +9
Anand Kumar, Daniel Roberts, Kenneth E. Wood et al. · Critical Care Medicine · 2006 · 6.1K citations
Veterinary Medicine, Infectious Diseases, Antimicrobial Pharmacotherapy +13
R. Phillip Dellinger, Mitchell M. Levy, Julian Bion et al. · Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) · 2008 · 3.9K citations
Recurrent Neural Networks for Multivariate Time Series with Missing Values
Zhengping Che, Sanjay Purushotham, Kyunghyun Cho et al. · Scientific Reports · 2018 · 2.1K citations · Full text
LSTM neural networks for language modeling
Martin Sundermeyer, Ralf Schlüter, Hermann Ney · 2012 · 2K citations
Computing, Computer Science, French +14