Frontiers in Big Data · 2020 · 198 citations · 42 references
ComputingHealth InformaticsForecastingMachine LearningPredictive AnalyticsEnsemble ForecastingEnsemble LearningEnsemble MethodsForecasting MethodsNeural NetworksTime Series ForecastingArima ModelsHealthcare ForecastingLong Short-term Memory NetworksMultilayer PerceptronNeural ForecastingNeural Time Series ForecastingPerceptronRecurrent Neural Network Forecasting
Both statistical and neural methods have been proposed in the literature to predict healthcare expenditures. However, less attention has been given to comparing predictions from both these methods as well as ensemble approaches in the healthcare domain. The primary objective of this paper was to evaluate different statistical, neural, and ensemble techniques in their ability to predict patients' weekly average expenditures on certain pain medications. Two statistical models, persistence (baseline) and autoregressive integrated moving average (ARIMA), a multilayer perceptron (MLP) model, a long short-term memory (LSTM) model, and an ensemble model combining predictions of the ARIMA, MLP, and LSTM models were calibrated to predict the expenditures on two different pain medications. In the MLP and LSTM models, we compared the influence of shuffling of training data and dropout of certain nodes in MLPs and nodes and recurrent connections in LSTMs in layers during training. Results revealed that the ensemble model outperformed the persistence, ARIMA, MLP, and LSTM models across both pain medications. In general, not shuffling the training data and adding the dropout helped the MLP models and shuffling the training data and not adding the dropout helped the LSTM models across both medications. We highlight the implications of using statistical, neural, and ensemble methods for time-series forecasting of outcomes in the healthcare domain.
42
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations
Likelihood Ratio Statistics for Autoregressive Time Series with a Unit Root
David A. Dickey, Wayne A. Fuller · Econometrica · 1981 · 14.6K citations
Business, Economics, Econometrics +15
Distilling the Knowledge in a Neural Network
Geoffrey E. Hinton, Oriol Vinyals · arXiv (Cornell University) · 2015 · 14K citations · Full text
Jeffrey L. Elman · Cognitive Science · 1990 · 10.8K citations