International Journal of Production Research · 2024 · 11 citations · 18 references
ComputingComputer ScienceMachine LearningPredictive AnalyticsTime Series AnalysisChange DetectionChange-point DetectionState-space ModelsTemporal Change DetectionTime Series ModelingTime Series PredictionData-driven Process MonitoringLong Short-term Memory NetworksPrediction IntervalsPredictive MonitoringProcess Mean ShiftProcess MonitoringRecurrent Neural NetworksTime-series Change Detection
The recurrent neural network and its variants have shown great success in processing sequences in recent years. However, these neural networks have not aroused much attention in the process monitoring literature. Whereas the flexibility and outstanding performance of these models enable them to be solutions to many problem settings within process monitoring. One such problem setting is process data with inherent time-varying variability, an aspect of data that is often ignored. Therefore, this paper proposes a prospective monitoring method for detecting structural changes in data with inherent time-varying variability. We integrate long short-term memory (LSTM) prediction intervals with a neural network (NN) for variability prediction to detect structural changes in data online. We compare our proposed method to benchmarks in a simulation study, showing that the proposed model outperforms other NN-based predictive monitoring methods for mean shift detection. The proposed method is also applied in two case studies to sensor data, which confirms that the proposed method is an effective technique for detecting shifts.
18
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Jeffrey L. Elman · Cognitive Science · 1990 · 10.8K citations
Speech recognition with deep recurrent neural networks
Alex Graves, Abdelrahman Mohamed, Geoffrey E. Hinton · 2013 · 8.8K citations
Learning to Forget: Continual Prediction with LSTM
Felix A. Gers, Jürgen Schmidhuber, Fred Cummins · Neural Computation · 2000 · 5.4K citations
Generating Text with Recurrent Neural Networks
Ilya Sutskever, James Martens, Geoffrey E. Hinton · 2011 · 1.2K citations