IEEE Transactions on Neural Networks · 1994 · 1.3K citations · 34 references
ComputingComputer ScienceForecastingMachine LearningTime Series AnalysisComputational Time Series AnalysisEnergy Demand ForecastingState-space ModelsTime Series ForecastingTime Series ModelingTime Series PredictionFeedforward Neural NetworksNeural ForecastingRecurrent Neural Network EstimationRecurrent Neural Network ForecastingRecurrent Neural NetworksRobust Time Series EstimationRobustnessTime Series Outlier Detection
We propose a robust learning algorithm and apply it to recurrent neural networks. This algorithm is based on filtering outliers from the data and then estimating parameters from the filtered data. The filtering removes outliers from both the target function and the inputs of the neural network. The filtering is soft in that some outliers are neither completely rejected nor accepted. To show the need for robust recurrent networks, we compare the predictive ability of least squares estimated recurrent networks on synthetic data and on the Puget Power Electric Demand time series. These investigations result in a class of recurrent neural networks, NARMA(p,q), which show advantages over feedforward neural networks for time series with a moving average component. Conventional least squares methods of fitting NARMA(p,q) neural network models are shown to suffer a lack of robustness towards outliers. This sensitivity to outliers is demonstrated on both the synthetic and real data sets. Filtering the Puget Power Electric Demand time series is shown to automatically remove the outliers due to holidays. Neural networks trained on filtered data are then shown to give better predictions than neural networks trained on unfiltered time series.
34
Classification and Regression Trees.
Alexander Gordon, Leo Breiman, Jerome H. Friedman et al. · Biometrics · 1984 · 23.9K citations
Time Series Analysis: Forecasting and Control
Michael D. Geurts, George E. P. Box, Gwilym M. Jenkins · Journal of Marketing Research · 1977 · 19.3K citations
Computing, Data Science, Forecasting +11
Jeffrey L. Elman · Cognitive Science · 1990 · 10.8K citations