Nature Communications · 2020 · 132 citations · 52 references
ComputingComputer ScienceForecastingMachine LearningTime Series AnalysisPredictive ModelingReal-time ForecastingTime Series ForecastingTime Series ModelingTime Series PredictionHigh-dimensional Time SeriesHigh-dimensional Time Series AnalysisHigh-dimensional Time Series ForecastingMulti-step-ahead ForecastingReservoir Computing
We develop an auto-reservoir computing framework, Auto-Reservoir Neural Network (ARNN), to efficiently and accurately make multi-step-ahead predictions based on a short-term high-dimensional time series. Different from traditional reservoir computing whose reservoir is an external dynamical system irrelevant to the target system, ARNN directly transforms the observed high-dimensional dynamics as its reservoir, which maps the high-dimensional/spatial data to the future temporal values of a target variable based on our spatiotemporal information (STI) transformation. Thus, the multi-step prediction of the target variable is achieved in an accurate and computationally efficient manner. ARNN is successfully applied to both representative models and real-world datasets, all of which show satisfactory performance in the multi-step-ahead prediction, even when the data are perturbed by noise and when the system is time-varying. Actually, such ARNN transformation equivalently expands the sample size and thus has great potential in practical applications in artificial intelligence and machine learning.
52
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations
Jörg Breitung, James D. Hamilton · Contemporary Sociology A Journal of Reviews · 1995 · 11.2K citations