Neural Information Processing Systems · 2018 · 443 citations · 16 references
ComputingComputer ScienceForecastingMachine LearningTime Series AnalysisDeep LearningNeural NetworksState-space ModelingState-space ModelsTime Series ForecastingTime Series PredictionDeep Learning For ForecastingDeep Learning For Time Series ForecastingDeep Learning-based ForecastingLinear State-space ModelsLinear State-space SystemsProbabilistic Deep LearningProbabilistic Time Series ModelingRecurrent Neural Networks
We present a novel approach to probabilistic time series forecasting that combines state space models with deep learning. By parametrizing a per-time-series linear state space model with a jointly-learned recurrent neural network, our method retains desired properties of state space models such as data efficiency and interpretability, while making use of the ability to learn complex patterns from raw data offered by deep learning approaches. Our method scales gracefully from regimes where little training data is available to regimes where data from millions of time series can be leveraged to learn accurate models. We provide qualitative as well as quantitative results with the proposed method, showing that it compares favorably to the state-of-the-art.
16
Auto-Encoding Variational Bayes
Diederik P. Kingma, Max Welling · UvA-DARE (University of Amsterdam) · 2013 · 15.6K citations · Full text
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 13.4K citations · Full text
Computing, Computer Science, French +14
WaveNet: A Generative Model for Raw Audio
Aäron van den Oord, Sander Dieleman, Heiga Zen et al. · arXiv (Cornell University) · 2016 · 2.5K citations · Full text
Computing, Musicology, Acoustics +16