Unsupervised Pre-training of a Deep LSTM-based Stacked Autoencoder for Multivariate Time Series Forecasting Problems

Long Short-Term Memory

Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 93.8K citations

Reducing the Dimensionality of Data with Neural Networks

Geoffrey E. Hinton, Ruslan Salakhutdinov · Science · 2006 · 20.5K citations

A Fast Learning Algorithm for Deep Belief Nets

Geoffrey E. Hinton, Simon Osindero, Yee‐Whye Teh · Neural Computation · 2006 · 16.2K citations

Distilling the Knowledge in a Neural Network

Geoffrey E. Hinton, Oriol Vinyals · arXiv (Cornell University) · 2015 · 13.9K citations · Full text

Artificial Intelligence, Engineering, Machine Learning +19

Learning long-term dependencies with gradient descent is difficult

Yoshua Bengio, P. Simard, Paolo Frasconi · IEEE Transactions on Neural Networks · 1994 · 8.3K citations

Structured Prediction, Gradient Descent, Engineering +11