Hierarchical temporal memory and recurrent neural networks for time series prediction: An empirical validation and reduction to multilayer perceptrons

Long Short-Term Memory

Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations

Computing, Computer Science, Algorithms +16

Adam: A Method for Stochastic Optimization

Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text

Computing, Computer Science, Algorithms +16

Dropout: a simple way to prevent neural networks from overfitting

Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations

Computing, Computer Science, Artificial Intelligence +12

A New Approach to Linear Filtering and Prediction Problems

R. E. Kalman · Journal of Basic Engineering · 1960 · 31K citations

Natural Sciences, Mathematics, Dynamical Systems +16

Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation

Kyunghyun Cho, Bart van Merriënboer, Çağlar Gülçehre et al. · 2014 · 24.4K citations · Full text

Computing, Computer Science, Computational Linguistics +14