Random error sampling-based recurrent neural network architecture optimization

Long Short-Term Memory

Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations

Computing, Computer Science, Algorithms +16

Adam: A Method for Stochastic Optimization

Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text

Computing, Computer Science, Algorithms +16

TensorFlow: A system for large-scale machine learning

Martı́n Abadi, Paul Barham, Jianmin Chen et al. · arXiv (Cornell University) · 2016 · 8.8K citations · Full text

Computing, Computer Engineering, Computer Science +15

Learning long-term dependencies with gradient descent is difficult

Yoshua Bengio, P. Simard, Paolo Frasconi · IEEE Transactions on Neural Networks · 1994 · 8.5K citations

Computing, Computer Science, Machine Learning +9

On the difficulty of training Recurrent Neural Networks

Razvan Pascanu, Tomáš Mikolov, Yoshua Bengio · arXiv (Cornell University) · 2012 · 3.8K citations · Full text

Computing, Computer Science, Artificial Intelligence +8