A model for learning to segment temporal sequences, utilizing a mixture of RNN experts together with adaptive variance

Long Short-Term Memory

Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 93.8K citations

Finding Structure in Time

Jeffrey L. Elman · Cognitive Science · 1990 · 10.6K citations

Semantic Processing, Psycholinguistics, Memory Demands +17

Learning long-term dependencies with gradient descent is difficult

Yoshua Bengio, P. Simard, Paolo Frasconi · IEEE Transactions on Neural Networks · 1994 · 8.3K citations

Structured Prediction, Gradient Descent, Engineering +11

Adaptive Mixtures of Local Experts

Robert A. Jacobs, Michael I. Jordan, Steven J. Nowlan et al. · Neural Computation · 1991 · 4.7K citations

Artificial Intelligence, Engineering, Machine Learning +19

A Learning Algorithm for Continually Running Fully Recurrent Neural Networks

Ronald J. Williams, David Zipser · Neural Computation · 1989 · 4.4K citations

Artificial Intelligence, Exact Form, Gradient-following Learning Algorithm +14