A novel selective learning based transformer encoder architecture with enhanced word representation

Long Short-Term Memory

Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations

Computing, Computer Science, Algorithms +16

Glove: Global Vectors for Word Representation

Jeffrey Pennington, Richard Socher, Christopher D. Manning · 2014 · 33.8K citations

Computing, Computer Science, Computational Linguistics +14

Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation

Kyunghyun Cho, Bart van Merriënboer, Çağlar Gülçehre et al. · 2014 · 24.4K citations · Full text

Computing, Computer Science, Computational Linguistics +14

Learning long-term dependencies with gradient descent is difficult

Yoshua Bengio, P. Simard, Paolo Frasconi · IEEE Transactions on Neural Networks · 1994 · 8.5K citations

Computing, Computer Science, Machine Learning +9

Distributional Structure

Zellig S. Harris · WORD · 1954 · 4.7K citations

Language Studies, Linguistics, Historical Linguistics +5