Journal of King Saud University - Computer and Information Sciences · 2020 · 228 citations · 71 references
Deep learning methods, with many processing layers, achieve state‑of‑the‑art results across domains, and recent model designs have expanded in natural language processing. The survey aims to describe advances in deep generative modeling, review numerous deep learning models for text generation, and summarize the past, present, and future of these models. The survey reviews deep learning models for text generation, focusing on papers from 2015 onward and including DL approaches evaluated across various NLP application domains. The survey summarizes various models and provides a detailed understanding of the past, present, and future of text generation models in deep learning.
Deep learning methods possess many processing layers to understand the stratified representation of data and have achieved state-of-art results in several domains. Recently, deep learning model designs and architectures have unfolded in the context of Natural Language Processing (NLP). This survey presents a brief description of the advances that have occurred in the area of Deep Generative modeling. This work considers most of the papers from 2015 onwards. In this paper, we review many deep learning models that have been used for the generation of text. We also summarize the various models and have put forward the detailed understanding of past, present, and future of text generation models in deep learning. Furthermore, DL approaches that have been explored and evaluated in different application domains in NLP are included in this survey.
71
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 93.8K citations
Glove: Global Vectors for Word Representation
Jeffrey Pennington, Richard Socher, Christopher D. Manning · 2014 · 33.2K citations
Learning representations by back-propagating errors
David E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams · Nature · 1986 · 29.7K citations
Kishore Papineni, Salim Roukos, Todd J. Ward et al. · 2001 · 20.9K citations · Full text
Natural Language Processing, Computer-assisted Translation, Engineering +10