2018 · 20 citations · 11 references
ComputingComputer ScienceEnglishComputational LinguisticsMachine LearningNatural Language ProcessingDeep LearningLanguage ClassificationLanguage ModelingLanguage ModelsText Feature EngineeringWord EmbeddingsConvolutional Neural NetworksFeature Vector EngineeringLong Short-term Memory NetworksNeural Language ModelsNeural Text RepresentationRecurrent Neural NetworksSkip-gram Model
This paper presents an extensive comparative study of four neural network models, including feed-forward networks, convolutional networks, recurrent networks and long short-term memory networks, on two sentence classification datasets of English and Vietnamese text. We show that on the English dataset, the convolutional network models without any feature engineering outperform some competitive sentence classifiers with rich hand-crafted linguistic features. We demonstrate that the GloVe word embeddings are consistently better than both Skip-gram word embeddings and word count vectors. We also show the superiority of convolutional neural network models on a Vietnamese newspaper sentence dataset over strong baseline models. Our experimental results suggest some good practices for applying neural network models in sentence classification.
11
Convolutional Neural Networks for Sentence Classification
Jeffrey L. Elman · Cognitive Science · 1990 · 10.8K citations
Speech recognition with deep recurrent neural networks
Alex Graves, Abdelrahman Mohamed, Geoffrey E. Hinton · 2013 · 8.8K citations
Jeffrey L. Elman · Cognitive Science · 1990 · 2.9K citations · Full text