2018 · 60 citations · 30 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningNatural Language ProcessingAttention NetworksClassificationDeep LearningRepresentation LearningTaxonomyText MiningAccuracy-computational Cost TradeoffAttention-based ClassificationAutomated Text ClassificationDocument ClassificationInterpretabilityMulticlass ClassificationText ClassificationText Classification Features
superior performance over traditional supervised classifiers in text classification. They learn to extract useful features automatically when sufficient amount of data is presented. However, along with the growth in the number of documents comes the increase in the number of categories, which often results in poor performance of the multiclass classifiers. In this work, we use external knowledge in the form of topic category taxonomies to aide the classification by introducing a deep hierarchical neural attention-based classifier. Our model performs better than or comparable to state-of-the-art hierarchical models at significantly lower computational cost while maintaining high interpretability.
30
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 13.4K citations · Full text
Computing, Computer Science, French +14
A unified architecture for natural language processing
Ronan Collobert, Jason Weston · 2008 · 5.2K citations