2017 · 32 citations · 28 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingDeep LearningHashtag AnalysisLanguage ModelingNamed Entity RecognitionSelf-supervised LearningWord EmbeddingsEncoder-decoder ArchitecturesFeedforward Neural NetworksHashtag ProcessingMulti-label Text ClassificationNeural Text RepresentationRecurrent Neural Network TaggingRecurrent Neural NetworksSocial Tagging
We propose a novel supervised approach for text tagging and multi-label text classification based on a multi-head encoder-decoder neural network architecture. Our method predicts which subset of possible tags best matches an input text. It efficiently spends computational resources, exploiting dependencies between tags by encoding an input text into a compact representation which is then passed to multiple decoder classifier heads. We test our architecture on a Twitter hashtag prediction task, comparing it to a baseline model with multiple feedforward networks and a baseline model with multiple recurrent neural networks with GRU cells. We show that our approach achieves a significantly better performance than baselines with an equivalent number of parameters.
28
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Jun‐Young Chung, Çağlar Gülçehre, Kyunghyun Cho et al. · arXiv (Cornell University) · 2014 · 10.8K citations · Full text