2020 · 288 citations · 19 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingDocument RepresentationGraph-based LearningLanguage ModelingText MiningText RepresentationWord EmbeddingsBenchmark DatasetsContextual Word EmbeddingsGraph EmbeddingsGraph Neural NetworksGraph Representation LearningGraph-based Document RepresentationText ClassificationWord Representation Learning
Text classification is fundamental in natural language processing (NLP), and Graph Neural Networks (GNN) are recently applied in this task. However, the existing graph-based works can neither capture the contextual word relationships within each document nor fulfil the inductive learning of new words. In this work, to overcome such problems, we propose TextING 1 for inductive text classification via GNN. We first build individual graphs for each document and then use GNN to learn the finegrained word representations based on their local structures, which can also effectively produce embeddings for unseen words in the new document. Finally, the word nodes are incorporated as the document embedding. Extensive experiments on four benchmark datasets show that our method outperforms state-of-theart text classification methods.
19
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Convolutional Neural Networks for Sentence Classification
Recurrent neural network based language model
Tomáš Mikolov, Martin Karafiát, Lukáš Burget et al. · 2010 · 5.4K citations