Journal of Database Management · 2021 · 53 citations · 7 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningNatural Language ProcessingDeep LearningNeural NetworksPattern RecognitionText Feature EngineeringText MiningWord EmbeddingsBenchmark DatasetsConvolutional Neural NetworksRecurrent Neural NetworksText ClassificationText Classification Features
Recurrent neural network (RNN) and convolutional neural network (CNN) are two prevailing architectures used in text classification. Traditional approaches combine the strengths of these two networks by straightly streamlining them or linking features extracted from them. In this article, a novel approach is proposed to maintain the strengths of RNN and CNN to a great extent. In the proposed approach, a bi-directional RNN encodes each word into forward and backward hidden states. Then, a neural tensor layer is used to fuse bi-directional hidden states to get word representations. Meanwhile, a convolutional neural network is utilized to learn the importance of each word for text classification. Empirical experiments are conducted on several datasets for text classification. The superior performance of the proposed approach confirms its effectiveness.
7
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Jeffrey L. Elman · Cognitive Science · 1990 · 10.8K citations
Probabilistic Classification Vector Machines
Huanhuan Chen, Peter Tiňo, Xin Yao · IEEE Transactions on Neural Networks · 2009 · 128 citations