Proceedings of the AAAI Conference on Artificial Intelligence · 2015 · 117 citations · 25 references
ComputingComputer ScienceFeature EngineeringMachine LearningNatural Language ProcessingOpinion MiningRepresentation LearningSemi-supervised LearningSentiment AnalysisText Feature EngineeringWord EmbeddingsDeep Feature LearningEmbedding LearningHand-crafted FeaturesLogistic RegressionRestaurant ReviewsReviewsSemi-supervised ClassificationWord Representation Learning
User-generated reviews are valuable resources for decision making. Identifying the aspect categories discussed in a given review sentence (e.g., “food” and “service” in restaurant reviews) is an important task of sentiment analysis and opinion mining. Given a predefined aspect category set, most previous researches leverage hand-crafted features and a classification algorithm to accomplish the task. The crucial step to achieve better performance is feature engineering which consumes much human effort and may be unstable when the product domain changes. In this paper, we propose a representation learning approach to automatically learn useful features for aspect category detection. Specifically, a semi-supervised word embedding algorithm is first proposed to obtain continuous word representations on a large set of reviews with noisy labels. Afterwards, we propose to generate deeper and hybrid features through neural networks stacked on the word vectors. A logistic regression classifier is finally trained with the hybrid features to predict the aspect category. The experiments are carried out on a benchmark dataset released by SemEval-2014. Our approach achieves the state-of-the-art performance and outperforms the best participating team as well as a few strong baselines.
25
Distributed Representations of Words and Phrases and their Compositionality
Tomáš Mikolov, Ilya Sutskever, Kai Chen et al. · arXiv (Cornell University) · 2013 · 18.1K citations · Full text
Mining and summarizing customer reviews
Minqing Hu, Bing Liu · 2004 · 7.7K citations
Bo Pang, Lillian Lee, Shivakumar Vaithyanathan · 2002 · 7K citations · Full text
A unified architecture for natural language processing
Ronan Collobert, Jason Weston · 2008 · 5.2K citations