2015 · 12 citations · 16 references
ComputingComputer ScienceData MiningNatural Language ProcessingText AnalyticsClassificationText MiningWord Sense DisambiguationAutomatic Text ClassificationDocument ClassificationNatural Disaster EventsText Classification
Document classification or document categorization is one of the most studied areas in computer science due to its importance. The problem is to assign a document using its text to one or more classes or categories from a predefined set. We propose a new approach for fast text classification using randomized explicit semantic analysis (RS-ESA). It is based on a state of the art approach for word sense disambiguation based on Wikipedia, the largest encyclopedia in existence. Our method reduces Wikipedia repository using a random sample approach resulting in a throughput, which is an order of magnitude faster than the original explicit semantic analysis. RS-ESA approach has been implemented as part of the LITMUS project due to a need in classifying data from Social Media into relevant and irrelevant items with respect to landslide as a natural disaster. We demonstrate that our approach achieves 96% precision when classifying Social Media landslide data collected in December 2014. We also demonstrate the genericity of the proposed approach by using it for separating factual texts from fictional based on Wikipedia articles and fan fiction stories, where we achieve 97% in precision.
16
Mark Hall, Eibe Frank, Geoffrey Holmes et al. · ACM SIGKDD Explorations Newsletter · 2009 · 17.8K citations
Earthquake shakes Twitter users
Takeshi Sakaki, Makoto Okazaki, Yutaka Matsuo · 2010 · 3.7K citations
Natural Sciences, Data Science, Natural Language Processing +14
Cross-domain sentiment classification via spectral feature alignment
Sinno Jialin Pan, Xiaochuan Ni, Jian-Tao Sun et al. · 2010 · 795 citations
Emergency situation awareness from twitter for crisis management
Mark Cameron, Robert Power, Bella Robinson et al. · 2012 · 272 citations