2016 · 33 citations · 14 references
ComputingComputer ScienceData ScienceData MiningDistributed SystemsMachine LearningDistributed Data ProcessingEmotion RecognitionOpinion MiningReal-time AnalyticsSentiment AnalysisStream ProcessingAccuracyData Stream MiningNaive BayesNaive Bayes ClassificationParallel ProcessingReal-time Data AnalysisReal-time Stream ProcessingSentiment Classification
Correct and fast sentiment analysis of continuously generated data such as Twitter message is very important for providing real-time customized service to the users. While Naive Bayes Classifier(NBC) is the most popular classifier employed for sentiment analysis, the existing studies on it have been based on single server environment. Consequently, they are not adequate for handling real-time stream data. In this paper, thus, we propose a scheme adopting the Laplace Smoothing technique with Binarized NBC for enhancing the accuracy, and employing SparkR for speed-up via distributed and parallel processing. Computer simulation with Sentiment140 reveals that the proposed approach consistently allows higher accuracy than the existing schemes. It also identifies that the SparkR environment allows faster training than R.
14
R: A Language and Environment for Statistical Computing
R Core Team · 2000 · 353K citations · Full text
Natural Sciences, Computer Science, Statistical Computing +10
Bo Pang, Lillian Lee, Shivakumar Vaithyanathan · 2002 · 7K citations · Full text
Opinion Mining and Sentiment Analysis
Bo Pang, Lillian Lee · Foundations and Trends® in Information Retrieval · 2008 · 6.2K citations
Spark: cluster computing with working sets
Matei Zaharia, Mosharaf Chowdhury, Michael J. Franklin et al. · 2010 · 4.2K citations