Software Practice and Experience · 2019 · 24 citations · 29 references
ComputingComputer ScienceInformation TechnologyBig Data AnalyticsMachine LearningPredictive AnalyticsDistributed Data ProcessingMachine Learning For Big DataOpinion MiningReal-time AnalyticsSentiment AnalysisStream ProcessingBig Data Analytics ArchitectureFake Account DetectionNaive BayesNaive Bayes ClassificationReal-time ProcessingSoftware ComponentsStreaming Data AnalysisStreaming Machine Learning
Summary There are many data sources that produce large volumes of data. The Big Data nature requires new distributed processing approaches to extract the valuable information. Real‐time sentiment analysis is one of the most demanding research areas that requires powerful Big Data analytics tools such as Spark. Prior literature survey work has shown that, though there are many conventional sentiment analysis researches, there are only few works realizing sentiment analysis in real time. One major point that affects the quality of real‐time sentiment analysis is the confidence of the generated data. In more clear terms, it is a valuable research question to determine whether the owner that generates sentiment is genuine or not. Since data generated by fake personalities may decrease accuracy of the outcome, a smart/intelligent service that can identify the source of data is one of the key points in the analysis. In this context, we include a fake account detection service to the proposed framework. Both sentiment analysis and fake account detection systems are trained and tested using Naïve Bayes model from Apache Spark's machine learning library. The developed system consists of four integrated software components, ie, (i) machine learning and streaming service for sentiment prediction, (ii) a Twitter streaming service to retrieve tweets, (iii) a Twitter fake account detection service to assess the owner of the retrieved tweet, and (iv) a real‐time reporting and dashboard component to visualize the results of sentiment analysis. The sentiment classification performances of the system for offline and real‐time modes are 86.77% and 80.93%, respectively.
29
Scikit-learn: Machine Learning in Python
Fabián Pedregosa, Gaël Varoquaux, Alexandre Gramfort et al. · arXiv (Cornell University) · 2012 · 63.7K citations · Full text
Sentiment Analysis and Opinion Mining
Bing Liu · Synthesis lectures on human language technologies · 2012 · 3.3K citations
Feature hashing for large scale multitask learning
Kilian Q. Weinberger, Anirban Dasgupta, John Langford et al. · 2009 · 937 citations
Detecting spammers on social networks
Gianluca Stringhini, Christopher Kruegel, Giovanni Vigna · 2010 · 791 citations