Human-centric Computing and Information Sciences · 2016 · 34 citations · 25 references
ComputingEconomicsData MiningTeamworkVolunteer ManagementEmployee VolunteeringSentiment AnalysisCrowdsourcingIncentive Controls
Abstract The continual advancement of internet technologies has led to the evolution of how individuals and organizations operate. For example, through the internet, we can now tap a remote workforce to help us accomplish certain tasks, a phenomenon called crowdsourcing. Crowdsourcing is an approach that relies on people to perform activities that are costly or time-consuming using traditional methods. Depending on the incentive given to the crowd workers, crowdsourcing can be classified as paid or unpaid. In paid crowdsourcing, the workers are incentivized financially, enabling the formation of a robust workforce, which allows fast completion of tasks. Consequently, in unpaid crowdsourcing, the lack of financial incentive potentially leads to an unpredictable workforce and indeterminable task completion time. However, since payment to workers is not necessary, it can be an economical alternative for individuals and organizations who are more concerned about the budget than the task turnaround time. In this study, we explore unpaid crowdsourcing by reviewing crowdsourcing applications where the crowd comes from a pool of volunteers. We also evaluate its performance in sentiment analysis and data extraction projects. Our findings suggest that for such tasks, unpaid crowdsourcing completes slower but yields results of similar or higher quality compared to its paid counterpart.
25
Techniques and applications for sentiment analysis
Ronen Feldman · Communications of the ACM · 2013 · 1.5K citations
Crowdsourcing systems on the World-Wide Web
AnHai Doan, Raghu Ramakrishnan, Alon Halevy · Communications of the ACM · 2011 · 1.3K citations
Muhammad Imran, Carlos Castillo, Ji Lucas et al. · 2014 · 471 citations
Gianluca Demartini, Djellel Difallah, Philippe Cudré-Mauroux · 2012 · 452 citations