2010 · 77 citations · 18 references
ComputingComputer ScienceArtificial IntelligenceAuction TheoryMachine LearningEthics Of Automated Decision-makingMechanism DesignHuman ComputationHuman-algorithm InteractionOpen Questions
"Tools for human computers" is an underexplored design space in human computation research, which has focused on techniques for buyers of human computation rather than sellers. We characterize the sellers in one human computation market, Mechanical Turk, and describe some of the challenges they face. We list several projects developed to approach these problems, and conclude with a list of open questions relevant to sellers, buyers, and researchers.
18
Crowdsourcing user studies with Mechanical Turk
Aniket Kittur, Ed H., Bongwon Suh · 2008 · 2K citations
Joel Ross, Lilly Irani, M. Six Silberman et al. · 2010 · 1K citations
Crowdsourcing graphical perception
Jeffrey Heer, M. G. Bostock · 2010 · 815 citations
Financial incentives and the "performance of crowds"
Winter Mason, Duncan J. Watts · 2009 · 533 citations
Demographics of Mechanical Turk
Panagiotis G. Ipeirotis · The Faculty Digital Archive (New York University) · 2010 · 457 citations · Full text