Perspectives on crowdsourcing annotations for natural language processing

Measuring nominal scale agreement among many raters.

Joseph L. Fleiss · Psychological Bulletin · 1971 · 8.5K citations

Education, Educational Assessment, Educational Measurement +13

Active Learning Literature Survey

Burr Settles · Minds at UW (University of Wisconsin) · 2009 · 4.8K citations · Full text

Computing, Computer Science, Machine Learning +9

The Berkeley FrameNet Project

Collin F. Baker, Charles J. Fillmore, John B. Lowe · 1998 · 2.6K citations · Full text

Language Studies, Computer Science, Linguistics +17

Labeling images with a computer game

Luis von Ahn, Laura Dabbish · 2004 · 2.2K citations

Computing, Computer Science, Computer Vision +16

Crowdsourcing user studies with Mechanical Turk

Aniket Kittur, Ed H., Bongwon Suh · 2008 · 2K citations

Computing, Computer Science, Information Systems +9