Figshare · 2018 · 41 citations · 12 references
BusinessDecision SciencesDecision AnalysisExperimental DesignExperimental EconomicsPeer ReviewReview ProceduresImpartial Decision-makingPeer Review EvaluationPeer Review MechanismsPeer-to-peer ReviewProposal FeedbackReviews
Motivated by a radically new peer review system that the National Science Foundation recently experimented with, we study peer review systems in which proposals are reviewed by PIs who have submitted proposals themselves. An (m, k)-selection mechanism asks each PI to review m proposals, and uses these reviews to select (at most) k proposals. We are interested in impartial mechanisms, which guarantee that the ratings given by a PI to others’ proposals do not affect the likelihood of the PI’s own proposal being selected. We design an impartial mechanism that selects a k-subset of proposals that is nearly as highly rated as the one selected by the non-impartial (abstract version of) the NSF pilot mechanism, even when the latter mechanism has the “unfair” advantage of eliciting honest reviews
12
Impartial division of a dollar
Geoffroy de Clippel, Hervé Moulin, Nicolaus Tideman · Journal of Economic Theory · 2007 · 103 citations
Impartial Nominations for a Prize
Ron Holzman, Hervé Moulin · Econometrica · 2013 · 86 citations
Noga Alon, Felix Fischer, Ariel D. Procaccia et al. · 2011 · 85 citations
John P. Dickerson, Ariel D. Procaccia, Tüomas Sandholm · 2013 · 75 citations