Journal of Sensory Studies · 2005 · 34 citations · 15 references
Social SciencesBehavioral SciencesPsychologyDecision TheoryExperimental DesignExperimental PsychologyBehavioral Decision-makingExperimental EvaluationForced-choice ProcedureForced-choice ScoringPaired Preference TestingPaired Preference TestsPerson-by-judge InteractionsThree-alternative Forced Choice
ABSTRACT The beta‐binomial model accounts for variability between samples as well as variability between judges (overdispersion), making it possible to combine responses across judges and replications. Overdispersion (measured by gamma) was examined in this 3‐part study. (1) Groups of judges ( n = 53–59) performed two replications each of a paired comparison and paired preference. Results showed that extent of overdispersion could not be predicted from the method. (2) The stability of gamma across discrimination methods (2‐alternative forced choice [2‐AFC], 3‐alternative forced choice [3‐AFC], triangle and duo‐trio) was also examined ( n = 103). Results indicated that gamma was largely consistent across 2‐AFC, 3‐AFC and triangle tasks, but it was higher in the duo‐trio task. (3) The stability of gamma over time was also investigated ( n = 25). Results demonstrate that overdispersion varied over time with no clear pattern. In all cases, use of the beta‐binomial model allowed responses across judges and replications to be combined, increasing the power achieved for a given panel size.
15
J. G. Skellam · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1948 · 414 citations
THE POWER OF SENSORY DISCRIMINATION METHODS
Daniel M. Ennis · Journal of Sensory Studies · 1993 · 264 citations
Discrimination testing: a few ideas, old and new
M. O'MAHONY · Food Quality and Preference · 2003 · 143 citations