THE BETA‐BINOMIAL MODEL: VARIABILITY IN OVERDISPERSION ACROSS METHODS AND OVER TIME

R.E. Liggett, Jeannine Delwiche

Journal of Sensory Studies · 2005 · 34 citations · 15 references

Concepts

Abstract

ABSTRACT The beta‐binomial model accounts for variability between samples as well as variability between judges (overdispersion), making it possible to combine responses across judges and replications. Overdispersion (measured by gamma) was examined in this 3‐part study. (1) Groups of judges ( n = 53–59) performed two replications each of a paired comparison and paired preference. Results showed that extent of overdispersion could not be predicted from the method. (2) The stability of gamma across discrimination methods (2‐alternative forced choice [2‐AFC], 3‐alternative forced choice [3‐AFC], triangle and duo‐trio) was also examined ( n = 103). Results indicated that gamma was largely consistent across 2‐AFC, 3‐AFC and triangle tasks, but it was higher in the duo‐trio task. (3) The stability of gamma over time was also investigated ( n = 25). Results demonstrate that overdispersion varied over time with no clear pattern. In all cases, use of the beta‐binomial model allowed responses across judges and replications to be combined, increasing the power achieved for a given panel size.

References

15