Inductive Reasoning and Judgment Interference: Experiments on Simpson’s Paradox

Abstract

In a series of experiments on inductive reasoning, participants assessed the relationship between gender, success, and a covariate in a situation akin to Simpson's paradox: Although women were less successful then men according to overall statistics, they actually fared better then men at either of two universities. Understanding trivariate relationships of this kind requires cognitive routines similar to analysis of covariance. Across the first five experiments, however, participants generalized the disadvantage of women at the aggregate level to judgments referring to the different levels of the covariate, even when motivation was high and appropriate mental models were activated. The remaining three experiments demonstrated that Simpson's paradox could be mastered when the salience of the covariate was increased and when the salience of gender was decreased by the inclusion of temporal cues that disambiguate the causal status of the covariate.