Personality Moderating Variables: A Warning about Statistical Artifact and a Comparison of Analytic Techniques

Victor Bissonnette, William Ickes, Ira H. Bernstein, Eric S. Knowles

Journal of Personality · 1990 · 85 citations · 22 references

Concepts

TL;DR

Personality moderating variables qualify the relationship between a trait measure and a behavioral criterion. The study aimed to assess artifact from the median split approach on confounded simulated data and to compare its error rates with moderated multiple regression under confounded and nonconfounded conditions. The authors used computer‑simulated datasets with confounded moderator and trait extremity, applying both the median split and moderated multiple regression techniques to evaluate Type I and II error rates. The median split yielded a high rate of false moderating effects, whereas moderated multiple regression produced error rates near chance and more reliably detected true effects, leading the authors to recommend MMR over MS for testing personality moderators.

Abstract

ABSTRACT Personality moderating variables act to qualify the relationship between a personality trait measure and a relevant behavioral criterion. Two data analytic techniques that can be used to test for significant moderating effects are the “median split” (MS) approach and the “moderated multiple regression” (MMR) approach. The goals of the present research were ( a ) to apply the MS approach to computer‐simulated data in which the moderator and trait extremity are confounded, to determine the extent of artifact, and ( b ) to compare the performance (Type I and Type II error rates) of the two approaches when applied to confounded and nonconfounded data. It was found that when the MS approach was applied to confounded data in which no real moderating effect existed, this approach produced an alarming rate of apparent, but spurious, moderating effects. When the MMR approach was applied to the same data, the rate of spurious effects was reduced to that expected by chance. When both approaches were applied to simulated data which contained genuine moderating effects, the MMR approach consistently resulted in more correct detections of these effects than the MS approach. We conclude that researchers should always employ the MMR rather than the MS approach when testing for personality moderator variable effects.

References

22