How Careless Responding and Acquiescence Response Bias Can Influence Construct Dimensionality

Abstract

We investigated the effects that careless responding and acquiescence response bias have on analyses conducted to assess construct dimensionality. Using job satisfaction/dissatisfaction as the focal construct, we measured and controlled for careless responding and acquiescence bias in data obtained from an online survey of employees ( N = 666) from different organizations and occupational groups. We found that the negative correlation between factors defined by job satisfaction and dissatisfaction items, respectively, was attenuated by careless responding and acquiescence bias, and was not significantly different from –1.0 when both were controlled. Moreover, the correlations between the two factors and measures of other constructs were similar when careless responding and acquiescence were controlled. These findings challenge recent research purporting to demonstrate that job satisfaction and dissatisfaction are distinct constructs. Recommendations for future investigations of construct dimensionality are provided.