Substantive and operational issues of response bias across levels of analysis: An example of climate-satisfaction relationships.

Abstract

Two studies tested whether method variance is present at multiple levels of analysis and whether methodological procedures can minimize its impact. In Study 1, 8,052 employees from 71 hotels completed measures of climate, work environment characteristics, and satisfaction. A comparison of correlations at the individual level, cross-level, cross-level split, aggregate level, and aggregate-split level of analysis revealed that response bias was present across multiple levels. Results suggest that samples should be split in half when cross-level and aggregate correlations are computed to ameliorate response bias problems that arise from individual-level method variance. In Study 2, results indicated that the temporal spacing of measures of climate and satisfaction influenced response bias. Implications and recommendations for future research are discussed.