Assessing the Validity of Key Informant Reports about Congregations' Social Composition

Abstract

Key informant interviewing is an important methodological tool for gathering information about congregations, but little research has examined the accuracy of the information key informants provide. We assess the validity of key informant reports about congregations’ social composition from the 1998 and 2006–2007 National Congregations Study using data from the 1998 and 2006 General Social Survey. We find that, in the aggregate, key informants are reasonably accurate on most measures, but they are less accurate when reporting congregants’ education, age, and household composition. Our findings regarding congregations’ social composition are consistent with other research showing that key informants provide the most valid assessments when they are asked about directly observable organizational characteristics.