Annual Review of Political Science · 2021 · 200 citations · 97 references
Social SciencesPsychologyCausal InferenceMethod ValidationNature Of ScienceExternal ValidityScientific EvidenceSource CredibilityTest ValidityEvaluative Criteria
External validity captures the extent to which inferences drawn from a given study's sample apply to a broader population or other target populations. Social scientists frequently invoke external validity as an ideal, but they rarely attempt to make rigorous, credible external validity inferences. In recent years, methodologically oriented scholars have advanced a flurry of work on various components of external validity, and this article reviews and systematizes many of those insights. We first clarify the core conceptual dimensions of external validity and introduce a simple formalization that demonstrates why external validity matters so critically. We then organize disparate arguments about how to address external validity by advancing three evaluative criteria: model utility, scope plausibility, and specification credibility. We conclude with a practical aspiration that scholars supplement existing reporting standards to include routine discussion of external validity. It is our hope that these evaluation and reporting standards help rebalance scientific inquiry, such that the current obsession with causal inference is complemented with an equal interest in generalized knowledge.
97
The weirdest people in the world?
Joseph Henrich, Steven J. Heine, Ara Norenzayan · Behavioral and Brain Sciences · 2010 · 12.1K citations
Statistics and Causal Inference
Paul W. Holland · Journal of the American Statistical Association · 1986 · 5.1K citations