American Political Science Review · 2020 · 302 citations · 74 references
Social SciencesBiostatisticsCriminologyCausal InferenceDiscriminationPolicingBiasCriminal JusticePolice-citizen RelationsRacial DiscriminationRacismSelection BiasCausal Mediation EffectsDiscrimination MeasurementPolice BiasPolice DiscriminationPrincipal StratificationRace EffectsStatistical Bias CorrectionStratification
Researchers often lack the necessary data to credibly estimate racial discrimination in policing. In particular, police administrative records lack information on civilians police observe but do not investigate. In this article, we show that if police racially discriminate when choosing whom to investigate, analyses using administrative records to estimate racial discrimination in police behavior are statistically biased, and many quantities of interest are unidentified—even among investigated individuals—absent strong and untestable assumptions. Using principal stratification in a causal mediation framework, we derive the exact form of the statistical bias that results from traditional estimation. We develop a bias-correction procedure and nonparametric sharp bounds for race effects, replicate published findings, and show the traditional estimator can severely underestimate levels of racially biased policing or mask discrimination entirely. We conclude by outlining a general and feasible design for future studies that is robust to this inferential snare.
74
Sample Selection Bias as a Specification Error
James J. Heckman · Econometrica · 1979 · 28.9K citations
Statistics and Causal Inference
Paul W. Holland · Journal of the American Statistical Association · 1986 · 5.1K citations
The new Jim Crow: mass incarceration in the age of colorblindness
Choice Reviews Online · 2010 · 4.4K citations