The Journal of Human Resources · 2021 · 59 citations · 57 references
Social SciencesBusiness EconomicsEconomicsEconometricsLabor EconomicsMicroeconomicsCausal Effect EstimationFixed-effect ModelsImpact IdentificationModel SpecificationPanel Data AnalysisTreatment EffectsEconometric IdentificationFixed-effect EstimatorsFixed-effect Model SelectionIdentification ConditionsIndividual Fixed EffectsPartial IdentificationSelection Model IdentificationTreatment Effect Identification
Many papers use fixed effects (FE) to identify causal impacts of an intervention. When treatment status only varies within some FE groups (e.g., families, for family fixed effects), FE can induce non-random selection of groups into the identifying sample, which we term selection into identification (SI). This paper empirically documents SI in the context of several family fixed effects (FFE) applications with a binary treatment. We show that the characteristics of the FFE identifying sample are different than the overall sample (and the policy-relevant population), including having larger families. The main implication of this is that when treatment effects are heterogeneous, the FE estimate may not be representative of the average treatment effect (ATE). We show that a reweighting-on-observables FE estimator can help recover the ATE for policy-relevant populations, and recommend its use either as a primary estimator or as a diagnostic tool to assess the importance of SI. We apply these insights to re-examine the longterm effects of Head Start in the PSID and the CNLSY using FFE. When we reweight the FFE estimates, we find that Head Start leads to a 2.1 percentage point (p.p.) increase (s.e. = 5.9 p.p.) in the likelihood of attending some college for white Head Start participants in the PSID. This participants' ATE is 83% smaller than the traditional FFE estimate (12 p.p). We also find that the CNLSY Head Start participants' ATE is smaller than the FE estimates. This raises new concerns with the external validity of FE estimates.
57
On the Pooling of Time Series and Cross Section Data
Yair Mundlak · Econometrica · 1978 · 5.2K citations
SOME THOUGHTS ON THE DISTRIBUTION OF EARNINGS 1
A. D. Roy · Oxford Economic Papers · 1951 · 3K citations
Experimental Analysis of Neighborhood Effects
Jeffrey R. Kling, Jeffrey B. Liebman, Lawrence F. Katz · Econometrica · 2007 · 2.7K citations
Analysis of Covariance with Qualitative Data
Gary Chamberlain · The Review of Economic Studies · 1980 · 2.7K citations