American Economic Review · 2022 · 31 citations · 4 references
Public HealthEconomicsCausal InferenceEconometricsStatisticsBias ControlCausal Effect EstimationHypothesis TestingInstrumental VariablesPublication BiasStatistical AnalysisDifference-in-differencesInstrumental Variables EstimationOne-sided Hypothesis TestsPublication Bias DetectionRandomizationSignificance ThresholdsStatistical Significance ThresholdsTwo-sided Hypothesis Tests
Brodeur, Cook, and Heyes (2020) study hypothesis tests from economic articles and find evidence for p-hacking and publication bias, in particular for instrumental variable and difference-in-difference studies. When adjusting for rounding errors (introducing a novel method), statistical evidence for p-hacking from randomization tests and caliper tests at the 5 percent significance threshold vanishes for difference-in-differnce studies but remains for instrumental variable studies. Results at the 1 percent and 10 percent significance thresholds remain largely similar. In addition, Brodeur, Cook, and Heyes derive latent distributions of z-statistics absent publication bias using two different approaches. We establish for each approach a result that challenges its applicability. (JEL A14, C12, C52)
4
Star Wars: The Empirics Strike Back
Abel Brodeur, Mathias Lé, Marc Sangnier et al. · American Economic Journal Applied Economics · 2015 · 419 citations · Full text
Identification of and Correction for Publication Bias
Isaiah Andrews, Maximilian Kasy · American Economic Review · 2019 · 376 citations · Full text
Public Health, Economics, Psychology +17