Research Synthesis Methods · 2013 · 906 citations · 33 references
Public HealthBiostatisticsEpidemiologic MethodsEpidemiologyMeta-analysisBias ControlEffect Size EstimationHeterogeneity AssessmentModerator AnalysisPublication BiasSelection BiasConditional Mean EstimationEgger's TestPublication Bias CorrectionPublication Bias DetectionPublication Selection BiasSelection Bias AssessmentStatistical Value Of LifeTruncated Regression
Publication selection bias is a serious challenge to the integrity of all empirical sciences. We derive meta-regression approximations to reduce this bias. Our approach employs Taylor polynomial approximations to the conditional mean of a truncated distribution. A quadratic approximation without a linear term, precision-effect estimate with standard error (PEESE), is shown to have the smallest bias and mean squared error in most cases and to outperform conventional meta-analysis estimators, often by a great deal. Monte Carlo simulations also demonstrate how a new hybrid estimator that conditionally combines PEESE and the Egger regression intercept can provide a practical solution to publication selection bias. PEESE is easily expanded to accommodate systematic heterogeneity along with complex and differential publication selection bias that is related to moderator variables. By providing an intuitive reason for these approximations, we can also explain why the Egger regression works so well and when it does not. These meta-regression methods are applied to several policy-relevant areas of research including antidepressant effectiveness, the value of a statistical life, the minimum wage, and nicotine replacement therapy.
33
Bias in meta-analysis detected by a simple, graphical test
Matthias Egger, George Davey Smith, Martin Schneider et al. · BMJ · 1997 · 56.3K citations
Quantifying heterogeneity in a meta‐analysis
Julian P. T. Higgins, Simon G. Thompson · Statistics in Medicine · 2002 · 36.7K citations
Sample Selection Bias as a Specification Error
James J. Heckman · Econometrica · 1979 · 28.9K citations
Statistical Power Analysis for the Behavioral Sciences
Keith E. Muller · Technometrics · 1989 · 16.5K citations