International Journal of Social Research Methodology · 2016 · 270 citations · 31 references
Public HealthBiostatisticsCausal InferenceExperimental DesignMeta-analysisEffect Size EstimationFixed-effect ModelsHeterogeneity AssessmentMissing Data HandlingModerator AnalysisMultilevel Meta-analysisEffect SizeFixed Effects EstimationOutcome MeasuresRobust EstimationThree-level Meta-analysisThree-level ModelsVariance EstimationWithin-study Dependence
This study investigates three methods to handle dependency among effect size estimates in meta-analysis arising from studies reporting multiple outcome measures taken on the same sample. The three-level approach is compared with the method of robust variance estimation, and with averaging effects within studies. A simulation study is performed, and the fixed and random effect estimates of the three methods are compared with each other. Both the robust variance estimation and three-level approach result in unbiased estimates of the fixed effects, corresponding standard errors and variances. Averaging effect sizes results in overestimated standard errors when the effect sizes within studies are truly independent. Although the robust variance and three-level approach are more complicated to use, they have the advantage that they do not require an estimate of the correlation between outcomes, and they still result in unbiased parameter estimates.
31
Statistical Power Analysis for the Behavioral Sciences
Keith E. Muller, Jacob Cohen · Technometrics · 1989 · 83.9K citations