Zeitschrift für Psychologie · 2016 · 30 citations · 39 references
Public HealthEducational PsychologyPsychologyExperimental DesignIndividual DifferencesMeta-analysisIndividual Participant Data Meta-analysisPublication BiasAggregationAggregation-induced BiasBiasesEcological FallacyMeta-analysis BiasMeta-analytic Bias Assessment
Abstract. Individual participant data (IPD) meta-analysis is the gold standard of meta-analyses. This paper points out several advantages of IPD meta-analysis over classical meta-analysis, such as avoiding aggregation bias (e.g., ecological fallacy or Simpson’s paradox) and shows how its two main disadvantages (time and cost) can be overcome through Internet-based research. Ideally, we recommend carrying out IPD meta-analyses that consider online versus offline data gathering processes and examine data quality. Through a comprehensive literature search, we investigated whether IPD meta-analyses published in the field of educational psychology already follow these recommendations; this was not the case. For this reason, the paper demonstrates characteristics of ideal meta-analysis on teachers’ judgment accuracy and links it to recent meta-analyses on that topic. The recommendations are important for meta-analysis researchers and for readers and reviewers of meta-analyses. Our paper is also relevant to current discussions within the psychological community on study replication.
39
Estimating the reproducibility of psychological science
Primary, Secondary, and Meta-Analysis of Research
Gene V. Glass · Educational Researcher · 1976 · 4.7K citations
Ecological Correlations and the Behavior of Individuals
W. Stitt Robinson · American Sociological Review · 1950 · 4.5K citations
Life Sciences, Ecology, Psychology +12