Integrative data analysis through coordination of measurement and analysis protocol across independent longitudinal studies.

TLDR

Replication across independent longitudinal studies is essential, yet meta‑analysis is hampered by limited published data, complex designs, and cross‑study measurement differences that reduce the utility of pooled analyses. The authors propose a collaborative, coordinated analysis framework that maximizes replication and extension across longitudinal studies by providing open access to analysis scripts and outputs. The framework coordinates analysis across studies by sharing scripts, outputs, and alternative statistical models, enabling evaluation and extension of results to additional datasets. The authors demonstrate that a coordinated analysis approach addresses challenges in meta‑analysis and pooled data, enhancing comparability, replication, and extension of longitudinal study findings.

Abstract

Replication of research findings across independent longitudinal studies is essential for a cumulative and innovative developmental science. Meta-analysis of longitudinal studies is often limited by the amount of published information on particular research questions, the complexity of longitudinal designs and the sophistication of analyses, and practical limits on full reporting of results. In many cases, cross-study differences in sample composition and measurements impede or lessen the utility of pooled data analysis. A collaborative, coordinated analysis approach can provide a broad foundation for cumulating scientific knowledge by facilitating efficient analysis of multiple studies in ways that maximize comparability of results and permit evaluation of study differences. The goal of such an approach is to maximize opportunities for replication and extension of findings across longitudinal studies through open access to analysis scripts and output for published results, permitting modification, evaluation, and extension of alternative statistical models and application to additional data sets. Drawing on the cognitive aging literature as an example, the authors articulate some of the challenges of meta-analytic and pooled-data approaches and introduce a coordinated analysis approach as an important avenue for maximizing the comparability, replication, and extension of results from longitudinal studies.