Research on Social Work Practice · 2022 · 11 citations · 24 references
Evidence-based InterventionRandomized Controlled TrialsEducationResearch EthicsSocial WorkPsychologyRandomized Controlled TrialPublic HealthInternal ValidityPilot ExperimentHealth SciencesHealth PolicyClinical Trial ManagementCausal QuestionsPreregistration (Science)Clinical Trial DesignDrug TrialClinical Trial EvaluationSurvey Methodology
Randomized controlled trials (RCTs) are designed to answer causal questions with internal validity. However, threats to internal validity exist for even well-designed RCTs. In this article, we focus on how preregistration can help address some specific threats to internal validity related to the reporting of results. Preregistration involves researchers publicly posting critical decision points in a study prior to conducting it for the purpose of making researcher plans transparent, making deviations from those plans discoverable, and improving the validity of tests of significance. We provide a brief overview of null-hypothesis significance testing; consider how questionable research practices (e.g., p-hacking) and conducting data-dependent analysis threaten the validity of significance tests; discuss how preregistration can help address these threats and how preregistration works for RCTs; note limitations and challenges to preregistration; and provide recommendations for increasing the use of preregistration by researchers conducting RCTs in social work, education, and related fields.
24
Why Most Published Research Findings Are False
John P. A. Ioannidis · PLoS Medicine · 2005 · 10.2K citations · Full text
Joseph P. Simmons, Leif D. Nelson, Uri Simonsohn · Psychological Science · 2011 · 6.6K citations
The preregistration revolution
Brian A. Nosek, Charles R. Ebersole, Alexander C. DeHaven et al. · Proceedings of the National Academy of Sciences · 2018 · 1.8K citations · Full text