Science · 2016 · 1.4K citations · 57 references
Social SciencesEconomicsBehavioral EconomicsExperimental DesignExperimental EconomicsExperimental EvaluationHypothesis TestingScientific EvidenceEffect SizeExperimental ReplicabilityMeasurement ReproducibilityP-valuesReplicability
Experimental economics has joined the reproducibility discussion by replicating selected published experiments from two top‑tier journals, as noted by Camerer et al. Two‑thirds of the 18 studies examined yielded replicable effect sizes and directions, a proportion somewhat lower than predictions from a market but consistent with expectations based on sample sizes and p‑values. Science, p.
Another social science looks at itself Experimental economists have joined the reproducibility discussion by replicating selected published experiments from two top-tier journals in economics. Camerer et al. found that two-thirds of the 18 studies examined yielded replicable estimates of effect size and direction. This proportion is somewhat lower than unaffiliated experts were willing to bet in an associated prediction market, but roughly in line with expectations from sample sizes and P values. Science , this issue p. 1433
57
Why Most Published Research Findings Are False
John P. A. Ioannidis · PLoS Medicine · 2005 · 10.5K citations · Full text
z-Tree: Zurich toolbox for ready-made economic experiments
Urs Fischbacher · Experimental Economics · 2007 · 9.9K citations · Full text
Estimating the reproducibility of psychological science
Joseph P. Simmons, Leif D. Nelson, Uri Simonsohn · Psychological Science · 2011 · 6.7K citations
Mutational heterogeneity in cancer and the search for new cancer-associated genes
Michael S. Lawrence, Petar Stojanov, Paz Polak et al. · Nature · 2013 · 5.7K citations · Full text