Evaluating replicability of laboratory experiments in economics

TLDR

Experimental economics has joined the reproducibility discussion by replicating selected published experiments from two top‑tier journals, as noted by Camerer et al. Two‑thirds of the 18 studies examined yielded replicable effect sizes and directions, a proportion somewhat lower than predictions from a market but consistent with expectations based on sample sizes and p‑values. Science, p.

Abstract

Another social science looks at itself Experimental economists have joined the reproducibility discussion by replicating selected published experiments from two top-tier journals in economics. Camerer et al. found that two-thirds of the 18 studies examined yielded replicable estimates of effect size and direction. This proportion is somewhat lower than unaffiliated experts were willing to bet in an associated prediction market, but roughly in line with expectations from sample sizes and P values. Science , this issue p. 1433