The design <i>versus</i> the analysis of observational studies for causal effects: parallels with the design of randomized trials

Donald B. Rubin

Statistics in Medicine · 2006 · 1K citations · 31 references

DOIFull text

Open access

TL;DR

Randomized experiments are the gold standard for estimating causal effects, but are often infeasible, so most causal knowledge comes from observational studies. This article argues that observational studies should be designed to approximate randomized experiments as closely as possible. The authors propose creating balanced subgroups of treated and control units using only background variables—typically via propensity score methods—without accessing outcome data, and illustrate this with a tobacco‑litigation example. © 2006 John Wiley & Sons, Ltd.

Abstract

Abstract For estimating causal effects of treatments, randomized experiments are generally considered the gold standard. Nevertheless, they are often infeasible to conduct for a variety of reasons, such as ethical concerns, excessive expense, or timeliness. Consequently, much of our knowledge of causal effects must come from non‐randomized observational studies. This article will advocate the position that observational studies can and should be designed to approximate randomized experiments as closely as possible. In particular, observational studies should be designed using only background information to create subgroups of similar treated and control units, where ‘similar’ here refers to their distributions of background variables. Of great importance, this activity should be conducted without any access to any outcome data, thereby assuring the objectivity of the design. In many situations, this objective creation of subgroups of similar treated and control units, which are balanced with respect to covariates, can be accomplished using propensity score methods. The theoretical perspective underlying this position will be presented followed by a particular application in the context of the US tobacco litigation. This application uses propensity score methods to create subgroups of treated units (male current smokers) and control units (male never smokers) who are at least as similar with respect to their distributions of observed background characteristics as if they had been randomized. The collection of these subgroups then ‘approximate’ a randomized block experiment with respect to the observed covariates. Copyright © 2006 John Wiley &amp; Sons, Ltd.

References

31