Subgroup identification from randomized clinical trial data

Jared C. Foster, Jeremy M. G. Taylor, Stephen J. Ruberg

Statistics in Medicine · 2011 · 554 citations · 17 references

DOIFull text

Open access

TL;DR

Identifying subgroups with enhanced treatment effect in randomized trials, ideally defined by few covariates, is a key challenge. The authors propose a standard, pre‑determined strategy to mitigate the risks of ad hoc subgroup analyses. They introduce the Virtual Twins approach, which predicts treatment and control response probabilities for each subject, uses their difference as an outcome in a tree, and estimates subgroup treatment effects via several cross‑validation and bootstrap methods. Simulations show Virtual Twins markedly outperforms logistic regression with forward selection when a true subgroup exists, though large samples or strong effects are required. © 2011 John Wiley & Sons, Ltd.

Abstract

We consider the problem of identifying a subgroup of patients who may have an enhanced treatment effect in a randomized clinical trial, and it is desirable that the subgroup be defined by a limited number of covariates. For this problem, the development of a standard, pre‐determined strategy may help to avoid the well‐known dangers of subgroup analysis. We present a method developed to find subgroups of enhanced treatment effect. This method, referred to as ‘Virtual Twins’, involves predicting response probabilities for treatment and control ‘twins’ for each subject. The difference in these probabilities is then used as the outcome in a classification or regression tree, which can potentially include any set of the covariates. We define a measure to be the difference between the treatment effect in estimated subgroup and the marginal treatment effect. We present several methods developed to obtain an estimate of , including estimation of using estimated probabilities in the original data, using estimated probabilities in newly simulated data, two cross‐validation‐based approaches, and a bootstrap‐based bias‐corrected approach. Results of a simulation study indicate that the Virtual Twins method noticeably outperforms logistic regression with forward selection when a true subgroup of enhanced treatment effect exists. Generally, large sample sizes or strong enhanced treatment effects are needed for subgroup estimation. As an illustration, we apply the proposed methods to data from a randomized clinical trial. Copyright © 2011 John Wiley & Sons, Ltd.

References

17