Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposal

David M. Kent, Peter M. Rothwell, John P. A. Ioannidis, Doug Altman, Rodney A. Hayward

Trials · 2010 · 502 citations · 57 references

DOIFull text

Open access

Concepts

TL;DR

Clinical trials often exhibit substantial variation in outcome risk, leading to heterogeneity in treatment effects that can make the average benefit unrepresentative of typical patients, and conventional subgroup analyses frequently fail to detect such variation because they ignore the simultaneous influence of multiple characteristics. The authors propose a framework that prioritizes multivariate risk‑based assessment and reporting of heterogeneity in treatment effects. The framework is grounded in recent evidence on optimal statistical approaches to HTE and recommends labeling other subgroup analyses as primary or secondary based on prior evidence and clinical actionability. Adopting a standardized, transparent HTE assessment and reporting approach could markedly enhance the utility and interpretability of clinical trials.

Abstract

Mounting evidence suggests that there is frequently considerable variation in the risk of the outcome of interest in clinical trial populations. These differences in risk will often cause clinically important heterogeneity in treatment effects (HTE) across the trial population, such that the balance between treatment risks and benefits may differ substantially between large identifiable patient subgroups; the "average" benefit observed in the summary result may even be non-representative of the treatment effect for a typical patient in the trial. Conventional subgroup analyses, which examine whether specific patient characteristics modify the effects of treatment, are usually unable to detect even large variations in treatment benefit (and harm) across risk groups because they do not account for the fact that patients have multiple characteristics simultaneously that affect the likelihood of treatment benefit. Based upon recent evidence on optimal statistical approaches to assessing HTE, we propose a framework that prioritizes the analysis and reporting of multivariate risk-based HTE and suggests that other subgroup analyses should be explicitly labeled either as primary subgroup analyses (well-motivated by prior evidence and intended to produce clinically actionable results) or secondary (exploratory) subgroup analyses (performed to inform future research). A standardized and transparent approach to HTE assessment and reporting could substantially improve clinical trial utility and interpretability.

References

57