A pilot study on the use of decision theory and value of information analysis as part of the NHS Health Technology Assessment programme

Abstract

The pilot study showed that, even with very short timelines, it is possible to undertake DA-VOI that can feed into the priority-setting process that has been developed for the HTA programme. There are however a number of areas that need to be established at the beginning of the process, such as clarification of the nature of the decision problem for which additional research is being considered, explicitness about which existing data should be used and how data that exhibit particular weaknesses should be down-weighted in the analysis. Other areas, including optimum application of researcher time, integrating the vignette (a summary of the clinical problem and existing evidence) and the use of DA-VOI, training, use of sensitivity analyses, and deployment of clinical expertise, are also considered in terms of the potential implementation of DA-VOI within the HTA programme. Recommendations for further research include how literature searching should focus on those variables to which the model's results are most sensitive and with the highest expected value of perfect information; methods of evidence synthesis (multiple parameter synthesis) to consider the evidence surrounding multiple comparators and networks of evidence; and ways in which the value of sample information can be used by the NHS HTA programme and other research funders to decide on the most efficient design of new evaluative research. There is also a need for an analytical framework to be developed that can jointly address the question of whether additional resources would better be devoted to additional research or interventions to change clinical practice.