Evaluation of the Impact of a Technology Appraisal Process in England: The South and West Development and Evaluation Committee

Abstract

Objectives:

To examine the influence of the English National Health Service (NHS) South and West (S&W) region Development and Evaluation Committee (DEC) technology appraisal reports on purchasing and clinical decisions in the S&W and elsewhere in the NHS, and to estimate the cost of the DEC process.

Methods:

Two postal questionnaires examining issues of awareness, influence and quality of the DEC reports were sent to samples of clinical and managerial health service staff in S&W NHS region, the North West NHS region, and three other randomly selected health authorities elsewhere. Supplementary telephone interviews were undertaken with a subsample of staff. Trends in utilisation before and after the publication of four S&W DEC reports were examined using routine health service data.

Results:

Survey response rates ranged between 73% and 85%. Within health authorities in the S&W, agreement about the impact of the DEC in informing policy and purchasing decisions was consistently high, although responses from clinicians were more equivocal. In the topic areas examined, the impact of the DEC reports could not be separated from wider influences on practice. The cost of each DEC report is estimated to have been £24 659.

Conclusions:

Health service staff perceived that the S&W DEC process had had an impact on policy decisions and clinical practice locally; however, any actual impact on practice could not be identified with routine data. The approach used in this study would be valuable in evaluating the impact of the English NHS National Institute for Clinical Excellence.