Early Economic Evaluation of Diagnostic Technologies: Experiences of the NIHR Diagnostic Evidence Co-operatives

Abstract

Diagnostic tests are expensive and time-consuming to develop. Early economic evaluation using decision modeling can reduce commercial risk by providing early evidence on cost-effectiveness. The National Institute for Health Research Diagnostic Evidence Co-operatives (DECs) was established to catalyze evidence generation for diagnostic tests by collaborating with commercial developers; DEC researchers have consequently made extensive use of early modeling. The aim of this article is to summarize the experiences of the DECs using early modeling for diagnostics. We draw on 8 case studies to illustrate the methods, highlight methodological strengths and weaknesses particular to diagnostics, and provide advice. The case studies covered diagnosis, screening, and treatment stratification. Treatment effectiveness was a crucial determinant of cost-effectiveness in all cases, but robust evidence to inform this parameter was sparse. This risked limiting the usability of the results, although characterization of this uncertainty in turn highlighted the value of further evidence generation. Researchers evaluating early models must be aware of the importance of treatment effect evidence when reviewing the cost-effectiveness of diagnostics. Researchers planning to develop an early model of a test should also 1) consult widely with clinicians to ensure the model reflects real-world patient care; 2) develop comprehensive models that can be updated as the technology develops, rather than taking a “quick and dirty” approach that may risk producing misleading results; and 3) use flexible methods of reviewing evidence and evaluating model results, to fit the needs of multiple decision makers. Decision models can provide vital information for developers at an early stage, although limited evidence mean researchers should proceed with caution.