Objectives. In June 2011, the National Institute for Health and Care Excellence (NICE) Decision Support Unit published a Technical Support Document (TSD) providing recommendations on survival analysis for NICE technology appraisals (TAs). Survival analysis outputs are influential inputs into economic models estimating the cost-effectiveness of new cancer treatments. Hence, it is important that systematic and justifiable model selection approaches are used. This study investigates the extent to which the TSD recommendations have been followed since its publication. Methods. We reviewed NICE cancer TAs completed between July 2011 and July 2017. Information on survival analyses undertaken and associated critiques for overall survival (OS) and progression-free survival were extracted from the company submissions, Evidence Review Group (ERG) reports, and final appraisal determination documents. Results. Information was extracted from 58 TAs. Only 4 (7%) followed all TSD recommendations for OS outcomes. The vast majority (91%) compared a range of common parametric models and assessed their fit to the data (86%). Only a minority of TAs included an assessment of the shape of the hazard function (38%) or proportional hazards assumption (40%). Validation of the extrapolated portion of the survival function using external data was attempted in a minority of TAs (40%). Extrapolated survival functions were frequently criticized by ERGs (71%). Conclusions. Survival analysis within NICE TAs remains suboptimal, despite publication of the TSD. Model selection is not undertaken in a systematic way, resulting in inconsistencies between TAs. More attention needs to be given to assessing hazard functions and validation of extrapolated survival functions. Novel methods not described in the TSD have been used, particularly in the context of immuno-oncology, suggesting that an updated TSD may be of value.
DaviesCBriggsALorgellyPGarellickGMalchauH.The “hazards” of extrapolating survival curves. Med Decis Making. 2013;33(3):369–80.
2.
KearnsBChilcottJWhyteSPrestonLSadlerS.Cost-effectiveness of screening for ovarian cancer amongst postmenopausal women: a model-based economic evaluation. BMC Med. 2016;14(1):200.
3.
LatimerNR.Survival analysis for economic evaluations alongside clinical trials—extrapolation with patient-level data: inconsistencies, limitations, and a practical guide. Med Decis Making. 2013;33(6):743–54.
4.
National Institute for Health and Care Excellence. Guide to the methods of technology appraisal 2013: process and methods. April4, 2013. Available from: nice.org.uk/process/pmg9.
5.
BriggsAClaxtonKSculpherM.Decision Modelling for Health Economic Evaluation. New York: Oxford University Press; 2006.
6.
SandersGDNeumannPJBasuA, et al. Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: second panel on cost-effectiveness in health and medicine. JAMA. 2016;316(10):1093–103.
7.
Canadian Agency for Drugs and Technologies in Health. Guidelines for the Economic Evaluation of Health Technologies: 4th ed.Ottawa: Canadian Agency for Drugs and Technologies in Health; 2017.
8.
DrummondMFSchwartzJSJönssonB, et al. Key principles for the improved conduct of health technology assessments for resource allocation decisions. Int J Technol Assess Health Care. 2008;24(3):244–58.
KearnsBAraRWailooA, et al. Good practice guidelines for the use of statistical regression models in economic evaluations. Pharmacoeconomics. 2013;31(8):643–52.
National Institute for Health and Care Excellence. Eribulin for the treatment of locally advanced or metastatic breast cancer. Technology appraisal guidance [TA250]. Available from: https://www.nice.org.uk/guidance/ta250. Accessed July 2017.
14.
National Institute for Health and Care Excellence. Erlotinib for the first-line treatment of locally advanced or metastatic EGFR-TK mutation-positive non-small-cell lung cancer. Technology appraisal guidance [TA258]. Available from: https://www.nice.org.uk/guidance/ta258. Accessed July 2017.
15.
National Institute for Health and Care Excellence. Abiraterone for castration-resistant metastatic prostate cancer previously treated with a docetaxel-containing regimen. Technology appraisal guidance [TA259]. Available from: https://www.nice.org.uk/guidance/ta259. Accessed July 2017.
16.
National Institute for Health and Care Excellence. Bevacizumab in combination with capecitabine for the first-line treatment of metastatic breast cancer. Technology appraisal guidance [TA263]. Available from: https://www.nice.org.uk/guidance/ta263. Accessed July 2017.
17.
National Institute for Health and Care Excellence. Ipilimumab for previously treated advanced (unresectable or metastatic) melanoma. Technology appraisal guidance [TA268]. Available from: https://www.nice.org.uk/guidance/ta268. Accessed July 2017.
18.
National Institute for Health and Care Excellence. Vemurafenib for treating locally advanced or metastatic BRAF V600 mutation-positive malignant melanoma. Technology appraisal guidance [TA269]. Available from: https://www.nice.org.uk/guidance/ta269. Accessed July 2017.
19.
National Institute for Health and Care Excellence. Bevacizumab in combination with paclitaxel and carboplatin for first-line treatment of advanced ovarian cancer. Technology appraisal guidance [TA284]. Available from: https://www.nice.org.uk/guidance/ta284. Accessed July 2017.
20.
National Institute for Health and Care Excellence. Bevacizumab in combination with gemcitabine and carboplatin for treating the first recurrence of platinum-sensitive advanced ovarian cancer. Technology appraisal guidance [TA285]. Available from: https://www.nice.org.uk/guidance/ta285. Accessed July 2017.
21.
National Institute for Health and Care Excellence. Everolimus in combination with exemestane for treating advanced HER2-negative hormone-receptor-positive breast cancer after endocrine therapy. Technology appraisal guidance [TA295/TA421]. Available from: https://www.nice.org.uk/guidance/ta295. Accessed July 2017.
22.
National Institute for Health and Care Excellence. Crizotinib for previously treated non-small-cell lung cancer associated with an anaplastic lymphoma kinase fusion gene. Technology appraisal guidance [TA296/TA422]. Available from: https://www.nice.org.uk/guidance/ta296. Accessed July 2017.
23.
National Institute for Health and Care Excellence. Bosutinib for previously treated chronic myeloid leukaemia. Technology appraisal guidance [TA299/TA401]. Available from: https://www.nice.org.uk/guidance/ta299. Accessed July 2017.
24.
National Institute for Health and Care Excellence. Pixantrone monotherapy for treating multiply relapsed or refractory aggressive non-Hodgkin’s B-cell lymphoma. Technology appraisal guidance [TA306]. Available from: https://www.nice.org.uk/guidance/ta306. Accessed July 2017.
25.
National Institute for Health and Care Excellence. Aflibercept in combination with irinotecan and fluorouracil-based therapy for treating metastatic colorectal cancer that has progressed following prior oxaliplatin-based chemotherapy. Technology appraisal guidance [TA307]. Available from: https://www.nice.org.uk/guidance/ta307. Accessed July 2017.
26.
National Institute for Health and Care Excellence. Pemetrexed maintenance treatment following induction therapy with pemetrexed and cisplatin for non-squamous non-small-cell lung cancer. Technology appraisal guidance [TA309/TA402]. Available from: https://www.nice.org.uk/guidance/ta309. Accessed July 2017.
27.
National Institute for Health and Care Excellence. Afatinib for treating epidermal growth factor receptor mutation-positive locally advanced or metastatic non-small-cell lung cancer. Technology appraisal guidance [TA310]. Available from: https://www.nice.org.uk/guidance/ta310. Accessed July 2017.
28.
National Institute for Health and Care Excellence. Bortezomib for induction therapy in multiple myeloma before high-dose chemotherapy and autologous stem cell transplantation. Technology appraisal guidance [TA311]. Available from: https://www.nice.org.uk/guidance/ta311. Accessed July 2017.
29.
National Institute for Health and Care Excellence. Enzalutamide for metastatic hormone-relapsed prostate cancer previously treated with a docetaxel-containing regimen. Technology appraisal guidance [TA316]. Available from: https://www.nice.org.uk/guidance/ta316. Accessed July 2017.
30.
National Institute for Health and Care Excellence. Ipilimumab for previously untreated advanced (unresectable or metastatic) melanoma. Technology appraisal guidance [TA319]. Available from: https://www.nice.org.uk/guidance/ta319. Accessed July 2017.
31.
National Institute for Health and Care Excellence. Dabrafenib for treating unresectable or metastatic BRAF V600 mutation-positive melanoma. Technology appraisal guidance [TA321]. Available from: https://www.nice.org.uk/guidance/ta321. Accessed July 2017.
32.
National Institute for Health and Care Excellence. Imatinib for the adjuvant treatment of gastrointestinal stromal tumours. Technology appraisal guidance [TA326]. Available from: https://www.nice.org.uk/guidance/ta326. Accessed July 2017.
33.
National Institute for Health and Care Excellence. Axitinib for treating advanced renal cell carcinoma after failure of prior systemic treatment. Technology appraisal guidance [TA333]. Available from: https://www.nice.org.uk/guidance/ta333. Accessed July 2017.
34.
National Institute for Health and Care Excellence. Pomalidomide for relapsed and refractory multiple myeloma previously treated with lenalidomide and bortezomib. Technology appraisal guidance [TA338]. Available from: https://www.nice.org.uk/guidance/ta338. Accessed July 2017.
35.
National Institute for Health and Care Excellence. Obinutuzumab in combination with chlorambucil for untreated chronic lymphocytic leukaemia. Technology appraisal guidance [TA343]. https://www.nice.org.uk/guidance/ta343. Accessed July 2017.
36.
National Institute for Health and Care Excellence. Ofatumumab in combination with chlorambucil or bendamustine for untreated chronic lymphocytic leukaemia. Technology appraisal guidance [TA344]. Available from: https://www.nice.org.uk/guidance/ta344. Accessed July 2017.
37.
National Institute for Health and Care Excellence. Nintedanib for previously treated locally advanced, metastatic, or locally recurrent non-small-cell lung cancer. Technology appraisal guidance [TA347]. Available from: https://www.nice.org.uk/guidance/ta347. accessed July 2017.
38.
National Institute for Health and Care Excellence. Pembrolizumab for treating advanced melanoma after disease progression with ipilimumab. Technology appraisal guidance [TA357]. Available from: https://www.nice.org.uk/guidance/ta357. Accessed July 2017.
39.
National Institute for Health and Care Excellence. Idelalisib for treating chronic lymphocytic leukaemia. Technology appraisal guidance [TA359]. Available from: https://www.nice.org.uk/guidance/ta359. Accessed July 2017.
40.
National Institute for Health and Care Excellence. Paclitaxel as albumin-bound nanoparticles in combination with gemcitabine for previously untreated metastatic pancreatic cancer. Technology appraisal guidance [TA360]. Available from: https://www.nice.org.uk/guidance/ta360. Accessed July 2017.
41.
National Institute for Health and Care Excellence. Pembrolizumab for advanced melanoma not previously treated with ipilimumab. Technology appraisal guidance [TA366]. Available from: https://www.nice.org.uk/guidance/ta366. Accessed July 2017.
42.
National Institute for Health and Care Excellence. Bortezomib for previously untreated mantle cell lymphoma. Technology appraisal guidance [TA370]. Available from: https://www.nice.org.uk/guidance/ta370. Accessed July 2017.
43.
National Institute for Health and Care Excellence. Trastuzumab emtansine for treating HER2-positive, unresectable locally advanced or metastatic breast cancer after treatment with trastuzumab and a taxane. Technology appraisal guidance [TA371/TA458]. Available from: https://www.nice.org.uk/guidance/ta371. Accessed July 2017.
44.
National Institute for Health and Care Excellence. Radium-223 dichloride for treating hormone-relapsed prostate cancer with bone metastases. Technology appraisal guidance [TA376/TA412]. Available from: https://www.nice.org.uk/guidance/ta376. Accessed July 2017.
45.
National Institute for Health and Care Excellence. Enzalutamide for treating metastatic hormone-relapsed prostate cancer before chemotherapy is indicated. Technology appraisal guidance [TA377]. Available from: https://www.nice.org.uk/guidance/ta377. Accessed July 2017.
46.
National Institute for Health and Care Excellence. Ramucirumab for treating advanced gastric cancer or gastro–oesophageal junction adenocarcinoma previously treated with chemotherapy. Technology appraisal guidance [TA378]. Available from: https://www.nice.org.uk/guidance/ta378. Accessed July 2017.
47.
National Institute for Health and Care Excellence. Panobinostat for treating multiple myeloma after at least 2 previous treatments. Technology appraisal guidance [TA380]. Available from: https://www.nice.org.uk/guidance/ta380. Accessed July 2017.
48.
National Institute for Health and Care Excellence. Olaparib for maintenance treatment of relapsed, platinum-sensitive, BRCA mutation-positive ovarian, fallopian tube and peritoneal cancer after response to second-line or subsequent platinum-based chemotherapy. Technology appraisal guidance [TA381]. https://www.nice.org.uk/guidance/ta381. Accessed July 2017.
49.
National Institute for Health and Care Excellence. Nivolumab for treating advanced (unresectable or metastatic) melanoma. Technology appraisal guidance [TA384]. Available from: https://www.nice.org.uk/guidance/ta384. accessed July 2017.
50.
National Institute for Health and Care Excellence. Ruxolitinib for disease-related splenomegaly or symptoms in adults with myelofibrosis. Technology appraisal guidance [TA386]. Available from: https://www.nice.org.uk/guidance/ta386. Accessed July 2017.
51.
National Institute for Health and Care Excellence. Abiraterone for treating metastatic hormone-relapsed prostate cancer before chemotherapy is indicated. Technology appraisal guidance [TA387]. Available from: https://www.nice.org.uk/guidance/ta387. Accessed July 2017.
52.
National Institute for Health and Care Excellence. Cabazitaxel for hormone-relapsed metastatic prostate cancer treated with docetaxel. Technology appraisal guidance [TA391]. Available from: https://www.nice.org.uk/guidance/ta391. Accessed July 2017.
53.
National Institute for Health and Care Excellence. Ceritinib for the treatment of ALK positive nonsmall cell lung cancer previously treated with crizotinib. Technology appraisal guidance [TA395]. Available from: https://www.nice.org.uk/guidance/ta395. Accessed July 2017.
54.
National Institute for Health and Care Excellence. Trametinib in combination with dabrafenib for treating unresectable or metastatic melanoma. Technology appraisal guidance [TA396]. Available from: https://www.nice.org.uk/guidance/ta396. Accessed July 2017.
55.
National Institute for Health and Care Excellence. Azacitidine for treating acute myeloid leukaemia with more than 30% bone marrow blasts. Technology appraisal guidance [TA399]. Available from: https://www.nice.org.uk/guidance/ta399. Accessed July 2017.
56.
National Institute for Health and Care Excellence. Nivolumab in combination with ipilimumab for treating advanced melanoma. Technology appraisal guidance [TA400]. Available from: https://www.nice.org.uk/guidance/ta400. Accessed July 2017.
57.
National Institute for Health and Care Excellence. Ramucirumab for previously treated locally advanced or metastatic non-small-cell lung cancer. Technology appraisal guidance [TA403]. Available from: https://www.nice.org.uk/guidance/ta403. Accessed July 2017.
58.
National Institute for Health and Care Excellence. Degarelix for treating advanced hormone-dependent prostate cancer. Technology appraisal guidance [TA404]. Available from: https://www.nice.org.uk/guidance/ta404. Accessed July 2017.
59.
National Institute for Health and Care Excellence. Trifluridine–tipiracil for previously treated metastatic colorectal cancer. Technology appraisal guidance [TA405]. Available from: https://www.nice.org.uk/guidance/ta405. Accessed July 2017.
60.
National Institute for Health and Care Excellence. Crizotinib for untreated anaplastic lymphoma kinase-positive advanced non-small-cell lung cancer. Technology appraisal guidance [TA406]. Available from: https://www.nice.org.uk/guidance/ta406. Accessed July 2017.
61.
National Institute for Health and Care Excellence. Pegaspargase for treating acute lymphoblastic leukaemia. Technology appraisal guidance [TA408]. Available from: https://www.nice.org.uk/guidance/ta408. Accessed July 2017.
62.
National Institute for Health and Care Excellence. Talimogene laherparepvec for treating unresectable metastatic melanoma. Technology appraisal guidance [TA410]. Available from: https://www.nice.org.uk/guidance/ta410. Accessed July 2017.
63.
National Institute for Health and Care Excellence. Necitumumab for untreated advanced or metastatic squamous non-small-cell lung cancer. Technology appraisal guidance [TA411]. Available from: https://www.nice.org.uk/guidance/ta411. Accessed July 2017.
64.
National Institute for Health and Care Excellence. Cobimetinib in combination with vemurafenib for treating unresectable or metastatic BRAF V600 mutation-positive melanoma. Technology appraisal guidance [TA414]. Available from: https://www.nice.org.uk/guidance/ta414. Accessed July 2017.
65.
National Institute for Health and Care Excellence. Osimertinib for treating locally advanced or metastatic EGFR T790M mutation-positive non-small-cell lung cancer. Technology appraisal guidance [TA416]. Available from: https://www.nice.org.uk/guidance/ta416. Accessed July 2017.
66.
National Institute for Health and Care Excellence. Nivolumab for previously treated advanced renal cell carcinoma. Technology appraisal guidance [TA417]. Available from: https://www.nice.org.uk/guidance/ta417. Accessed July 2017.
67.
National Institute for Health and Care Excellence. Pertuzumab for the neoadjuvant treatment of HER2-positive breast cancer. Technology appraisal guidance [TA424]. Available from: https://www.nice.org.uk/guidance/ta424. Accessed July 2017.
68.
National Institute for Health and Care Excellence. Pembrolizumab for treating PD-L1-positive non-small-cell lung cancer after chemotherapy. Technology appraisal guidance [TA428]. Available from: https://www.nice.org.uk/guidance/ta428. Accessed July 2017.
69.
National Institute for Health and Care Excellence. Ibrutinib for previously treated chronic lymphocytic leukaemia and untreated chronic lymphocytic leukaemia with 17p deletion or TP53 mutation. Technology appraisal guidance [TA429]. Available from: https://www.nice.org.uk/guidance/ta429. Accessed July 2017.
70.
National Institute for Health and Care Excellence. Everolimus for the second-line treatment of metastatic renal cell carcinoma. Technology appraisal guidance [TA432]. Available from: https://www.nice.org.uk/guidance/ta432. Accessed July 2017.
71.
National Institute for Health and Care Excellence. Nanoliposomal irinotecan for the treatment of metastatic pancreatic cancer following gemcitabine-based therapy. Technology appraisal guidance [TA440]. Available from: https://www.nice.org.uk/guidance/ta440. Accessed July 2017.
72.
National Institute for Health and Care Excellence. Erlotinib and gefitinib for treating non-small-cell lung cancer that has progressed after prior chemotherapy. Technology appraisal guidance [TA374]. Available from: https://www.nice.org.uk/guidance/ta374. Accessed July 2017.
73.
KearnsBJonesMLStevensonMLittlewoodC.Cabazitaxel for the second-line treatment of metastatic hormone-refractory prostate cancer: a NICE single technology appraisal. Pharmacoeconomics. 2013;31(6):479–88.
74.
StevensJW.Using evidence from randomised controlled trials in economic models: what information is relevant and is there a minimum amount of sample data required to make decisions?Pharmacoeconomics. 2018;36(10):1135–41.
75.
BullementALatimerNRGorrodHB.Survival extrapolation in cancer immunotherapy: a validation-based case study. Value Health. 2019;22(3):276–83.
76.
CasellasJ.Bayesian inference in a piecewise Weibull proportional hazards model with unknown change points. J Anim Breed Genet. 2007;124(4):176–84.
77.
BagustABealeS.Survival analysis and extrapolation modeling of time-to-event clinical trial data for economic evaluation: an alternative approach. Med Decis Making. 2014;34(3):343–51.
78.
GuyotPWeltonNJOuwensMJAdesAE.Survival time outcomes in randomized, controlled trials and meta-analyses: the parallel universes of efficacy and cost-effectiveness. Value Health. 2011;14(5):640–6.
79.
IshakKJKreifNBenedictAMuszbekN.Overview of parametric survival analysis for health-economic applications. Pharmacoeconomics. 2013;31(8):663–75.
HainesPTremblayGBriggsA.A criterion-based approach for the systematic and transparent extrapolation of clinical trial survival data. J Health Econ Outcomes Res. 2015;2(2):147–60.
82.
National Institute for Health and Care Excellence. Nivolumab for previously treated squamous non-small-cell lung cancer. Technology appraisal guidance [TA483]. https://www.nice.org.uk/guidance/ta483. Accessed May 2018.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
