Abstract
Background:
The CheckMate-649 trial compared nivolumab plus chemotherapy (NC) with chemotherapy alone as first-line treatment for advanced gastric cancer (GC), gastroesophageal junction cancer (GEJC), and esophageal adenocarcinoma (EAC) and showed significant benefits to progression-free survival and overall survival. This study evaluated the lifetime cost-effectiveness of NC versus chemotherapy alone in patients with GC/GEJC/EAC from the perspective of the US payers.
Methods:
A 10-year partitioned survival model was constructed to evaluate the cost-effectiveness of NC and chemotherapy alone and measured the health achievements in quality-adjusted life-years (QALYs), incremental cost-effectiveness ratios (ICERs), and life-years. Health states and transition probabilities were modeled from the survival data from the CheckMate-649 clinical trial (NCT02872116). Only direct medical costs were considered. One-way and probabilistic sensitivity analyses were conducted to assess the robustness of the results.
Results:
On comparing the chemotherapy, we found that NC incurred substantial health costs, resulting in ICERs of $240,635.39/QALY, $434,182.32/QALY, and $386,715.63/QALY for the model of patients with programmed cell death-ligand 1 (PD-L1) combined positive score (CPS) ⩾5, PD-L1 CPS ⩾1, and all-treated patients, respectively. All ICERs were significantly higher than the willingness-to-pay threshold value of $150,000/QALY. The main influencing factors were the cost of nivolumab, the utility value of the progression-free disease, and the discount rate.
Conclusion:
Compared with chemotherapy alone, NC may not be a cost-effective option for treating advanced GC, GEJC, and EAC in the United States.
Keywords
Introduction
Gastric cancer (GC) is one of the leading causes of cancer-related deaths and the most common cancer, with the fifth and third highest incidence and mortality rates among cancers worldwide. 1 The definition of GC is relatively broad, and a variety of cancers, including gastroesophageal junction cancer (GEJC), which forms at the junction of the stomach and esophagus, can be classified as GC. 2 In the United States, there are approximately 27,500 new cases and 11,000 deaths annually, with a 5-year survival rate of 30% for all stages.3,4
Esophageal cancer ranks seventh and sixth in global cancer incidence and mortality. 1 Esophageal cancer mainly consists of squamous cell carcinoma and adenocarcinoma, which account for more than 90% of malignant esophageal tumors. 5 Among them, the incidence of esophageal adenocarcinoma (EAC) is rising faster than any other cancer in the United States. In addition, EAC is usually diagnosed at an advanced stage and has a 5-year survival rate of less than 20%. 6
GC/GEJC/EAC have similar molecular characteristics and have comparable clinical outcomes with systemic chemotherapy in the advanced setting. 7 Patients with advanced GC/GEJC/EAC have limited treatment options, and NCCN Clinical Practice Guidelines in Oncology recommend fluorouracil plus platinum as systemic chemotherapy. However, the therapeutic effect is still not ideal, leading to tumor recurrence and treatment ineffectiveness in some cases.8,9 In recent years, immunotherapy has been an emerging approach for treating solid tumors. In particular, immune checkpoint inhibitors (ICIs) have shown promising therapeutic effects on solid tumors, and the possible benefits of combination therapies combining ICIs with other agents are being explored clinically.10,11
In the tumor microenvironment, PD-L1 expressed by tumor cells binds to PD-1 expressed by tumor-infiltrating T lymphocytes, allowing tumor cells to evade the immune attack and inducing T cells apoptosis. 11 ICIs can block the interaction between PD-1 and PD-L1 by preventing the binding of PD-L1 and PD-1, and the immune killing ability can then be restored, thereby killing tumor cells. 11
Nivolumab is a highly potent inhibitor of PD-1 targets. 7 CheckMate-649 is a global multicenter, randomized, open-label phase III clinical trial (NCT02872116). 7 The trial evaluated the efficacy of nivolumab plus chemotherapy (NC) compared to chemotherapy in improving overall survival (OS) and progression-free survival (PFS). The median OS was 13.8 and 11.6 months in the overall population, 14.1 and 11.1 months in patients with PD-L1 CPS ⩾5, and 14.0 and 11.3 months in patients with PD-L1 CPS ⩾1 in the NC and chemotherapy arms, respectively. The median PFS was 7.7 and 6.9 months in the overall population, 7.7 and 6.05 months in patients with PD-L1 CPS ⩾5, and 7.5 and 6.9 months in patients with PD-L1 CPS ⩾1 in the NC and chemotherapy arms, respectively. The results showed that NC significantly improved OS and PFS in patients with advanced GC/GEJC/EAC.
Despite the more extended survival advantage of NC over chemotherapy, its high cost also increases the financial burden on patients’ families and society.12,13 Therefore, as NC is included in the first-line treatment pattern, it is necessary to analyze further the impact of combination chemotherapy with nivolumab on treatment cost-effectiveness. We provided the following articles according to the request of the CHEERS 2022 report list. 14
Materials and Methods
Population
Targeted population
This study utilized the sample characteristics of the CheckMate-648 clinical trial: patients were aged ⩾18 years (median age 61–62 years) with previously untreated, unresectable advanced or metastatic GC, GEJC, or EAC, regardless of PD-L1 expression. Patients with prior adjuvant or neoadjuvant chemotherapy, radiotherapy, and/or chemoradiotherapy (administered at least 6 months before randomization) were allowed. This study was conducted in the overall population, patients with PD-L1 CPS ⩾5, and patients with PD-L1 CPS ⩾1, respectively. 7
Intervention
Patients received nivolumab (360 mg every 3 weeks or 240 mg every 2 weeks) plus chemotherapy [XELOX every 3 weeks (capecitabine 1000 mg/m2 twice daily, days 1–14 and oxaliplatin 130 mg/m2, day 1) or FOLFOX every 2 weeks (leucovorin 400 mg/m2, day 1; fluorouracil 400 mg/m2, day 1 and 1200 mg/m2, days 1–2; and oxaliplatin 85 mg/m2, day 1)] or chemotherapy alone. All treatments were administered intravenously except for oral capecitabine. Treatment continued until disease progression, unacceptable toxic effects, consent withdrawal, or study termination. Patients can be treated with NC for up to 2 years. 7
Model
Model approach
Cost-effectiveness analysis is based on a partitioned survival model, which determines the number and proportion of individuals in each state from the survival curves. 15 It is the method most commonly used by National Institute for Health and Clinical Excellence currently to evaluate interventions for advanced or metastatic cancer. 15 Survival data were extracted from Kaplan-Meier (K-M) curves of the CheckMate-648 clinical trial using GetData Graph Digitizer software (version 2.26; http://www.getdata-graph-digitizer.com/download.php), which is a software product developed by GetData Pty Ltd, an Australian software development company. 16 According to Guyot et al.’s method, the K-M curves were reconstructed by R language software (version 3.5.1) and extrapolated to obtain long-term clinical outcomes. 17 The distribution functions included Exponential, Weibull, Log-Normal, Gamma, and Log-Logistic. 18 The goodness-of-fit was examined using the Akaike information criterion (AIC), Bayesian information criterion (BIC), and visual simulation methods. 19 Lower AIC and BIC values indicate a better fit (The fitting results are shown in Supplemental Figures 1 and 2, and the selected fitting curves and data are shown in Table 1). The area under the OS curve estimated the proportion of patients who survived, and the area under the PFS curve calculated the proportion of patients with progression-free disease (PFD). The space between the OS and PFS curves estimated the proportion of patients with the progressed disease (PD) (The key steps to calculate the transition probability are shown in Supplemental Figure 3). 19 The probability of death for patients with PFD in the model was assumed to be the natural mortality rate. 20
Model parameters and ranges used in the sensitivity analyses.
AE, adverse event; CPS, combined positive score; iv, intravenous injection; NC, nivolumab plus chemotherapy; PD, progressed disease; PFD, progression-free disease.
Model assumptions
The median treatment duration for patients receiving first-line NC and chemotherapy alone was 6.5 and 4.9 months, respectively. Therefore, the first-line treatment durations for our model were assumed to be seven and five cycles in the NC and chemotherapy arms, respectively.
All patients received second-line chemotherapy after progression. Second-line chemotherapy regimens were developed based on the recommendations of NCCN Clinical Practice Guidelines in Oncology, systematic treatment information provided by CheckMate-649, and guidance of an oncologist to enhance the validity and reliability of our model.8,9 Therefore, second-line chemotherapy regimens were assumed to be paclitaxel every 21 days (175 mg/m2, day 1), docetaxel every 21 days (75–100 mg/m2, day 1), or irinotecan monotherapy every 14 days (150–180 mg/m2, day 1); all treatments were administered intravenously.
Model structure
This study was based on the data from the CheckMate-649 clinical trial to build a partitioned survival model with TreeAgePro2022, a decision analysis software developed by TreeAge Software, Inc, to obtain total costs and total outputs over the time horizon. The model constructs three mutually exclusive health states: PFD, PD, and death. All patients were initially set to a PFD state, and in each cycle, the patient’s status could be maintained or moved to the following health state. Due to the poor prognosis of patients with advanced GC/GEJC/EAC, the 5-year survival rate is less than 20%. The time horizon was set at 10 years, which can fully cover the whole life cycle of the patients. The model cycle was set to 4 weeks, referring to the course of chemotherapy. Based on the CheckMate-649 clinical trial, NC and chemotherapy alone were used as first-line treatment for advanced GC/GEJC/EAC, as shown in Figure 1. Patients in PD status would be treated with irinotecan, paclitaxel, or docetaxel and have an equal chance of receiving them. Sensitivity analysis was performed on the probability of choosing different treatment options after progression to avoid the impact of this assumption on the results. The primary outcomes included total cost, quality-adjusted life-year (QALY), and incremental cost-effectiveness ratio (ICER).

Partitioned survival model simulating the results of the CheckMate-649 clinical trial. All patients started in the PFD state and received appropriate treatment. Patients could enter the PFD state and subsequently move to the death state. XELOX: capecitabine 1000 mg/m2 twice daily, days 1–14 and oxaliplatin 130 mg/m2, day 1, every 3 weeks; FOLFOX: leucovorin 400 mg/m2, day 1, fluorouracil 400 mg/m2, day 1 and 1200 mg/m2, days 1–2, and oxaliplatin 85 mg/m2, day 1, every 2 weeks.
Cost input
Model cost inputs are listed in Table 1. Only direct medical costs were considered in the model, including drug costs, administration costs, management costs of serious adverse events (AEs), and follow-up costs. 21 Drug costs were obtained from the Medicare part B drug average sales price provided by the Centers for Medicare and Medicaid Services, and the administration costs were obtained from the Medicare Physician Fee Schedule.22,23 Other costs were derived from published literature. Only AEs ⩾3 with an incidence greater than 10% were considered in our study. Management cost of AEs per cycle = incidence rate of AEs × management cost of AEs. Management costs of AEs were only applied to the first cycle of the model and assumed to occur only once in 1 month. Costs and utilities were discounted using a 3% discount rate. 24
Utility input
Model inputs concerning utility are listed in Table 1. Health utility values for PFD and PD were derived from published studies. 26 The utility value of PFD was 0.797, derived from EuroQol (EQ-5D) responses of the TOGA trial calculated by the Japanese scoring algorithm. 26 The utility value of PD was 0.577, derived from the National Institute for Health and Clinical Excellence. 26 Other utility values were obtained from the published literature. The disutility of AEs per cycle = the disutility of AEs × incidence rate of AEs. The AEs’ disutility was applied only to the first cycle of the model and was assumed to occur only once in 1 month.
Sensitivity analysis
One-way sensitivity analysis was used to analyze the influence of different parameters on ICER when they varied within a specific range. Twenty percent fluctuation in cost, utility, the incidence of adverse reactions, and body surface area were used as the range of variation for these parameters. The ranges of variation for other parameters were obtained from the published literature. The results were presented in the figure of the tornado diagram.
Second-order Monte Carlo simulations were used for probabilistic sensitivity analysis to assess the overall robustness of the results. According to the ISPOR-SMDM report, the cost and medical resource utilization parameters were set to Gamma distributions, the incidence rate of AEs and health utility were set to Beta distributions, and body surface area was set to normal distributions. 27 The probabilistic sensitivity analysis was repeated 1000 times. The results were presented as cost-effectiveness acceptability curves and incremental cost-effectiveness scatter plots, representing the probability that each treatment option was cost-effective at the willingness-to-pay (WTP) threshold. The WTP threshold in the United States was set at $150,000, as recommended by Neumann et al. 28
Results
Base-case results
The results of the base-case analysis are shown in Table 2. The incremental cost of NC was $95,280.39 compared with chemotherapy alone in the overall population, and the incremental effect was 0.25 QALY, leading to the ICER of $386,715.63/QALY. The incremental cost of NC was $94,841.74 and $93,978.28 compared with the chemotherapy in the patients with PD-L1 CPS ⩾5 and PD-L1 CPS ⩾1, and the incremental effect was 0.39 and 0.22 QALY, leading to the ICER of $240,635.39/QALY and $434182.32/QALY, respectively. All ICERs were significantly higher than the US WTP threshold of $150,000/QALY.
The cost and outcome results of the base-case analysis.
C, chemotherapy; CPS, combined positive score; ICER, incremental cost-effectiveness ratio; NC, nivolumab plus chemotherapy; QALYs, quality-adjusted life-years.
Sensitivity analysis
The results of the one-way sensitivity analysis are shown in Figures 2 to 4. The most influential factors were the cost of nivolumab, the utility value of PFD, and the utility value of PD. Other parameters, including the proportion of XELOX, the incidence rate of AEs, etc., slightly impacted the ICERs. However, none of the variables could reduce the ICER values below the threshold, which was consistent with the base-case results.

One-way sensitivity analysis in patients with PD-L1 CPS ⩾5.

One-way sensitivity analysis in patients with PD-L1 CPS ⩾1.

One-way sensitivity analysis in the overall population.
The results of the probabilistic sensitivity analysis are shown in Figures 5 to 7 and Supplementary Figures 1 to 3. The cost acceptability curves indicate that at a threshold of $150,000, the probability that NC is a cost-effective option is 0. If the WTP is increased to $250,000, then the probability that NC is economical in the patients with PD-L1 CPS ⩾5 is >50%, while the probability that it is economical in the overall population and in the patients with PD-L1 CPS ⩾1 is 0. The possibility that NC has a cost-effectiveness advantage may increase as WTP improves. However, at present, first-line NC may not be a cost-effective option for advanced GC/GEJC/EAC compared with chemotherapy.

The cost-effectiveness acceptability curves of patients with PD-L1 CPS ⩾5.

The cost-effectiveness acceptability curves of patients with PD-L1 CPS ⩾1.

The cost-effectiveness acceptability curves for overall population.
Discussion
Patients with advanced GC/GEJC/EAC have limited treatment options, poor prognosis, and a low 5-year survival rate.3,4 The CheckMate-649 clinical trial showed that NC could significantly improve OS and PFS in patients with advanced GC/GEJC/EAC. Based on the CheckMate-649 clinical trial, the FDA approved NC as first-line therapy for advanced GC/GEJC/EAC, regardless of PD-L1 expression status. However, nivolumab is expensive, whether its price reflects the drug’s clinical value, the health insurance system will guarantee the drug’s cost, and patients will ultimately receive treatment with nivolumab. These questions remain to be determined. Therefore, it is necessary to evaluate the economics of nivolumab use.
Our study shows that first-line NC for patients with advanced GC/GEJC/EAC may not be a cost-effective option from the perspective of third-party payers in the United States. Compared with chemotherapy alone, the ICER values obtained for NC were significantly higher than the $150,000 WTP threshold in the overall population, the patients with PD-L1 CPS ⩾5, and those with PD-L1 CPS ⩾1. One-way sensitivity analysis showed that the cost of nivolumab, the utility value of PFD, and the utility value of PD significantly impacted the model results but could not reduce ICER below WTP. Probabilistic sensitivity analysis showed that the probability of NC being economical at the US $150,000 WTP threshold was 0. First-line NC for patients with advanced GC/GEJC/EAC does not have a cost-effectiveness advantage compared with chemotherapy.
Our findings are consistent with two recent economic analyses of NC for the treatment of advanced GC/GEJC/EAC.29,30 Both studies were conducted from the Chinese healthcare system perspective. Jiang et al.’s 29 study showed that, compared with chemotherapy alone, ICER produced by NC was $191,266/QALY. Shu et al.’s 30 study showed that NC yielded an ICER of $278,658.71/QALY compared to chemotherapy alone. Both ICERs were significantly higher than the WTP threshold in China (triple GDP per capita $37,654/QALY), suggesting that NC is not an economical treatment option for patients with advanced GC/GEJC/EAC compared with chemotherapy alone, which is consistent with our findings. In addition, these studies had some limitations in terms of model and data processing: in Jiang’s analysis, the second-line regimen was only paclitaxel monotherapy and did not involve the fitting of the survival model; in Shu’s study, the distribution function of survival model were all fitted by Weibull, and the study was only conducted in the patients with PD-L1 CPS ⩾5. Both studies have some limitations.
In addition, patients who discontinue the therapy of NC because of intolerable AEs or for other reasons may continue to show clinical benefit if treatment is continued. There are few studies on immunotherapy combined with chemotherapy as the first-line treatment for advanced GC/GEJC/EAC, and the optimal duration of therapy with nivolumab remains to be investigated. 31
There are some limitations to our study. First, CheckMate-649 is a multicenter, randomized, phase III clinical trial comparing NC versus chemotherapy alone in advanced GC/GEJC/EAC. This is a large, well-designed clinical trial. But our model depends on the trial’s validity and universality, and our study will reflect all deviations in the trial. Second, the utility values were obtained from the published literature in our study. The values of AEs were derived from published studies of small cell lung cancer, and different diseases may affect the results. Third, only AEs ⩾3 were considered in our research, which might have influenced the results. However, the cost of AEs <3 was relatively low, and one-way sensitivity analysis showed that these AEs had little impact on results. Fourth, second-line treatment may use different chemotherapy regimens. We assumed that patients in the PD state would be treated with irinotecan, paclitaxel, or docetaxel according to the NCCN Clinical Practice Guidelines in Oncology and assumed the probability of using all three drugs is equal. However, the situation of patients with advanced GC/GEJC/EAC is more complex and using different treatment regimens may affect the final results.
Although these limitations may limit the applicability of this study, one-way sensitivity analysis showed that the cost of nivolumab, the utility value of PFD and PD, and other parameters were not enough to reduce the ICER value below the threshold, which was consistent with the results of base-case analysis. Therefore, our study can still serve as a valuable reference for doctors and policymakers, reflecting the general clinical treatment of patients with advanced GC/GEJC/EAC.
Conclusion
From the perspective of a third-party payer in the United States, the ICERs obtained for NC were significantly higher than the $150,000 WTP threshold compared with chemotherapy in the overall population, patients with PD-L1 CPS ⩾5, and patients with PD-L1 CPS ⩾1. At present, first-line NC may not be a cost-effective option for patients with advanced GC/GEJC/EAC.
Supplemental Material
sj-docx-1-tam-10.1177_17588359231171038 – Supplemental material for First-line nivolumab plus chemotherapy versus chemotherapy alone for advanced gastric cancer, gastroesophageal junction cancer, and esophageal adenocarcinoma: a cost-effectiveness analysis
Supplemental material, sj-docx-1-tam-10.1177_17588359231171038 for First-line nivolumab plus chemotherapy versus chemotherapy alone for advanced gastric cancer, gastroesophageal junction cancer, and esophageal adenocarcinoma: a cost-effectiveness analysis by Xueqiong Cao, Mingming Zhang, Na Li, Bin Zheng, Maobai Liu, Xiaobing Song and Hongfu Cai in Therapeutic Advances in Medical Oncology
Footnotes
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
