Abstract
Background:
The introduction of antibodies targeting programmed cell death protein 1 (PD-1) and programmed cell death-ligand 1 (PD-L1) into clinical practice has had a revolutionary effect on cancer treatment. However, the incidence and risk of fatal adverse events (FAEs) following PD-1/PD-L1 inhibitor administration are controversial.
Methods:
We performed a systematic search for randomized controlled trials (RCTs) of PD-1/PD-L1 inhibitors (atezolizumab, avelumab, durvalumab, nivolumab, and pembrolizumab) in Embase, PubMed, the Cochrane database, and abstracts presented at American Society of Clinical Oncology and European Society of Medical Oncology from inception to July 2018. FAEs were extracted from each study and pooled to calculate overall incidence and odds ratios (ORs).
Results:
In total, 20 RCTs involving 12,398 patients with solid tumors were included in this study. The overall incidence of FAEs with PD-1/PD-L1 inhibitors was 0.43% [95% confidence interval (CI), 0.25–0.66%]. However, the incidences of FAEs varied significantly by tumor type and median follow-up time. Compared with conventional agents, the application of PD-1/PD-L1 inhibitors significantly reduced the risk of FAEs (OR, 0.56; 95% CI, 0.35–0.89; p = 0.015). Moreover, trial sequential analysis confirmed that our results were solid and reliable; further studies were unlikely to alter this conclusion. FAEs occurred dispersed in major organ systems, with the most common mortalities appearing in the respiratory system (46.2%).
Conclusions:
Compared with conventional treatment, PD-1/PD-L1 blockade monotherapy is associated with a significantly reduced risk of mortality in patients with solid tumors.
Introduction
Fatal adverse event (FAE) refers to death presumed to have been caused by a drug. FAE is a major cause of fatality globally; previous studies demonstrate that the incidence of fatal adverse drug reactions account for approximately 5% of all deaths in hospital patients, 1 and 3% in the general population. 2 In cancer patients, the risk of treatment-related mortalities may be even higher because of the serious toxicities induced by conventional treatments.3,4
The programmed cell death protein 1 (PD-1) and programmed cell death-ligand 1 (PD-L1) axis is an important immune checkpoint signaling pathway that downregulates the magnitude of the inflammation response and sustains immune homeostasis. 5 In 2014, the United States (US) Food and Drug Administration (FDA) approved pembrolizumab, the first PD-1/PD-L1 inhibitor, for the treatment of melanoma. Since then, agents targeting PD-1/PD-L1 have revolutionized clinical practice in a broad range of tumor types.6,7 Meanwhile, activation of the immune system can also affect healthy tissues and cause a variety of immune-related adverse events (AEs). Previous work has revealed that ipilimumab, an immune checkpoint inhibitor (ICI) targeting cytotoxic T-lymphocyte-associated protein 4 (CTLA-4), could increase the risk of mortality in cancer patients by 130%. 8 Although antibodies targeting PD-1/PD-L1 are relatively safe anti-tumor agents, serious adverse events (SAEs) and FAEs have been reported in clinical practice,9–16 and have unfortunate consequences for patients. One previous meta-analysis reported that PD-1/PD-L1 inhibitors have a similar risk of treatment-related death as chemotherapy agents 17 ; evidence was limited because only eight studies were available at that time. Additionally, three of the eight trials were not included in the final analysis since no FAEs were reported. 17 An improved understanding of this issue may have important public health and clinical implications given the expected significant increase in the future application of immunotherapy. 18 Here, with accumulating evidence, to evaluate the association between PD-1/PD-L1 blockade monotherapy and risk of FAE, we conducted a meta-analysis of randomized controlled trials among patients with solid tumors. Furthermore, we applied trial sequential analysis (TSA) to investigate whether the currently available evidence was sufficient and conclusive.
Materials and methods
This study was reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. 19
Literature search and study selection
A systematic search of the Embase, PubMed, and Cochrane databases from inception to July 2018 was conducted, with no language restrictions. Because recent progress with PD-1/PD-L1 inhibitors might be unpublished, additional searches were carried out through the proceedings of two major international congresses (American Society of Clinical Oncology and European Society of Medical Oncology). The search keywords and medical subject headings used were: atezolizumab, avelumab, durvalumab, nivolumab, pembrolizumab, checkpoint inhibitors, PD-1, PD-L1, and randomized controlled trial (Supplemental Material). All the authors performed the initial search independently, screened titles and abstracts for relevance, and identified trials as excluded, included, or uncertain. For uncertain trials, the full texts were reviewed for confirmation of eligibility. Any discrepancy was resolved by discussion.
Both inclusion and exclusion criteria were prespecified. To be eligible, studies had to meet the following criteria: (1) population: prospective phase II or phase III RCT involving adult patients (>18 years old) with solid tumor; (2) intervention: random assignment of patients to PD-1/PD-L1 inhibitors (atezolizumab, avelumab, durvalumab, pembrolizumab, and nivolumab) monotherapy or control treatment irrespective of dosage and duration; (3) outcomes: available information on FAEs and sample size. Studies were excluded if they were retrospective or prospective observational cohort trials. In addition, Phase I and nonrandomized phase II trials were excluded. Other publications, including review articles, preclinical papers, editorials, and cost-effectiveness analyses, were also excluded. When multiple publications of the same trial occurred, only the most recent or most complete reporting study was included. Any discrepancies were settled by discussion and consensus. All included trials represented unique studies.
Data extraction and risk-of-bias assessment
The key aim of this study was to establish the association between PD-1/PD-L1 inhibitors and FAEs in cancer patients. Eligible abstracts were collected and full texts were reviewed for trial design and reporting of FAEs. The following data were extracted: name of study, trial design, tumor type, number of patients enrolled, number of patients for safety analysis, therapy strategy, median treatment duration, median follow up, median overall survival, and number of FAEs.
The Cochrane risk-of-bias tool was applied to evaluate the risk of bias. 20 Every trial was scored as having high, low, or unclear risk of bias to the following criteria: random sequence generation; allocation concealment; blinding of participants and personnel to the study protocol; blinding of outcome assessment; incomplete outcome data and selective reporting. All authors carried out the data extraction and quality assessment independently. Any disagreements were resolved by discussion and consensus.
Trial sequential analysis
Random errors increase the risk of type I error (false-positive results) in meta-analysis because of sparse data or repetitive examining. 21 Accordingly, trial sequential analysis (TSA) was introduced.21,22 TSA can determine whether the data in a meta-analysis is reliable and conclusive. When the cumulative z curve crosses the trial sequential monitoring boundary, or enters the futility area, a sufficient level of evidence for the anticipated intervention effect may have been reached and no further trials need be included. If the z curve crosses none of the boundaries, and the required information size has not been reached, there is insufficient evidence to reach a conclusion. Here, we estimated the required information size using α = 0.05 (two-sided), β = 0.20 (power of 80%), the control event proportions calculated for the traditional palpation group, and an odds ratio (OR) reduction of 50% in the first-attempt failure. TSA was conducted using TSA version 0.9.5.9 Beta (http://www.ctu.dk/tsa).
Statistical analysis
The primary analysis investigated the overall incidence, OR, and corresponding 95% confidence interval (CI) of FAEs in patients treated with PD-1/PD-L1 inhibitors. To calculate the incidence, the number of patients and the number of FAEs were extracted from every trial. For calculation of OR, patients assigned to PD-1/PD-L1 inhibitor arm were compared with those assigned to a control arm. When trials reported no FAE in one arm, we applied a classic half-integer continuity correction to calculate OR.
Statistical heterogeneity across trials was evaluated by Cochrane’s Q statistic. The I2 statistic was calculated to assess the extent of inconsistency contributable to the heterogeneity across different studies. 23 The assumption of homogeneity was considered invalid for I2 > 25% and p < 0.05. Summary ORs and incidences were calculated using fixed-effects or random-effects models depending on the heterogeneity. To check the impact of various clinicopathological variables on FAE, we further conducted post hoc subgroup analysis based on tumor type, PD-1/PD-L1 inhibitors, clinical phase, control type, masking method, year of publication, and median follow up.
Potential publication bias was assessed by visual inspection of a funnel plot, and also evaluated using the tests of Egger and colleagues and Begg and colleagues.24,25 Two-sided p < 0.05 were considered statistically significant. All analysis was performed by MedCalc 18.2.1 (MedCalc Software, Belgium).
Results
Search results
In total, 8397 potentially related papers were identified from the initial search, including 3815 from PubMed, 4109 from EMBASE, and 473 from the Cochrane database. Of this total, 3694 articles were removed because of duplications. After screening of titles and abstracts, 4597 studies did not meet the inclusion criteria. Following further review of the whole texts of the remaining 106 potentially eligible articles, 20 RCTs were enrolled for the final analysis.9–15,26–39 A flow chart showing study selection is presented in Figure 1.

Selection of trials included in this study.
Study characteristics
The main characteristics of the 20 eligible RCTs are presented in Table 1. All these studies were international, multicenter, RCTs funded by the pharmaceutical industry. Randomized treatments were well generated in all trials. Of the 20 eligible RCTs, 14 were open-labeled,9–11,13,14,29–33,35–37,39 6 were double-blinded,12,15,26,27,34,38 and thus treated as being of low risk of performance and detection bias. Follow-up time was adequate for each trial. The methodological qualities of the included trials were generally moderate to good (Supplemental Table S1).
Characteristics of the trials included in this study.
FAE, fatal adverse event; G/GJC, gastric or gastroesophageal junction cancer; ICC, investigator-choice chemotherapy; NR, not reported; OS, overall survival; RCT, randomized controlled trial.
A total of 12,398 patients were included for safety analysis; 6923 (56%) subjects were treated by PD-1/PD-L1 inhibitors and 5475 subjects (44%) were enrolled in control arms. The average numbers of patients recruited in these eligible trials was 620 (range, 260–1187). Of the 20 studies, 17 were phase III RCTs, POPLAR and KEYNOTE-002 were phase II RCTs,30,38 and KEYNOTE-010 was a phase II/III trial. 35 Nivolumab was examined in 10 trials with 5296 patients, pembrolizumab in 7 trials with 4736 patients, and atezolizumab in 3 trials with 2366 patients. Underlying malignancies included lung cancer (seven studies, 4104 patients), melanoma (seven trials, 4660 patients), urothelial cancer (two trials, 1423 patients), gastric or gastroesophageal junction cancer (G/GJC, two trials, 1061 patients), renal cancer (one trial, 803 patients), and head and neck cancer (one trial, 347 patients). A total of 14 RCTs used chemotherapy as a control; other controls included Everolimus, 14 placebo,12,34,37 and ipilimumab.26,27,39
FAEs and PD-1/PD-L1 inhibitors
In total, there were 70 FAEs (PD-1/PD-L1 inhibitors, 29; control, 41) in the eligible trials. The highest incidence of FAE associated with PD-1/PD-L1 inhibitors was observed in G/GJC (1.42%; 95% CI, 0.65–2.69%), and the lowest incidence was observed in melanoma (0.26%; 95% CI, 0.10–0.54%). Using a random-effects model (heterogeneity test: Q = 32.37; p = 0.03; I2 = 41.3%), the summary incidence of FAEs in patients receiving PD-1/PD-L1 inhibitors was 0.43% (95% CI, 0.25–0.66%). We explored the possible causes of the heterogeneity. As shown in Table 2, the incidence of FAEs varies significantly by tumor type (p = 0.008) and median follow-up time (p = 0.046), suggesting that these factors contribute to the risk of FAEs.
Subgroup analysis of the incidences and ORs of FAEs with PD-1/PD-L1 inhibitors.
CI, confidence interval; FAE, fatal adverse event; G/GJC, gastric or gastroesophageal junction cancer; OR, odds ratio; PD-1/PD-L1, programmed cell death protein 1/programmed cell death-ligand 1.
The summary OR of FAE induced by PD-1/PD-L1 monotherapy is 0.56 (95% CI, 0.35–0.89; p = 0.015; Figure 2), suggesting a significantly decreased risk of FAEs associated with PD-1/PD-L1 inhibitors compared with controls. No heterogeneity was identified (Q = 6.56; p = 0.99; I2 = 0.0%). TSA reveals that the cumulative z curve crosses the boundary for required information size (Figure 3), which established sufficient and conclusive evidence. Thus, further trials were not needed and were unlikely to change our results.

OR of FAEs associated with PD-1/PD-L1 monotherapy versus control.

TSA of 20 RCTs comparing PD-1/PD-L1 inhibitors with controls (scaled trial distance). TSA demonstrated that the cumulative z curve crossed the boundary for required information size, establishing conclusive and sufficient evidence, and suggesting no further trials are needed. A diversity-adjusted required information size of 10,395 patients was calculated using α = 0.05 (two-sided) and β = 0.20 (power of 80%), an anticipated relative risk reduction of 50% in the control arm. X-axis, number of patients randomized; Y-axis, cumulative z score; horizontal red lines, conventional boundaries (z score, ±1.96; two-sided p = 0.05); sloping red lines with black dots, trial sequential monitoring boundaries; blue line with black dots, z curve; vertical red line, required information size.
Subgroup analyses
To examine whether tumor type influenced the risk of FAEs with PD-1/PD-L1 inhibitors, we conducted subgroup analysis based on tumor type (Table 2). The highest OR was found in G/GJC (OR, 1.67; 95% CI, 0.44–6.31; incidence, 1.42% versus 0.84%), and the lowest OR was observed in urothelial cancer (OR, 0.37; 95% CI, 0.13–1.03 incidence, 0.80% versus 1.99%). The odds ratio of FAEs showed statistical differences by tumor type (p = 0.04), suggesting the risk of FAE associated with PD-1/PD-L1 inhibitors was different among various tumor types.
To investigate whether the association between risk of FAE and PD-1/PD-L1 inhibitors could be altered by other clinicopathological characteristics, we also performed subgroup analysis according to PD-1/PD-L1 inhibitor, clinical phase, control type, masking method, year of publication, and median follow-up time (Table 2). No statistical difference was observed among all these subgroup analyses (p > 0.05 for all analyses).
Specific FAEs
Among the total 29 FAEs associated with PD-1/PD-L1 blockade treatment, 26 (89.7%) had specified adverse events, the rest were deaths (n = 3, 10.3%) due to unknown causes (Table 3). Detailed causes of FAEs are presented in Supplemental Table S2. Respiratory system (pneumonitis, pneumonia, and respiratory failure) had the most frequently occurring FAE, reported in 10 studies and representing a total of 12 deaths (46.2%) from of all specified FAEs. Other common reported FAEs occurred in heart (n = 3, 11.5%), and gastro-intestinal (n = 2, 7.7%) systems.
Incidences and OR of specific FAEs with PD-1/PD-L1 inhibitors.
CI, confidence interval; FAE, fatal adverse event; OR, odds ratio; PD-1/PD-L1, programmed cell death protein 1/programmed cell death-ligand 1.
Publication bias
Inspection of the funnel plot, and formal statistical tests (Begg’s test, p = 0.65; Egger’s test, p = 0.58), reveals no evidence of publication bias (Supplemental Figure S1).
Discussion
Here, based on 20 RCTs with 12,398 patients, our results revealed that the overall incidence of mortalities induced by PD-1/PD-L1 monotherapy was 0.43%. Compared with conventional treatment, PD-1/PD-L1 blockade immunotherapy decreased the risk of FAEs by 44%. TSA confirmed that our results were solid and reliable, further studies were unlikely to alter our findings. In addition, FAEs occurred in major organ systems in a dispersed manner, with the most common toxicities appearing in the respiratory system. These findings suggest that PD-1/PD-L1 blockade therapy is a relatively safe treatment regimen compared with conventional interventions. Although uncommon, fatal toxic effects occurred at a rate of 0.43% in PD-1/PD-L1 monotherapy. Clinicians should be aware of potential lethal complications. Moreover, future studies are needed to identify patients at high risk of FAE to establish optimal monitoring strategies and explore new methods to reduce risk.
Meta-analysis is a powerful tool for investigating rare events like FAE, given that it can comprehensively synthesize data from various trials to achieve a robust and reliable result. One previous study showed that there was no association between PD-1/PD-L1 inhibitors and risk of FAEs in cancer patients. 17 In this meta-analysis, eight trials with 4292 patients (experiment, 2498; control, 1794) were included in the PD-1/PD-L1 subgroup analysis. The incidence of FAEs was 0.52%, close to our estimate of 0.43% in the present study. However, the OR of FAEs was 0.63 (95% CI, 0.31–1.30), which was not consist with the primary result of our study. It should be noted that there were several differences between these two studies. First, our study included 20 well-conducted, high-quality RCTs, with over 12,000 adult patients with solid tumors. Moreover, the lack of heterogeneity in the risk of FAEs suggested good selection of eligible RCTs. With the increased statistical power of more than 8000 cases, our meta-analysis is the most up-to-date and comprehensive study to date, and should be more reliable and solid. Second, to further increase the robustness of our result, we conducted TSA to access the impact of potential random errors and repetitive testing. The analysis revealed that our study established sufficient and conclusive evidence. Third, we investigated the relationships between various clinicopathological characteristics and PD-1/PD-L1 monotherapy-related FAEs.
The development of immunotherapy has greatly improved clinical outcomes in various types of cancers, and immunotherapy is now increasingly used in earlier disease settings and in combination with other therapies.5,40 However, high-grade AEs, SAEs, even FAEs, can occur during treatment. There have been several meta-analyses estimating FAEs associated with ICIs.8,17 Currently, it is generally accepted that the use of ipilimumab is associated with an increased risk of FAEs compared with controls. 8 Interestingly, the observed immune-associated toxicities in patients receiving PD-1/PD-L1 inhibitors are similar to those related to anti-CTLA-4; however, the frequency is significantly lower in PD-1/PD-L1 blockade therapy. One possible explanation is that the PD-1/PD-L1 checkpoint acts at a later stage of the T cell response, which causes more limited T cell reactivity toward cancer cells, so these PD-1/PD-L1 inhibitors are generally well tolerated in clinical practice. Additionally, it should be noted that most ipilimumab trials were conducted relatively early, when knowledge about immune-associated AEs and management guidelines for such toxicities had not yet been established.
A recent meta-analysis revealed that taking one ICI was generally safer than taking two ICIs, or one ICI combined with conventional therapy. 41 It is plausible that, compared with monotherapy, combination therapy is associated with more FAEs. However, no direct or indirect comparison of FAEs between combination immunotherapy and conventional therapy has been conducted currently. This is a potential focus of future study.
Here, we evaluated the relationship of PD-1/PD-L1 blockade therapy with FAEs based on several different clinicopathological characteristics. The incidence of FAEs varied significantly among cancer types, reflecting the potential association of underlying tumor biology and PD-1/PD-L1 blockade therapy. Further analysis revealed that the risk of FAEs was significantly decreased in lung cancer. In contrast, the ORs of FAEs did not show any statistical differences in other types of cancer. This might suggest that better benefit/risk evaluation could be achieved though PD-1/PD-L1 blockade therapy in lung cancer treatment. With accumulating knowledge about side effects related to immunotherapy, it is speculated that the incidence of FAE will decrease with time. Here, we calculated the incidence and risk of FAE associated with PD-1/PD-L1 immunotherapy in studies published before 2017, and after 2017. However, our data failed to support this hypothesis. We think part of reason is that most of these studies were published between 2015 and 2017 (n = 18, 90%). This time period is too short to observe any significant differences. In addition, the timing when SAE/FAE occurred could have had important clinical implications. However, we cannot conduct such a subgroup analysis here because of the limited information provided in the original publications. This is a potential focus for future study.
Previous studies have revealed that ipilimumab treatment-related deaths are dominated by colitis.42,43 However, our study showed that almost 50% of FAEs induced by PD-1/PD-L1 blockade treatment occurred in the respiratory system. Accordingly, doctors should pay attention to any patient presenting with pulmonary symptoms, including dry cough, hypoxia, and shortness of breath. Radiologically, evidence of interstitial pneumonitis could be presented by high-resolution computed tomography.
This study has several important clinical implications. In clinical practice, the careful review of potential treatment-related toxicities should play an essential role in the decision-making process. In addition, the risk of mortality should be acknowledged to patients before they consent to any therapy. However, doctors often overestimate the beneficial side and overlook the harmful side of a treatment.44,45 Our findings here could play an important role in considering the risk/benefit trade-off of cancer treatment by providing data on the overall incidence and relative risk of FAEs in PD-1/PD-L1 blockade therapy.
This study is restricted by some limitations. First, there was significant heterogeneity in the incidence of FAEs among the included trials. We adjusted for this heterogeneity by applying a random-effects model to determine the overall incidence of FAEs. Even so, this might underestimate the real event rate, given that trials without any deaths received disproportional weight in the calculations. Second, these clinical trials were usually not designed specifically to address toxic events; thus, asymptomatic AEs may have been ignored in prospective assessment. Third, some eligible trials were open-label RCTs. Even for the double-blinded studies, skillful doctors might identify AEs induced by PD-1/PD-L1 inhibitors, which could lead to potential bias. Fourth, since the follow-up time for most eligible RCTs was relatively short, long-term observation of potential serious toxic effects is needed. Fifth, the eligible trials were carried out at different medical centers by various researchers, and might have potential bias in reporting FAEs. Especially, the attribution of FAE to PD-1/PD-L1 treatment was determined by the investigators, and thus associated with some subjectivity. The exact reason for mortality may not be fully studied even at single-patient level. Our study is subject to any biases or errors of the original investigators, and the results are generalizable only to the patient groups eligible for these trials.
Conclusion
PD-1/PD-L1 blockade monotherapy, compared with conventional treatment, significantly reduces the risk of FAEs in patients with solid tumors. This suggests that a better benefit/risk evaluation could be achieved in PD-1/PD-L1 immmonotherapy. However, clinicians should be aware of rare, but potentially lethal, complications, and ensure rigorous monitoring to improve outcomes.
Supplemental Material
suppl_material – Supplemental material for Fatal adverse events associated with programmed cell death protein 1 or programmed cell death-ligand 1 monotherapy in cancer
Supplemental material, suppl_material for Fatal adverse events associated with programmed cell death protein 1 or programmed cell death-ligand 1 monotherapy in cancer by Bin Zhao, Hong Zhao and Jiaxin Zhao in Therapeutic Advances in Medical Oncology
Footnotes
Acknowledgements
Authors Bin Zhao, Hong Zhao, and Jiaxin Zhao contributed equally to this work.
Author Note
Hong Zhao is now affiliated with The Cancer Center of the Fifth Affiliated Hospital, Sun Yat-sen University, Zhuhai, China.
Funding
The authors disclose receipt of the following financial support for the research, authorship, and publication of this article: This work was funded by National Natural Science Foundation of China (grant number 31571417), Postdoctoral Science Foundation of China (grant numbers 2018M641862 and 2019T120282), and Wenzhou Municipal Science and Technology Bureau (grant number Y20180086). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Conflict of interest statement
The authors declare that there is no conflict of interest.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
