Abstract
Keywords
For approximately two thirds of patients undergoing radical prostatectomy for prostate cancer, surgery is curative and patients remain disease-free (without biochemical or radiographic evidence of recurrence). 1 However, patients with adverse pathologic findings (defined as seminal vesicle invasion, extraprostatic extension, and positive surgical margins [residual tumor at the surgical site]) experience up to a 60% risk of recurrence at 10 years and may require subsequent radiation therapy. 2
In three randomized controlled trials, adjuvant radiotherapy improved recurrence-free survival for men with adverse pathologic findings compared with a “watch-and-wait” approach (SWOG S8794, 3 EORTC 22911, 4 and ARO 96-02 5 ). As a result, the American Urological Association (AUA) and American Society for Radiation Oncology (ASTRO) published guidelines recommending adjuvant radiotherapy for these patients, while recommending salvage radiotherapy for patients who do not fit these criteria but who develop biochemical recurrence following surgery. 2 Problematically, patients in the “watch-and-wait” strategy received a variety of postoperative treatments including radiotherapy, surgical castration, medical hormonal treatments, and others, administered in a nonsystematic fashion. Furthermore, both the design and execution biased against the “watch-and-wait” approach as only a third of the men in this arm received radiotherapy and it was delayed in nearly half of these. Finally, compared with the endpoint of recurrence following salvage radiotherapy, the endpoint employed (recurrence prior to salvage therapy) favored an adjuvant strategy. 6 Thus, due to limitations in the design, analysis, and interpretation of the three randomized trials, many experts do not support the routine use of adjuvant radiotherapy,7,8 despite the AUA/ASTRO guidelines.
An alternative to adjuvant radiotherapy for all patients is the salvage radiotherapy strategy in which radiation is administered at the time of recurrence, thus sparing the 40% of patients with adverse pathologic features who will not recur unnecessary radiotherapy. In observational data, salvage radiotherapy has been shown to provide durable cancer control for patients at high risk for progression to metastasis 9 and to decrease the risk of prostate cancer–related mortality compared with observation alone. 10 The benefit is maximized when radiotherapy is administered early following biochemical recurrence. 10 However, there are no published randomized controlled trials comparing adjuvant and early salvage radiotherapy. A recent trial assessing these two modalities closed prior to reaching planned accrual (RAVES; https://clinicaltrials.gov/ct2/show/NCT00860652).
Decision models are useful when examining population-based implementation of established treatments and when assessing complex balances of benefit and harm including quality of life. 11 Thus, we used a decision analysis to compare quality-adjusted survival between adjuvant and salvage radiotherapy strategies.
Methods
Decision Model
We constructed a health state transition (Markov) model employing two-dimensional Monte Carlo simulation using TreeAge HealthPro 2015 (TreeAge Software Inc., Williamstown, MA) to compare quality-adjusted life expectancy (QALE) for patients with adverse pathologic findings, defined as positive surgical margins, seminal vesicle invasion, and extraprostatic extension, 2 following radical prostatectomy. Model parameters were selected from distributions (outer-loop or second-order iterations), and for each parameter set, hypothetical patients were simulated (inner-loop or first order iterations). Second-order simulation captures parameter-level uncertainly, whereas first-order simulation allows for patient-level variability. The latter facilitates the simulation of the life history of individual hypothetical patients as they traverse through various health states and allows for tracking of complications as they are experienced.
Modelling Details
We modelled a cycle duration of 1 month and used a lifetime time horizon. We discounted QALE at 3% per annum 12 and employed a trapezoidal within-cycle correction for bias arising from discrete-time Markov models. 13
To account for uncertainty in the probabilities and utilities employed in the model, we sampled the model parameters as distributions using point estimates and measures of uncertainty, such as confidence intervals or standard error. Where published studies did not include these uncertainty measures, we treated the variables as fixed. Further details are provided in the online appendix (Supplementary Table 6).
Outcome
The primary outcome was QALE, which comprises duration of survival and quality of life. Quality of life was assessed using utility weights, derived from a standard gamble technique, which have been previously used in decision analyses of prostate cancer treatments (Table 1).14–16 The effect of complications was assessed using disutility scores. To combine utilities, after sampling the disease-related health state utility from a beta distribution, we subtracted the lowest complication-related disutility.
Utilities and Disutilities Used to Inform Health States
The secondary outcome was overall life expectancy (without quality adjustment). We performed a sensitivity analysis without discounting.
Treatment Strategies
For each second-order iteration (parameter set), we considered hypothetical cohorts of 10,000 men with adverse pathologic findings following radical prostatectomy for prostate cancer, beginning 10 to 12 weeks postoperatively. This time was chosen as it represents when patients are likely to initiate radiotherapy in the adjuvant strategy.4,5 Men receive radiotherapy immediately on entering the model (adjuvant) or undergo surveillance with radiotherapy administered for biochemical recurrence (salvage; serum prostate specific antigen < 0.4 ng/mL).
We based this model on a number of disease-related health states (Figure 1) following multidisciplinary consensus involving radiation oncologists (GM and ES), urologists (CJDW, RS, and RKN), and an external methodologist (AJ). Radiotherapy was assumed to last for one cycle. After radiation, patients entered the “previous radiotherapy” state. Subsequently, patients either remained in that state or sequentially moved through disease progression states based on literature-derived transition probabilities.

Diagram of health states. Patients in the adjuvant radiotherapy arm initially enter the model at the “Currently undergoing radiotherapy” state, whereas those in the salvage arm enter at the “Well Post-op” state. We assumed that patients then sequentially progressed through the health states based on literature-derived probabilities. A decision analytic tree is provided in the appendix as Supplementary Figure 1.
Independent of current state membership, we explicitly modeled complications of erectile dysfunction, urinary incontinence, and bowel dysfunction as they significantly affect patient quality of life and have been used in other decision analyses in prostate cancer.15,17 Postsurgical complications of erectile dysfunction and urinary incontinence recovered according to literature derived probabilities within 1 and 2 years of surgery, respectively.18,19 We assumed that adjuvant radiotherapy did not increase the probability of erectile dysfunction or incontinence nor their probabilities of recovery compared with salvage, based on previous work.20,21 For patients receiving radiotherapy, we modeled radiotherapy-associated bowel dysfunction, which we assumed to recover after 1 year.
Derivation of Model Probabilities
Transition probabilities were determined from a MEDLINE literature search as of 1 November 2015, supplemented by hand search of references from retrieved studies, review articles, previous decision analyses, and expert consultation (Table 2). The multidisciplinary panel appraised the acquired literature. Each transition probability and utility was determined by consensus following panel discussion. Priority was given to results derived from randomized trials, followed by multi-institutional cohort studies. We assumed the risk of metastasis after recurrence and prostate cancer mortality following metastasis were the same in both arms. Annual age-specific probabilities of other cause death were obtained from life tables.
Transition Probabilities Used to Inform Monte Carlo Microsimulation Model
Derivation of the composite estimates is provided in Supplementary Table 1.
May recover for first 12 months following radical prostatectomy.
May recover for first 24 months following radical prostatectomy.
Model Calibration
We calibrated the values of the probabilities of recurrence following radical prostatectomy, recurrence following radiotherapy in the adjuvant and salvage arms, metastasis following recurrence, prostate cancer mortality following metastasis, and other cause mortality using biochemical recurrence as the outcome. To do so, we multiplied each literature-derived probability by a calibration factor and compared the resulting value for biochemical recurrence with the results of EORTC 22911. 4 As the trial did not have a salvage radiotherapy arm, we used the probability of recurrence following radical prostatectomy for our salvage arm and the probability of recurrence following radiotherapy for our adjuvant arm as calibration outcomes. We selected the combination of calibration values, which resulted in the best approximation of the trial.22,23 Further details are available in the appendix.
Analysis
We used two-dimensional simulation in order to capture both parameter-level uncertainty and patient-level variability. We drew 10,000 parameter samples from the distributions specified from the literatures search and, for each, simulated cohorts of 10,000 hypothetical patients. On each inner-loop iteration, each hypothetical patient traversed both strategies and the incremental benefit was calculated as the difference in quality-adjusted survival between the two strategies. The incremental benefits were then averaged across the 10,000 inner-loop iterations. These average incremental benefits were then averaged in turn across the 10,000 outer-loop parameter samples to yield the overall model output.
To better understand the relationship between treatment strategy and QALE, we plotted a histogram of the incremental benefit of salvage radiotherapy across the total number of parameter samples. Further details are in the appendix.
Results
Model Validation
Following calibration, the model closely approximated the results of EORTC 22991 (Figure 2). Five-year biochemical recurrence rates were 26% for patients in the adjuvant group and 44% for patients in the salvage group, similar to literature values (Supplementary Table 5).3–5 Thus, we considered the model adequately calibrated and validated.

Kaplan-Meier analysis of biochemical recurrence comparing model-derived results (modeled) following calibration with the EORTC 22911 trial (observed). 4
Quality-Adjusted Life Expectancy
A salvage radiotherapy strategy was associated with increased QALE (mean 58.3 months), compared with adjuvant radiotherapy (53.7 months) for men with adverse pathological findings. The mean incremental benefit was 4.6 months (standard deviation 8.8 months).
Among 10,000 outer-loop iterations of the model, salvage radiotherapy had a higher QALE in 5,270 (52.7%) iterations while adjuvant was preferred in 4,730 (47.3%). The distribution of incremental benefit was heavily skewed (Figure 3), with a much larger incremental benefit among iterations favoring salvage radiotherapy (9.4 months) than among iterations favoring adjuvant (0.8 months; Figure 3).

Distribution of incremental benefit of salvage radiotherapy, compared with adjuvant radiotherapy, across 10,000 outer-loop iterations of the decision analytic model.
Overall Life Expectancy
The mean difference in overall survival between the two radiotherapy strategies was 0.07 months (2 days; standard deviation 0.4 months) favoring an adjuvant radiotherapy approach, with mean survival of 64 months in both groups. In an analysis without discounting, the mean difference was 0.2 months (6 days; standard deviation 0.6 months), again favoring an adjuvant approach.
Discussion
We evaluated the optimal radiation strategy for patients with adverse pathological findings following radical prostatectomy for prostate cancer using a health state transition (Markov) model employing two-dimensional Monte Carlo simulation. A salvage radiotherapy therapy strategy was associated with QALE of 58.3 months, whereas adjuvant radiotherapy had QALE of 53.7 months, an incremental benefit of 4.6 quality-adjusted life months. We found a marked skew in incremental benefit with a much larger benefit in those iterations favoring salvage radiotherapy. Our model showed validity when compared with published randomized data assessing adjuvant radiotherapy.
Wright and Weinstein suggested that interpretation of an incremental benefit in QALE can be made by comparing with other, similar interventions aimed at similar patient populations. 24 The incremental benefit of adjuvant chemotherapy for women with node-positive breast cancer is 3.2 quality-adjusted life months. 24 Thus, the benefit seen with salvage radiotherapy compared with adjuvant is likely meaningful. However, these authors also point out that such population average effects do not preclude the possibility of conflicting outcomes for individual patients.
Elliott and others have previously examined this research question using a similar methodology 6 and demonstrated that salvage radiotherapy is associated with improved QALE when accounting for the disutility of radiotherapy. Our analysis employs more mature data from both the EORTC 4 and ARO 5 randomized trials and probabilistic sensitivity analyses, which account for uncertainty and variability in all parameters simultaneously, rather than deterministic sensitivity analyses. This allowed us to capture the distribution of the incremental benefit around its mean. Furthermore, its highlights the two dimensions of the policy question: first, what treatment most benefits the entire population of patients following radical prostatectomy (an economic, utilitarian perspective), and second, what treatment is best for each individual patient? We sought to assess the former. In doing so, we found that a salvage radiotherapy strategy is unambiguously superior. However, this does not preclude adjuvant radiotherapy benefiting a subset of men, supported by the finding that adjuvant radiotherapy was preferred in 47% of iterations. However, the incremental benefit of adjuvant radiotherapy in these iterations was quite small. Conversely, in iterations favoring salvage radiotherapy, the incremental benefit was large.
In order to better inform individual patient decision making, the use of genomic classifiers may assist in the identification of patients who are at high risk of biochemical recurrence or metastasis following radical prostatectomy.25–27 Furthermore, genomic markers may distinguish between patients who benefit from adjuvant radiotherapy and those who do not.28,29 Thus, adjuvant radiotherapy is likely to benefit patients who are identified as being at high risk of biochemical recurrence and metastasis. 30
As there were very small differences in unadjusted life expectancy, the observed differences in QALE were driven by differences in quality of life in keeping with previous analyses. 6 This likely stems from the avoidance of radiotherapy complications in a large proportion of patients in the salvage radiotherapy group who never recur. In a subset of 217 patients in SWOG S8794, adjuvant therapy was associated with worse bowel and urinary function and with increased symptom distress but not with significant differences in other general measures of health-related quality of life. 31 However, Moinpour and others employed the SWOG quality of life questionnaire, whereas the US Panel on Cost-Effectiveness in Health and Medicine and the UK National Institute of Health and Clinical Excellence recommend the use of QALEs based on utilities 32 such as we used to inform health care decision making.
We did not perform traditional deterministic sensitivity analyses in which one or two probability or utilities values were varied in order to assess the sensitivity of the model to variation in a single parameter because variation in the model results is due to the simultaneous uncertainty of all parameters. Therefore, we used probabilistic analyses in which all parameters were varied simultaneously (by using probability distributions). The net effect of the global uncertainty is reflected in the distribution of incremental benefits around the mean. 33 Furthermore, we examined the frequency with which each strategy is optimal. 33 As the distribution of net benefit shifts when assessing unadjusted life expectancy, the model appears to be sensitive to quality of life assessment as reflected in utility scores, as others have shown. 34
Typically, gains in QALE necessitate active medical intervention. In contrast, this analysis demonstrates that prostate cancer patients with adverse pathological findings benefit when postoperative radiotherapy is withheld until there is evidence of recurrence. In this analysis, we considered quality-adjusted and overall life expectancy outcomes and did not model costs. This was done in order to increase the generalizability of the research findings as there is wide variation in radiotherapy costs across regions and jurisdictions, a minority of which is due to patient factors. 35 While costs were not explicitly examined, in keeping with the framework of Choosing Wisely, 36 routine adoption of a salvage radiotherapy strategy offers an opportunity to improve patient outcomes while reducing health care utilization.
There are several limitations of this study. First, we assumed that salvage radiotherapy is administered early in the time course of biochemical recurrence. While this may not reflect routine clinical practice, it is appropriate for comparative assessment of adjuvant and salvage radiotherapy. Second, true clinical complexity is underestimated in this model. We used estimates derived from the primary analyses of each of the randomized controlled trials. Many authors have pointed out the significant heterogeneity of outcomes within this group, 7 including the lack of survival benefit to adjuvant radiotherapy for patients with negative surgical margins 37 and possible harm for patients older than 70 years. 4 Furthermore, recent observational data suggest that patients treated with early salvage radiotherapy (prostate specific antigen 0.2–0.5 ng/mL) have a similar risk of recurrence or metastasis as those treated with adjuvant radiotherapy. 38 In addition, there are limitations regarding the modeling of complications. First, we considered these dichotomously rather than as a spectrum of severity as they exist in clinical practice. Second, we considered the risk of incontinence and erectile dysfunction to be equivalent between the groups based on literature review including data from SWOG S8794.3,20 However, there is recent observational evidence that functional outcomes may be compromised by early postoperative radiotherapy. 18 Additional complications beyond erectile dysfunction, incontinence, and bowel dysfunction may also be important following radiotherapy. 39 Inclusion of these would be expected to increase the difference between the two strategies as a greater proportion of patients in the adjuvant arm are expected to experience these complications. Thus, in each instance, we have used conservative assumptions that favor adjuvant radiotherapy and therefore underestimate the true benefit of routine adoption of a salvage radiotherapy strategy. Finally, we assumed that each patient in the salvage radiotherapy strategy would receive early radiotherapy. While in clinical practice, a proportion of patients may be lost to follow-up or have delayed recognition of recurrence for another reason, such an assumption is reasonable when assessing the population-level effects of a salvage approach.
The quality of the conclusions that can be drawn from this decision model depends on the data underpinning our transition probabilities. In many cases, we were unable to obtain transition probabilities for the adjuvant and salvage radiotherapy arms from the same study population given the heterogeneous treatment offered to patients in the “watch-and-wait” arms.
Methodologically, there is debate regarding the most appropriate manner to combine utilities with options including addition, multiplication, selection of the lowest utility, and selection of the highest utility. We selected disease-related health states independently from beta distributions. We considered the treatment-related complications to be short-term outcomes and thus subtracted the associated disutilities from the disease-related health state utilities, as has been recommended. 40 Distribution-based sampling as we performed produces a range of possible values that encompasses the results of multiplicative, additive, and minimum approaches.
Recently, the addition of androgen deprivation therapy to salvage radiotherapy following prostatectomy was shown to improve recurrence and progression-free survival. 41 Should this practice become standard of care, survival is likely to improve for all patients with adverse pathologic factors following radical prostatectomy, but it is not clear how this may affect the incremental benefit of salvage compared with adjuvant radiotherapy.
In conclusion, while randomized data have shown that adjuvant radiotherapy reduces biochemical recurrence compared with a “watch-and-wait” approach, expert opinion and clinical practice has shown a decreasing use of this treatment strategy. 42 This decision analysis supports the preferred use of a salvage radiotherapy strategy for patients with adverse pathologic findings following radical prostatectomy in order to maximize QALE. These findings, in addition to forthcoming data to come from ongoing randomized trials, will help guide urologists and radiation oncologists in the provision of postoperative radiotherapy.
Footnotes
Financial support for this study was provided in part by a peer-reviewed grant from the Canadian Urological Association Scholarship Foundation (Canadian Urological Association—Pfizer Urology Resident Grant) to CJDW and the Ajmera Family Chair in Urologic Oncology held by RKN. The funding agreement ensured the authors’ independence in designing the study, interpreting the data, writing, and publishing the report.
All authors declare that they have no conflicts of interest or disclosures to declare.
CJDW and RKN had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
