Abstract
Background
Although confirmed disability progression (CDP) is a common outcome in multiple sclerosis (MS) clinical trials, its predictive value for long-term outcomes is uncertain.
Objective
To investigate whether CDP at month 24 predicts subsequent disability accumulation in MS.
Methods
The Comprehensive Longitudinal Investigation of Multiple Sclerosis at Brigham and Women’s Hospital includes participants with relapsing-remitting MS or clinically isolated syndrome with Expanded Disability Status Scale (EDSS) scores ≤5 (N = 1214). CDP was assessed as a predictor of time to EDSS score 6 (EDSS 6) and to secondary progressive MS (SPMS) using a Cox proportional hazards model; adjusted models included additional clinical/participant characteristics. Models were compared using Akaike’s An Information Criterion.
Results
CDP was directionally associated with faster time to EDSS 6 in univariate analysis (HR = 1.61 [95% CI: 0.83, 3.13]). After adjusting for month 24 EDSS, CDP was directionally associated with slower time to EDSS 6 (adjusted HR = 0.65 [0.32, 1.28]). Models including CDP had worse fit statistics than those using EDSS scores without CDP. When models included clinical and magnetic resonance imaging measures, T2 lesion volume improved fit statistics. Results were similar for time to SPMS.
Conclusions
CDP was less predictive of time to subsequent events than other MS clinical features.
Introduction
Disability accumulation in patients with multiple sclerosis (MS) is most commonly measured using the Expanded Disability Status Scale (EDSS). The EDSS is a 0‒10 ordinal scale with half steps that combines 7 functional system scores. 1 Given the ordinal nature of the EDSS, simple analysis of change scores can be challenging because a change in 1 unit reflects a different amount of disability accumulation depending on initial level of the scale, and the time between EDSS transitions varies based on initial EDSS level. 2 In addition to the unequal steps of the scale, disability accumulation can occur for multiple reasons in MS. Disability accumulation can be due to relapses, 3 but disability that continues to increase for a specified period of time may indicate MS progression. Progression is difficult to assess using cross-sectional EDSS measurements because it is challenging to distinguish between the two underlying causes of disability accumulation from a single measurement. Moreover, analysis of the placebo arms of 31 randomized controlled trials showed that the rate of EDSS improvement can be significant, sometimes equivalent to the rate of EDSS worsening, in both relapsing-remitting and secondary progressive MS (SPMS) populations. 4 At the same time, EDSS has been shown to overestimate the accumulation of permanent disability by up to 30%, highlighting its instability and inaccuracy. 5
To overcome this challenge, most clinical trials investigating a treatment effect on disability accumulation have used confirmed disability progression (CDP) on EDSS as the outcome of interest. 6 CDP requires that a participant in a clinical trial experience a specified increase on the EDSS that is maintained for at least 3 or 6 months depending on the study design. The specified increase on the EDSS is an increase of at least 1.5 points for baseline EDSS of 0, an increase on the EDSS of at least 1 point for baseline EDSS between 1 and 5, or an increase of at least 0.5 point for a baseline EDSS at least 5.5. For clinical trials of relapsing MS (RMS), CDP is often a secondary outcome with annualized relapse rate as the primary outcome; however, CDP is usually the primary outcome for clinical trials within a population with progressive MS.
Even though CDP is the most common measure of disability accumulation in MS clinical trials, the value of CDP in terms of predicting long-term disability accumulation is not yet well understood. The goal of this analysis was to classify participants based on the presence or absence of disability accumulation over a 2-year period and assess the predictive information in this outcome relative to other clinical, radiological, and patient-reported outcome (PRO) measures.
Methods
Participants
All participants enrolled in the Comprehensive Longitudinal Investigation of Multiple Sclerosis at Brigham and Women’s Hospital and the Partners MS Center (CLIMB) were eligible for this analysis. 7 CLIMB participants have clinical visits with a complete neurological exam and EDSS ratings every 6 months and brain magnetic resonance imaging (MRI) scans every year. In addition, a subgroup of participants completes PRO instruments every year. The study began following participants in 2000 and has been approved by the Brigham and Women’s Hospital Institutional Review Board with all participants providing written informed consent.
For this analysis, we identified participants enrolled in CLIMB from 29 February 2000 through 24 March 2016 who met the following inclusion criteria: (1) 2 clinical visits 24 months apart, with the second visit occurring between 640 and 820 days after the first visit; (2) at least 1 additional visit between the 2 visits identified in criterion 1 that occurred at least 150 days prior to the second visit; (3) at least 1 visit after the 24-month visit; (4) diagnosis of relapsing-remitting, clinically isolated syndrome (CIS), clinically silent MS, or suspected MS at first clinic visit contributing to this analysis; (5) EDSS ≤5 at first clinic visit; and (6) MRI measurement at first clinic visit. A CONSORT diagram showing the sample selection is provided in Supplementary Figure 1.
Predictors
The predictors assessed in our analyses were clinical, radiological, and PRO variables. Because different subsets of participants had radiological and PRO data available, the sample size contributing to specific analyses varied. Participants that had disability accumulation at the 2 visits following the initial visit were included in the CDP group at the month 24 (CDP24) analysis. If there was an additional CLIMB visit between these two visits, the disability accumulation was required to remain at all time points to be classified as confirmed disability accumulation. Disability accumulation was assessed using the common definition of an increase on the EDSS of at least 1 point for baseline EDSS between 1 and 5 or an increase of at least 1.5 points for baseline EDSS of 0. Participants who did not meet these criteria were classified as not having CDP at month 24 (noCDP24).
For this study, we used MRIs collected on a 1.5 T scanner, which was used at our center until 2014. The scans are collected and processed using the template-driven segmentation (TDS+) pipeline to obtain measures of lesion burden (T2 lesion volume [T2LV]) and brain atrophy (brain parenchymal fraction [BPF]). 8 For this project, the MRI measurements from the pipeline were used without further manual correction.
Finally, a subset of CLIMB participants completed PROs on a yearly basis, including a measure of fatigue and a brief cognitive screening test. The measure of fatigue was the modified fatigue impact scale (MFIS), which is a commonly used measure in MS that includes 21 questions to measure the physical, mental, and psychological components of fatigue. 9 The brief cognitive screening test was the symbol digit modalities test (SDMT), which is a 90-second speed of information processing test. The SDMT has been shown to have good reliability and validity, and it is sensitive to MS-related cognitive dysfunction.10,11
Outcomes
To assess the predictive value of CDP, we analyzed 3 outcome measures. First, we analyzed the time to the first visit with an EDSS of 6 or greater. Participants who reached an EDSS of 6 prior to the month 24 visit (n = 32) could not contribute to this analysis; thus, 1182 participants were included. Second, we analyzed the time to the first visit with a physician-classified SPMS diagnosis. Of the eligible participants, 35 reached SPMS prior to the month 24 visit; thus, 1179 participants contributed to this analysis. Third, we analyzed the time to the next EDSS progression after the month 24 measurement.
Statistical analysis
The summary statistics for the CDP24 and noCDP24 groups at both baseline and month 24 were calculated showing mean and standard deviation for continuous or ordinal variables and proportions for dichotomous variables. For the analyses of the time to events, a set of Cox proportional hazards models were fit with 3 groups of predictors. First, we fit a set of models with only clinical predictors (CDP24, EDSS at month 0, and EDSS at month 24). Second, we fit a set of models with the clinical predictors from model 1 and 2 radiological predictors (T2LV at month 24 and BPF at month 24). Third, we fit a set of models with the clinical predictors from model 1, MFIS at month 24, and SDMT at month 24. For each of the 3 sets of models, we estimated the hazard ratio for each of the predictors with the associated 95% confidence intervals (CIs). Further, we calculate Akaike’s An Information Criteria (AIC) and concordance (which measures the model’s ability to distinguish between low- and high-risk participants, quantified by the C statistics, with C = 50% and C = 100% being random and perfect prediction, respectively) to compare the models based on the same participant subsets to determine the best combination of clinical disability measures for modeling time to further disability accumulation.
Results
Characteristics of participants
Of the 1214 eligible participants, 120 experienced CDP24 and 1094 did not meet the criteria (Table 1). At the baseline visit, those who had disease progression had slightly higher age, but otherwise the groups were similar. In fact, the participants who had subsequent disease progression had slightly lower EDSS at the baseline visit. At month 24, those with disease progression were higher in age and had greater EDSS scores compared with those who did not have disease progression. The participants who progressed also had larger lesion volume and higher MFIS.
Demographic and disease characteristics of participants at first visit.
For each variable, mean, standard deviation (in parenthesis), and sample size are shown.
BPF: brain parenchymal fraction; CDP24: confirmed disease progression at 24 months; EDSS: Expanded Disability Status Scale; MFIS: modified fatigue impact scale; noCDP24: no confirmed disease progression at 24 months; SDMT: symbol digit modalities test; T2LV: T2 lesion volume; TDS: template-driven segmentation.
Time to EDSS 6
The CDP24 group had a faster time to EDSS 6 than the noCDP24 group, as shown in Figure 1. Although CDP24 was directionally associated with a faster time to EDSS 6 in the univariate analysis (hazard ratio [HR]=1.61), CDP24 was associated with a slower time to EDSS 6 after adjusting for month 24 EDSS (HR = 0.65; Table 2). Further, the fit statistics demonstrated that a model including the EDSS scores at months 0 and 24 led to a better fit compared with the models using CDP24, demonstrating a loss of information from using CDP24 as compared with using the EDSS. Further, the Kaplan-Meier curves showing the time to EDSS 6 among participants classified into quartiles based on the predicted Cox proportional hazards regression score showed greater separation compared with the CDP24 vs. noCDP24 curves (Supplemental Figure 2). Similar results were observed when radiological predictors (month 24 BPF and T2LV) or fatigue/cognitive predictors (standardized month 24 MFIS or standardized month 24 SDMT) were included. The HR associated with CDP24 is systematically reduced when month 24 EDSS is also included in the models. EDSS scores at months 0 and 24 were consistently associated with faster time to EDSS 6. Month 24 T2LV and MFIS were associated with faster time to EDSS 6 in all models, while SDMT was associated with longer time to EDSS 6.

Kaplan–Meier curve comparing time to EDSS 6 in participants with and without confirmed disability progression by month 24. CDP24: confirmed disability progression at month 24; EDSS 6: Expanded Disability Status Scale score of 6.
Association between clinical, MRI, and PRO predictors and time to EDSS 6.
AIC: Akaike’s An Information Criterion; BPF: brain parenchymal fraction; CDP24: confirmed disease progression at 24 months; EDSS: Expanded Disability Status Scale; MFIS: modified fatigue impact scale; MRI: magnetic resonance imaging; PRO: patient-reported outcome; SDMT: symbol digit modalities test; T2LV: T2 lesion volume.
Results show HR, the 95% CI (in parenthesis), and
Time to SPMS
The estimated time to SPMS among the CDP24 group and the noCDP24 group is shown in Figure 2, and the regression analyses are presented in Table 3. CDP24 was associated with a much faster time to SPMS in the univariate analysis (HR = 3.40), but the association was attenuated conditional on the month 24 EDSS value (HR = 1.13). As with time to EDSS 6, the fit statistics demonstrated that a model including the months 0 and 24 EDSS scores led to a better fit compared with either model using CDP24, demonstrating again a loss of information from using CDP24. Months 0 and 24 EDSS were consistently associated with faster time to SPMS. Similar results were observed when radiological predictors (month 24 BPF and T2LV) or fatigue/cognitive predictors (month 24 MFIS or SDMT) were included. Similar to the models for time to EDSS 6, month 24 T2LV and MFIS were associated with a faster time to SPMS across all models, while SDMT was associated with longer time to SPMS.

Kaplan–Meier curve comparing the time to physician-defined SPMS in participants with and without confirmed disability progression. CDP24: confirmed disability progression at month 24; SPMS: secondary progressive multiple sclerosis.
Association between clinical, MRI, and PRO predictors and time to SPMS.
AIC: Akaike’s An Information Criterion; BPF: brain parenchymal fraction; CDP24: confirmed disease progression at 24 months; EDSS: Expanded Disability Status Scale; MFIS: modified fatigue impact scale; MRI: magnetic resonance imaging; PRO: patient-reported outcome; SDMT: symbol digit modalities test; T2LV: T2 lesion volume.
Results show HR, the 95% CI (in parenthesis) and
Time to subsequent disability accumulation
The estimated time to subsequent disability accumulation among the CDP24 group and the noCDP24 group is shown in Figure 3, and the regression analyses using a combination of CDP and EDSS values are presented in Table 4. Participants who experienced CDP24 had a longer time to subsequent disability accumulation in univariate analysis (HR = 0.51), but the association was attenuated after accounting for month 24 EDSS (HR = 0.73). Once again, the fit statistics demonstrated that a model including the months 0 and 24 EDSS scores led to a better fit compared with either model using CDP24. Months 0 and 24 EDSS were associated, respectively, with longer and faster time to subsequent disability accumulation. When radiologic predictors or fatigue/cognitive predictors were included, there was a systematic increase in the HR of CDP24 when adjusting for month 24 EDSS. T2LV was associated with time to subsequent disability accumulation across all of the models including the radiological predictors and MFIS was associated with faster time to subsequent disability accumulation.

Kaplan–Meier curve comparing the time to EDSS increase after the month 24 visit in participants with and without confirmed disability progression. CDP24: confirmed disability progression at month 24; EDSS: Expanded Disability Status Scale.
Association between clinical, MRI, and PRO predictors and time to EDSS increase after the month 24 visit.
AIC: Akaike’s An Information Criterion; BPF: brain parenchymal fraction; CDP: confirmed disease progression; EDSS: Expanded Disability Status Scale; MFIS: modified fatigue impact scale; MRI: magnetic resonance imaging; PRO: patient-reported outcome; SDMT: symbol digit modalities test; T2LV: T2 lesion volume.
Results show HR, the 95% CI (in parenthesis) and
Discussion
Our analysis investigated whether CDP at month 24 was predictive of subsequent disability accumulation in participants with MS. Although CDP24 was associated with time to EDSS 6 and time to SPMS in univariate analysis, this association was attenuated after accounting for month 24 EDSS. When assessing time to subsequent disability accumulation, CDP24 was associated with a reduced hazard in univariate analysis, but this association was also attenuated after accounting for month 24 EDSS. For all 3 outcomes, the models using CDP24 had worse model fit compared with the models using the EDSS measurements at months 0 and 24. All of these results were consistent across models that also included radiological measures and fatigue/cognitive measures.
The primary analysis for this study was time to EDSS 6; this is a common clinical endpoint for long-term studies in MS. In the univariate analysis, we observed that participants with CDP24 had a faster time to EDSS 6, which was expected because these participants with CDP24 recently experienced disability progression. Interestingly, after accounting for month 24 EDSS, the association changed direction, demonstrating that CDP24 was protective. This finding is likely driven by the fact that participants at a specific EDSS level in the CDP24 group recently arrived at this disability level, while participants at a specific EDSS level in the noCDP24 group had already achieved this level of disability. For example, the noCDP24 group with a month 24 EDSS score of 3 would likely have had an EDSS of 3 for at least the previous 24 months (since the beginning of the study), if not much longer, while the CDP24 group with a month 24 EDSS score of 3, by definition, had to have reached an EDSS of 3 more recently. If the accumulation of disability requires a specific amount of time and the EDSS represents discrete changes in our measurement of disability, we would expect people in the noCDP24 group to progress faster than those in the CDP24 group conditional on the month 24 EDSS score, as the results herein indicate. In addition, the model including month 0 EDSS and month 24 EDSS had improved model fit compared with either model including CDP24. This result is consistent with previous work by our group showing that using EDSS scores directly improved power to detect treatment effects on disability accumulation. 12
CDP24 was found to have a stronger association with time to SPMS than with time to EDSS 6. In the multivariable model, the association with CDP24 was attenuated and the confidence interval included a wide range of values showing both a positive and a negative association with time to SPMS, but this association remained stronger compared with that for time to EDSS 6. The stronger association may be driven by the uncertain clinical definition of SPMS. In this study, the physician classification of the disease was used to define the visit when a participant transitioned from RMS to SPMS. Several participants were classified as transitioning from RMS to SPMS even though the EDSS remained below 6. This may indicate that physicians who observed CDP24 considered that the participant might be more susceptible to future transition to SPMS, which may partly explain why CDP24 had a stronger association with this outcome.
For time to subsequent disability accumulation, the univariate analysis showed a negative association between CDP24 and subsequent disability. In the multivariable analysis, the association was attenuated, but CDP24 remained negatively associated. These results are consistent with the results of the time to EDSS 6 analysis controlling for EDSS at month 24 because participants who have a disability transition may be less likely to have a second disability accumulation in the short term. The decreased hazard of subsequent EDSS accumulation for increasing EDSS is consistent with our recent study showing that the time between EDSS levels is larger at higher points on the scale. 13
When radiological measures, fatigue, and cognitive functioning were added to the regression models, the main conclusions regarding CDP24 remained valid. In addition, T2LV was shown to be consistently associated with time to disability accumulation. T2LV has been shown to be a marker of disability accumulation in multiple systematic reviews of clinical trials.14,15 In a longitudinal, retrospective study, T2LV at year 1 was predictive of EDSS at year 10. In addition, annualized T2LV change was predictive of Multiple Sclerosis Severity Scale score at year 10. 16 Fatigue is the most common symptom in patients with MS, affecting up to 90% at some point during the course of the disease.9,17–19 A study from the New York State MS Consortium registry found that patients with moderate-to-severe fatigue were significantly more likely to experience worsening physical and psychosocial limitations. 20 Across all of the models, an increased fatigue score was associated with an increased hazard of disability accumulation, demonstrating that increased fatigue may be indicative of a poor disease prognosis even after accounting for present disability level. The association between SDMT score and disability accumulation was not as consistent, but the direction of the association showed that higher SDMT scores, which indicate better cognitive performance, were associated with a lower hazard of disability accumulation. These results are consistent with existing research on SDMT. A 10-year retrospective longitudinal study reported cognitive impairment, measured by SDMT, as a predictor of disability progression and SPMS conversion in newly diagnosed patients with RMS. Patients with cognitive impairment at MS diagnosis were 3 times more likely to reach EDSS 4 and twice as likely to convert to SPMS compared with cognitively preserved patients. 21
Although CDP24 identifies patients who have experienced disability accumulation, our results may show that MS in patients who experience CDP24 may not be progressive, given the limited predictive information CDP24 provides in the presence of EDSS. Recent work has also shown the potential challenges in measuring disability accumulation and improvement on the EDSS. 22 This analysis showed that outcomes using the Timed 25-Foot Walk or Nine-Hole Peg Test might lead to better identification of progression in SPMS patients.
Our study has several limitations that warrant further discussion. First, the CLIMB study includes a sample of participants with MS from a single tertiary care MS center, which may not be representative of a larger population of patients with MS. Further, the CLIMB participants had a lower rate of CDP24 than shown in clinical trials, which is consistent with the milder disease course seen in previous CLIMB studies. Therefore, our conclusions may not generalize to patients with more severe disease. Second, only a subset of participants had radiological or fatigue/cognitive information, so we had less power to detect the impact of predictors in these groups. Third, participants could be seen by different providers over the course of the study; thus, changes in the EDSS could have been due to differences in provider assessments rather than change in disability. Fourth, this study included a large number of analyses so the
Overall, we show that CDP24 progression provides limited predictive power regarding subsequent disability accumulation in participants with MS based on 3 different outcome measures. Alternative measures of disability provide more information regarding subsequent disease course.
Conflict of interests
The author(s) declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article:
Brian Healy, PhD, has received grant support from Analysis Group, Celgene (Bristol Myers Squibb), Verily, Novartis, Merck Serono, and Genzyme and is employed by Brigham and Women’s Hospital.
Bonnie I. Glanz, PhD, has received research support from Merck Serono and Verily and is employed by Brigham and Women’s Hospital.
Elyse Swallow, MPP, James Signorovitch, PhD, and Kaitlin Hagan, PhD, are employed by Analysis Group.
Diego Silva, MD, and Corey Pelletier, PhD, are employed by Bristol Myers Squibb.
Tanuja Chitnis, MD, has provided advisory board/consulting services to Biogen Idec, Merck Serono, Novartis, Sanofi, Bayer, Celgene (Bristol Myers Squibb), and Alexion; has received research support from Verily, Merck Serono, and Novartis; and is employed by Brigham and Women’s Hospital.
Howard Weiner, MD, has received grant support from the National Institutes of Health, the National Multiple Sclerosis Society, Verily, Google Life Sciences, EMD Serono, Biogen, Teva, and Novartis; has received grant support and provided consulting services to Sanofi and Genentech; has provided personal, consulting, and/or advising services to Tilos, Tiziana, IM Therapeutics, vTv Therapeutics, and MedDay and is employed at Brigham and Women’s Hospital.
Data sharing statement
Data requests may be submitted to Celgene, a Bristol Myers Squibb company, at https://vivli.org/ourmember/celgene/ .
Supplemental Material
sj-pdf-1-mso-10.1177_2055217321999070 - Supplemental material for Confirmed disability progression provides limited predictive information regarding future disease progression in multiple sclerosis
Supplemental material, sj-pdf-1-mso-10.1177_2055217321999070 for Confirmed disability progression provides limited predictive information regarding future disease progression in multiple sclerosis by Brian C Healy, Bonnie I Glanz Brigham and Women’s Hospital, Boston, MA, USA Elyse Swallow, James Signorovitch, Kaitlin Hagan Analysis Group, Boston, MA, USADiego Silva, CoreyPelletier Bristol Myers Squibb, Princeton, NJ, USA Tanuja Chitnis and HowardWeiner Brigham and Women’s Hospital, Boston, MA, USA in Multiple Sclerosis Journal – Experimental, Translational and Clinical
Footnotes
Acknowledgements
The authors received medical writing support from Analysis Group, Boston, MA, and editorial support from Analysis Group and from Peloton Advantage, LLC , an OPEN Health company, Parsippany, NJ, sponsored by Bristol Myers Squibb, Princeton, NJ. The authors, however, directed and are fully responsible for all content and editorial decisions for this manuscript.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by Bristol Myers Squibb, Princeton, NJ, USA.
Supplemental Material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
