Abstract
Several patient-reported outcome measures have been developed to assess health status in pulmonary arterial hypertension. The required change in instrument scores needed, to be seen as meaningful to the individual, however remain unknown. We sought to identify minimal clinically important differences in the Cambridge Pulmonary Hypertension Outcome Review (CAMPHOR) and to validate these against objective markers of functional capacity. Minimal clinically important differences were established from a discovery cohort (
Introduction
Pulmonary arterial hypertension (PAH) is a rare disorder characterised by a progressive rise in mean pulmonary artery pressure and pulmonary vascular resistance, ultimately resulting in right heart failure and death. 1 PAH may present with a range of non-specific, yet debilitating symptoms which can affect health-related quality of life (HRQoL).1–3 As there is presently no cure for PAH, pharmacotherapy remains the mainstay of treatment with the aim of slowing disease progression and alleviating symptoms. 1 Despite recent treatment advancements improving PAH survival, symptomatic burden remains high.4–8
Conventionally, establishing drug efficacy in PAH clinical trials has relied upon observed changes in functional status and capacity. 4 It has not until relatively recently that composite morbidity and mortality end-points have been employed in event-driven trials, as highlighted by Sitbon et al. 9 Whether selected trial end-points are relevant to the individual, however, remains unknown. As a result, there is an increasing awareness of the need for patient-reported outcomes (PROs) to be incorporated as secondary end-points in PAH clinical trials. 10
Despite this, PROs continue to remain under-utilised. This, in part, is because changes in HRQoL measures have been more modest than objective end-points such as six-minute walk distance11,12 or pulmonary haemodynamics. 4 Generic measures of HRQoL (e.g. SF-36) conventionally used in such trials, however, may lack sensitivity to detect change in specific disease processes such as PAH. 13 To address this, a number of pulmonary hypertension-specific HRQoL instruments have been developed and validated: Cambridge Pulmonary Hypertension Outcome Review (CAMPHOR), 14 EmPHasis-10, 2 Living with Pulmonary Hypertension 15 and Pulmonary Arterial Hypertension-Symptoms and Impact (PAH-SYMPACT). 16 Such disease-specific PROs have been shown to track functional status, clinical deterioration and prognosis in PAH.12,17 The magnitude of improvement in these measures needed to be seen as meaningful by the individual, or the Minimal Clinically Important Difference (MCID), however, are unknown. This is of importance as even in the absence of statistically significant changes in PRO end-points, interventions may still be of relevance to the patient. Furthermore, knowledge of a measure’s MCID provides useful information regarding longitudinal changes in PROs and the monitoring of individual patient’s clinical progression.
Although the MCID has become a standard approach in the interpretation of the clinical relevance of changes in PROs, there remains no ‘gold-standard’ for MCID estimation and methodological approaches remain much debated. 18 Broadly, MCIDs may be estimated using distributional- or anchor-based approaches. 19 Distributional methods rely on the statistical characteristics of scores around the mean (e.g. standard deviation (SD)) whilst anchor-based methods link changes in PRO scores to a second external measure of change, or the anchor, and are therefore presumed to be sample independent. Global assessments of health change are most frequently employed as anchors in MCID estimations and enable the direct association of PRO score change to a patient’s preferences and values. 20 They are, however, subject to recall bias. 21 Given limitations in both distributional and anchor-based MCID methods, conventionally both methods are employed with MCIDs typically reported as the mean of combined estimates. 22
We provide the first estimation of a MCID in a pulmonary hypertension-specific PRO measure (CAMPHOR) using both distributional- and anchor-based methods. Furthermore, we demonstrate validation of these estimates using objective markers of PAH severity.
Methods
All incident and prevalent cases of idiopathic pulmonary arterial hypertension (IPAH) between January 2006 and June 2018 were eligible for inclusion. Follow-up was included until 1 June 2019. All patients were age >18 years at the time of diagnostic right heart catheterisation. IPAH diagnosis and treatment was as per international guideline recommendations at the time of diagnosis.1,23,24 Clinical data were collected prospectively into a dedicated pulmonary vascular diseases database.
The discovery cohort was comprised of all incident cases of IPAH with CAMPHOR scores available at treatment-naïve baseline and within 4–12 months following the initiation of PAH-specific therapy. A minimum follow-up of four months was chosen as this reflects the upper limit of the 12–16 week end-point historically employed for outcome assessment in PAH clinical trials. 9 A maximum follow-up interval of 12 months was chosen as beyond this, it is increasingly difficult to attribute changes directly related to the initiation of drug therapy.
The validation dataset was formed of incident and prevalent cases of IPAH not included in the discovery cohort with at least two serial CAMPHOR scores recorded at any time point until end of follow-up. In the main, individuals in the validation cohort were prevalent cases diagnosed before the routine clinical use of CAMPHOR in 2006. Baseline pre-treatment PRO scores were therefore unavailable for this group. A minimum time period of six weeks between CAMPHOR scores was set to limit the testing effect of repeated measures completed within a short time-frame. No maximum time limit between CAMPHOR completion dates was set for the validation cohort. Prevalent cases underwent clinical review every six months as standard with CAMPHOR questionnaires completed at each visit. New York Heart Association (NYHA) functional class, six-minute walk distance (6MWD) and N-Terminal pro-Brain Natriuretic Peptide (NT-proBNP) levels concurrent to CAMPHOR completion were recorded where available.
CAMPHOR questionnaire
The CAMPHOR questionnaire contains 65 items measuring; Symptoms (25 questions), Activity (15 questions) and quality of life (25 questions). Symptoms and quality of life are both scored out of 25, and activity out of 30. Scores are negatively weighted so that a higher score reflects worse quality of life and greater functional limitation. 14
At the beginning of the CAMPHOR questionnaire, patients are also prompted to provide responses to two global ratings of health status. One question assesses current health status with available responses of poor/fair/good/excellent, and the other, change in health status relative to last clinical review with available responses ranging from ‘significantly worse’ to ‘significantly better’ on a seven-point scale.
Statistical analysis
Statistical analysis was performed using R version 3.6.1.
25
Data averages for continuous variables were reported as mean (SD) and categorical variables as n (percentage of total). As CAMPHOR scores are ordinal, values were rounded to the nearest whole number. Paired t-tests were used to compare CAMPHOR scores at baseline and post-treatment. Reported
MCID estimation
In the absence of gold-standard methodology, MCID estimates were based upon prevailing methodological approaches reported in systematic review 22 and expert opinion.18–21
Distributional-based MCID estimation
MCIDs were estimated using three distributional-based approaches:
where
δ1 = group standard deviation at baseline
MCIDs expressed as ES reduce bias which mainly result from dependency on baseline scores. 22 As the MCID of a scale is generally considered to correspond to a small ES (0.2), the above formula was re-arranged so that the ES MCID was attained by multiplying the SD of baseline scores by 0.2.29,30
rxx = the reliability of the HRQoL measure
Test–retest reliability coefficients for each of the three CAMPHOR subscales have been established and validated: symptoms, 0.92; activities, 0.86 and quality of life (QoL), 0.92. 14 A number of thresholds have been suggested (1-, 1.96- and 2-SEM) when employing the SEM in MCID estimation.31–33 As the most widely validated is 1-SEM, this was used for the purposes of this study. 31
Anchor-based MCID estimation
Anchor-based MCID estimations were attained using within-person and sensitivity-based approaches using methods similar to Van Der Roer et al.: 34
Results
There were 184 consecutive incident cases of IPAH during the study period, of whom 129 patients had available pre- and post-PAH treatment CAMPHOR scores and formed the discovery cohort. The characteristics of incident IPAH patients included and excluded from the discovery cohort did not differ (online Appendix Table 1).
Patient demographics and characteristics at treatment-naïve baseline and following PAH treatment (
Notes: Values are expressed as mean (standard deviation) unless otherwise specified.
PAH: pulmonary arterial hypertension; RAP: right atrial pressure; PAP: pulmonary arterial pressure; PVR: pulmonary vascular resistance; CO: cardiac output; NYHA: New York Heart Association functional class; CAMPHOR: Cambridge Pulmonary Hypertension Outcome Review questionnaire; 6MWD: six-minute walk distance; NT-proBNP: N-Terminal pro-Brain Natriuretic Peptide.
aPositive response to vasoreactivity challenge with nitric oxide as defined by current international guideline. 1
bValues expressed as median (interquartile range).
Discovery cohort patient demographics and characteristics at treatment-naive baseline and post PAH treatment are outlined in Table 1. Mean (SD) age was 54.4 (16.4) years and 64% were female. Three individuals were vasoresponders to nitric oxide. The majority of patients (63%) were treated following PAH diagnosis with oral monotherapy (sequential therapy). Twenty-four patients (22%) were treated with upfront parenteral prostanoid therapy. In the five years following IPAH diagnosis, 32 patients in the discovery cohort died and one underwent lung transplantation.
CAMPHOR scores at treatment-naïve baseline were mean (SD): Symptoms, 12 (7); Activity, 12 (7) and QoL, 10 (7). Baseline CAMPHOR scores were poorly correlated with pre-PAH treatment haemodynamics (Symptoms,

Correlation matrix for baseline CAMPHOR scores against haemodynamic, age and functional status.
Cox proportional hazard model of survival from date of IPAH diagnosis.
Notes: The association between baseline variables (treatment-naïve) and long-term survival was assessed. IPAH diagnosis date taken from time of diagnostic right heart catheterisation.
CAMPHOR: Cambridge Pulmonary Hypertension Outcome Review; QoL: quality of life; 6MWD: six-minute walk distance; mPAP: mean pulmonary artery pressure; PVR: pulmonary vascular resistance; CI: confidence interval; HR: hazard ratio.
PAH therapy was associated with a significant improvement in CAMPHOR subdomain scores: Symptoms:
Global ratings of health
Patient-reported global health status at baseline (
A total of 117 individuals provided global ratings of health change following PAH treatment. The seven potential responses of ‘very much worse’ to ‘very much better’ were discriminated by CAMPHOR subscale scores (
Change in CAMPHOR score for global ratings of health status change with PAH treatment (
Notes: Values expressed as mean (standard deviation). Global health and CAMPHOR score change at 4–12 month post PAH treatment review relative to treatment-naive baseline.
Anchor and distributional MCID estimates
Distributional MCIDs were calculated using 0.5SD, the ES and SEM as described above. For the Symptoms domain, distributional MCIDs were 4-points, 1-point and 2-points, respectively; for the Activity domain: 4-points, 1-point and 3-points, respectively and for QoL: 4-points, 2-points and 2-points (Table 4).
CAMPHOR subscale MCID estimates for clinical improvement by distributional and anchor-based methods.
SD: standard deviation; SEM: standard error of measurement; AUROC: Area under the Receiver Operating Curve; CI: confidence interval; QoL: quality of life.
Anchor-based MCIDs generated from the mean change in CAMPHOR score for those who reported feeling ‘moderately better’ post PAH treatment were: Symptoms, –5 points; Activity, –4 points and QoL, –4 points and from ROC thresholds: Symptoms, –6 points (Area Under Receiver Operating Cure (AUROC) 0.79; 95% Confidence Interval (CI): 0.70–0.88), Activity, –6 points (AUROC 0.73; 95% CI: 0.63–0.84) and QoL, –1 points (AUROC 0.80; 95% CI: 0.72–0.88).
Final MCID estimates derived by taking the mean of distributional- and anchor-based results were: Symptoms, 4 points; Activity, 4 points and QoL, 3 points. MCIDs in CAMPHOR subscale scores between treatment-naïve baseline and post-PAH treatment were achieved by 41 patients (32%) for Symptoms, 39 patients (30%) for Activity and 47 patients (36%). Seventeen patients (13%) achieved the MCID across all three scales.
MCID validation
MCIDs were first compared against objective markers of PAH severity in the discovery cohort. The CAMPHOR Activity domain had the strongest correlation with 6MWD (Pearson r = 0.70,
MCID estimates were further verified in a validation dataset comprised of 1008 CAMPHOR observations with contemporaneous 6MWD measurements across 87 incident and prevalent cases of IPAH. Mean interval between observations was 188 days. The Activity scale again had the highest correlation with 6MWD:
Discussion
The symptomatic burden of PAH and its effects on HRQoL are widely known.4–8,35 Changes in HRQoL in response to PAH treatment in the ‘real world’ setting, however, remains poorly understood. This is the first systematic study to directly assess the impact of PAH therapy on HRQoL outside of the clinical trial setting using a PH-specific PRO measure; CAMPHOR. We demonstrate significant improvements in each of the three CAMPHOR subdomains with PAH therapy, alongside improvements in objective measures of PAH treatment response: functional class, exercise capacity and NTproBNP level. Using distributional and anchor-based methods, we propose minimum thresholds of CAMPHOR score change deemed clinically relevant to individuals with PAH, or the MCID. Attainment of the Activity scale MCID (four-point change) was associated with a significantly higher increase in exercise capacity in both incident and prevalent population compared to those who failed to achieve the required change.
As with previous studies utilising CAMPHOR, we demonstrate moderate correlations between CAMPHOR subdomains and exercise capacity;
14
the Activity subscale having the strongest relationship with six-minute walk distance (
Whilst anecdotally, there is the perception that PAH therapies improve patient’s HRQoL, there is limited ‘real word’ data to support subjective physician experience. Although PROs have been incorporated as secondary end-points in PAH clinical trials, these have relied upon generic HRQoL measures which may be less sensitive to change in specific disease process such as PAH. This may at least partly explain why only modest changes in PRO end-points have been observed to-date.
13
In this study, we demonstrate the significant improvement in CAMPHOR scores following initiation of PAH therapy (Symptoms:
Survival from PAH diagnosis was associated with lower baseline CAMPHOR Activity score, younger age at diagnosis, female sex and greater exercise capacity. Whilst our limited sample size precluded a robust evaluation of the additional contribution of PROs to prognostication using proposed risk stratification tools, the significance of baseline CAMPHOR scores in predicting long-term survival highlights the insights that can be gained simply from patient perceptions alone.
In chronic diseases such as PAH where there is no ‘cure’, understanding clinically important change to patients becomes more relevant. To our knowledge, this is the first study to quantify a MCID in IPAH for a disease-specific PRO measure. Standardised methodology for MCID estimation has yet to be determined. Both distributional and anchor-based approaches have their limitations which have been extensively discussed elsewhere.18,21 Methodology in this study was based on prevailing consensus opinion. As global ratings of health change are the most commonly used measure when attempting to identify within patient change, this approach was adopted for anchor-based estimations.18,21,22
Across five methods (three distributional and two anchor-based), MCIDs for improvement in CAMPHOR were; Symptoms: –4 points, Activity: –4 points and QoL, –3 points. A third of incident patients achieved an MCID in at least one of the three CAMPHOR subdomains with PAH therapy. Change in CAMPHOR Activity scale score that was equivalent, or greater than, the MCID was associated with a significantly greater increase in six-minute walk distance from diagnostic baseline compared to those who did not attain the MCID threshold (82.3 m vs. 38.8 m;
The longitudinal relevance of CAMPHOR MCID estimates was demonstrated in an extended validation cohort comprised of 1008 instances of CAMPHOR score completion in 87 incident and prevalent cases of IPAH. Once again, a change in CAMPHOR Activity score at least equivalent to the MCID of –4 points between serial CAMPHOR measures was associated with greater gains in six-minute walk distance compared to individuals who did not report a MCID threshold change (31.4 (64) m versus –4.6 (35) m). This distance of 31 m associated with CAMPHOR Activity MCID attainment compares favourably to direct estimates of the MCID in 6MWD for PAH of 33 m, and reinforces the utility of these values in determining relevant change at the level of the individual. 37 The validation of MCID estimates in both incident and prevalent populations enables not only a better understanding of the effects of intervention at the cohort level (e.g. when submitted to clinical trials) but provides useful insights when monitoring individual patient’s progress.
Whilst this study has a number of strengths, we acknowledge that although patient characteristics were similar to those of well-published PAH cohorts, data from this study originate from a single pulmonary hypertension centre and may therefore be subject to bias. CAMPHOR has also received criticism for being more time intensive than other available pulmonary hypertension QOL measures, however remains the most validated with adaption for use in, but not limited to, the: United States, 39 Australia/New Zealand, 40 Portugal, 41 Germany, 42 Netherlands, 43 Poland, 44 Brazil, 45 Croatia, 46 French/English Canada 47 and Columbia. 48 This provides plentiful opportunity for the external validation of MCID estimates to assess their robustness which is unafforded by other measures at present. Moreover, CAMPHOR is the only clinically utilised measure inclusive of a global assessment of health. As global assessments of health change enable the direct association of PRO score change to a patient’s preferences and values, the inclusion of anchor-based methodology in any MCID estimation is generally considered mandatory. 22
One further limitation to our study is the absence of a gold standard methodology for MCID estimation. We have however aligned our methodological approach to prevailing consensus opinion and indeed have derived estimates using approaches in excess of those seen in the majority of other published MCID works, refining the accuracy of our estimates to the best available. 22 Further work is required to determine universally accepted methods for MCID estimation which may be of relevance to our work in the future.
In conclusion, we have established MCIDs for patient-relevant clinical improvement in CAMPHOR subscale scores and demonstrate the correlation of the CAMPHOR Activity subscale to functional capacity. MCIDs in a pulmonary hypertension-specific PRO measure provides useful insights when monitoring individual patient’s progress and allows for a better understanding of the effects of intervention at the cohort level (e.g. when submitted to clinical trials).
Supplemental Material
sj-pdf-1-pul-10.1177_2045894021995055 - Supplemental material for A minimal clinically important difference measured by the Cambridge Pulmonary Hypertension Outcome Review for patients with idiopathic pulmonary arterial hypertension
Supplemental material, sj-pdf-1-pul-10.1177_2045894021995055 for A minimal clinically important difference measured by the Cambridge Pulmonary Hypertension Outcome Review for patients with idiopathic pulmonary arterial hypertension by Katherine Bunclark, Natalie Doughty, Alice Michael, Nisha Abraham, Samantha Ali, John E Cannon, Karen Sheares, Nicola Speed, Dolores Taboada, Mark Toshner and Joanna Pepke-Zaba in Pulmonary Circulation
Supplemental Material
sj-pdf-2-pul-10.1177_2045894021995055 - Supplemental material for A minimal clinically important difference measured by the Cambridge Pulmonary Hypertension Outcome Review for patients with idiopathic pulmonary arterial hypertension
Supplemental material, sj-pdf-2-pul-10.1177_2045894021995055 for A minimal clinically important difference measured by the Cambridge Pulmonary Hypertension Outcome Review for patients with idiopathic pulmonary arterial hypertension by Katherine Bunclark, Natalie Doughty, Alice Michael, Nisha Abraham, Samantha Ali, John E Cannon, Karen Sheares, Nicola Speed, Dolores Taboada, Mark Toshner and Joanna Pepke-Zaba in Pulmonary Circulation
Footnotes
Contributorship
K.B. had full access to all of the data in the study and takes responsibility for the integrity of the data and accuracy of the data analysis. A.M., N.A., S.A., N.D., J.C., K.S., N.S., D.T., M.T. and J.P-Z. contributed substantially to the study design, data analysis and interpretation and review/revisions of the manuscript. J.P-Z. provided overall supervisory support and approved the final version of the manuscript.
Ethical approval
This project was deemed to be Research without Requiring Ethics by Royal Papworth Hospital Research and Development department (Reference No: P02368).
Guarantor
Katherine Bunclark.
Conflict of interest
J.C., A.M. and N.D. have no conflicts of interest to declare. K.B. has received travel grants from Merck Sharp & Dohmen (MSD). N.A. has served on advisory boards for MSD. S.A. has served on advisory boards and received educational funding from Actelion. K.S. has received educational funding from Actelion, Bayer, GlaxoSmithKline (GSK) and MSD and consultancy/lecture fees from Actelion. N.S. has received educational grants from Actelion and GSK. D.T. has received speaker fees and educational funding from Actelion, Bayer, GSK, Lilley, MSD and Pzier. J.P-Z. has served on advisory boards of, and received personal fees, institutional grant/research support from Actelion, Bayer, MSD and GSK. M.T. has received personal fees from Actelion, GSK and Bayer, institutional grant/research support from Actelion, Roche and Bayer and is a member of the Scientific Advisory Board of Morphogen-IX.
Funding
This study was supported by funding from the National Institute of Health Research.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
