Abstract
Background:
Several reports suggest that cognitive reserve (CR) may protect against cognitive impairment in MS. Fatigue and depression are common in MS. Yet, their influence on engagement with activities that build CR is unclear.
Objectives:
This study aimed to achieve a better understanding of CR-building in MS, by examining how CR differs in people with MS (pwMS) compared with neurologically healthy individuals and by investigating how common MS symptoms interact with CR-building.
Methods:
In total, 206 pwMS and 150 age- and gender-matched controls participated in this cross-sectional study. Participants completed self-report measures of CR accumulated in early life and across the lifespan (including education, occupation, cognitively enriching leisure activities), and of cognitive functioning, fatigue, depression, anxiety and MS-impact on everyday life.
Results:
PwMS’ recent engagement in cognitively enriching leisure activities was negatively associated with self-reported cognitive difficulties (rho = −0.31, p < 0.001). However, after controlling for fatigue and depression, this association was no longer present. Correspondingly, we observed that higher levels of depression were associated with lower engagement in cognitively enriching leisure activities (B = −0.41 (95% confidence interval (CI): −0.61 to −0.22), p < 0.001).
Conclusion:
Our results highlight the importance of addressing depression and fatigue in the context of lifestyle recommendations.
Introduction
Cognitive reserve (CR) refers to an individual’s ability to adapt cognitive processes in response to brain atrophy. 1 This concept of CR was originally developed in the cognitive ageing literature. 2 CR has been studied across various populations and conditions, including MS. Meta-analyses suggest that CR may help to explain individual differences in cognitive outcomes in MS, showing that higher levels of CR can protect against cognitive impairment, at least in some domains.3,4
An individual’s level of CR is typically estimated through proxy measures, including premorbid intellectual abilities, educational level, occupational attainment and engagement in cognitively enriching leisure activities. 2 Traditional CR measures were originally developed for an older adult population, who potentially could have experienced a lifetime of enriching activities.
In contrast, MS is typically diagnosed between the ages of 20 and 40 years, thereby affording a different timeline for building CR. 5 People with MS (pwMS) often experience a range of symptoms including fatigue, depression, anxiety, which impact their day-to-day functioning.6–8 For example, increased fatigue may be associated with lower levels of physical activity. 9 In contrast, greater perceived self-efficacy in the management of MS symptoms can be associated with greater engagement in social and intellectual activities. 10 As such, living with MS may impact engagement with enriching environments (CR-building) as measured through traditional CR measures.
A recent systematic review revealed that approximately half of the research on CR in MS investigated the protective outcomes of engagement in enriching activities prior to the MS-diagnosis (e.g. pre-MS education or leisure activities). 11 Of the studies examining lifespan enrichment (including post-diagnosis occupation or leisure activities), only 53% accounted for the potential impact of common MS symptoms in their analyses. A minority of studies conducted analyses with and without accounting for MS symptoms. These studies highlighted that by not accounting for MS symptoms, findings about the protective nature of CR may be distorted. 12
The present study aimed to achieve a nuanced understanding of CR-building in MS. Our main research questions addressed whether pwMS and an age- and gender-matched control group differ in CR-building, and whether the experience of common MS symptoms is associated with CR-building in pwMS. We hypothesised that pwMS and controls would not differ in early life (i.e. pre-MS) CR-building, but that pwMS would have lower levels of CR as assessed through post-diagnosis CR measures. We hypothesised that MS-impact on everyday life, fatigue, depression and anxiety would be associated with post-diagnosis CR-building in pwMS.
Materials and methods
Study design and participants
This cross-sectional study was preregistered (https://doi.org/10.17605/OSF.IO/J53CQ). Data were collected via an online survey hosted on Qualtrics (https://www.qualtrics.com). Data collection occurred between November 2023 and April 2024.
Participants were recruited through two streams: (1) social media, with the support of a national MS society, and (2) Prolific (https://www.prolific.com). Participation via the first stream was unpaid. Participation via the research platform Prolific was paid (£8.35/hour) as per platform standards.
PwMS and a control group of people without MS were recruited. MS diagnoses were based on self-report. Participants had to be aged 18–60 years and speak English. Participants were excluded if they reported a neurological condition likely to impact responses (e.g. stroke). Participants with neurodevelopmental conditions (e.g. attention-deficit/hyperactivity disorder (ADHD), dyslexia) were included, and this was considered in the analysis. PwMS with epilepsy were included as this could be secondary to MS, but controls with epilepsy were excluded.
The Human Research Ethics Committee at University College Dublin granted approval on 22 November 2023 (HS-23-59-Stein-Bramham). All participants gave informed consent prior to participation. A person with MS piloted our survey to ensure its acceptability.
Measures
Demographic data were collected (age, ethnicity, gender, work status, neurodevelopmental/neurological condition, MS duration, subtype, disease-modifying treatment (DMT), last relapse, history of depression, anxiety, fatigue). All measures were completed by pwMS and controls, except for the MS Impact Scale (MSIS-29), which only pwMS completed.
CR measures
The Cognitive Leisure Scale (CLS) was developed for pwMS and contains seven items (e.g. reading magazines or newspapers) measuring engagement in cognitively enriching leisure activities during an individual’s early 20s (CLS 20s). 13 Participants indicated their engagement on a 5-point Likert-type scale ranging from 1 (once/less per year) to 5 (daily) (total raw scores: 7–35). Participants also completed the CLS with reference to the last year (CLS Recent) to measure recent activity.
The Cognitive Reserve Index questionnaire (CRIq) was developed for an older adult population and assesses engagement in enriching activities across the lifespan, including years of education, work and leisure. 14 Work activity is quantified as years spent across five levels of employment from low skilled manual to highly responsible or intellectual occupation. Leisure items assess how frequently (never/rarely vs often/always) and for how many years participants engage in weekly (e.g. domestic chores), monthly (e.g. voluntary work), annual (e.g. attending exhibitions, concerts, conferences) and fixed frequency (e.g. pet care) activities. The template used to compute standardised and age-adjusted component (CRI-Education, CRI-Work, CRI-Leisure) and total CRI scores is freely accessible (https://www.cognitivereserveindex.org). CRI scores can be categorised as low (<70), medium-low (70–84), medium (85–114), medium-high (115–130) and high (>130). Supplementary Materials 1 contains further information on CRIq administration and scoring.
Self-report measures
The MS Impact Scale (MSIS-29) includes 20 items on the physical and 9 items on the psychological impact of MS over the past 2 weeks. 15 PwMS rated each item on a 5-point Likert-type scale (total raw scores: 29–145). The MSIS-29 has high internal consistency and test-re-test reliability. 15
The Modified Fatigue Impact Scale (MFIS) consists of 21 items, constituting three subscales on physical, cognitive and psychosocial fatigue over the last 4 weeks. 16 Participants indicated on a 5-point Likert-type scale how impacted they were by each item (total raw scores: 0–84).
The Hospital Anxiety and Depression Scale (HADS) contains two subscales screening for anxiety (HADS-A) and depression (HADS-D) symptoms experienced during the last week. 17 Each subscale contains 7 items, rated on a 4-point Likert-type scale. Raw scores range from 0 to 21 and are categorised as subclinical (0–7), mild (8–10), moderate (11–14) and severe (15–21). 18 The cut-off of >7 has high sensitivity (depression: 90%; anxiety: 88.5%) and specificity (depression: 87.3%; anxiety: 80.7%) in pwMS. 19 The HADS has acceptable internal consistency. 18
The MS Neuropsychological Questionnaire (MSNQ) is a self-report measure of cognitive difficulty, assessing how each of 15 items impacted on daily functioning over the last 3 months on a 5-point Likert-type scale. 20 Raw scores range from 0 to 60, with a cut-off of >27 having high sensitivity (83%) and specificity (97%) for detecting cognitive difficulty. 20 The MSNQ has high internal consistency and test–retest correlations. 21
Statistical analysis
Statistical analyses were conducted in R (4.4.1) using RStudio and JASP (0.19). Missing data were imputed with the median of the five nearest neighbours, identified using an extended version of Gower distance (Supplementary Materials 2 contains frequency of missing data). 22 Missing data for pwMS and controls were imputed separately. Results are based on imputed data (Supplementary Materials 2 contains examples based on complete cases).
If test assumptions were not met, non-parametric alternatives were used.
Mann–Whitney U and chi-square tests examined if groups (pwMS vs controls) were age- and gender-matched. A robust 2 × 2 analysis of variance (ANOVA) (group × recruitment stream) tested if there was a main effect of recruitment stream.
Spearman’s rank correlations investigated the relationship between recent CR-building and neuropsychological outcomes in pwMS. Mann–Whitney U tests examined between-group differences in CR-building. Paired Wilcoxon tests examined within-group differences in early 20s (CLS 20s) versus last year (CLS Recent) engagement in cognitively enriching leisure activities.
Regression analyses (controlling for age, MS duration, time since last relapse, presence of a neurodevelopmental condition) investigated the relationship between MS symptoms and post-diagnosis/lifespan CR-building. Four multiple regression models were specified:
CLS Recent = b0 + b1age + b2MS duration + b3time since last relapse + b4presence of a neurodevelopmental condition + b5MSIS-29 + b6MFIS total + b7HADS-Anxiety + b8HADS-Depression + b9MSNQ + ε
CLS Discrepancy = b0 + b1age + b2MS duration + b3time since last relapse + b4presence of a neurodevelopmental condition + b5MSIS-29 + b6MFIS total + b7HADS-Anxiety + b8HADS-Depression + b9MSNQ + ε
CRI-Work = b0 + b1age + b2MS duration + b3time since last relapse + b4presence of a neurodevelopmental condition + b5MSIS-29 + b6MFIS total + b7HADS-Anxiety + b8HADS-Depression + b9MSNQ + ε
CRI-Leisure = b0 + b1age + b2MS duration + b3time since last relapse + b4presence of a neurodevelopmental condition + b5MSIS-29 + b6MFIS total + b7HADS-Anxiety + b8HADS-Depression + b9MSNQ + ε
CLS Discrepancy scores were calculated by subtracting CLS Recent scores from CLS 20s scores. Regression diagnostics and sensitivity analyses were conducted. Values were considered potential (1) regression outliers if their studentised residuals > |2|, (2) high leverage cases if their hat values > 2*Meanhat and (3) high influence cases if Cook’s distance Di > 4 ÷ (n − k − 1). Data were excluded if removing potential high influence cases improved model fit.
The significance level for all analyses is alpha 0.001 (<0.01 interpreted as a trend). This alpha level was set to guard against type 1 error in the context of multiple comparisons and correlations. Exact p-values were reported throughout to allow readers to interpret significance individually.
Results were presented to a Public and Patient Involvement (PPI) panel of pwMS (n = 20) and their insights contributed to the interpretation of results and implications in the discussion section.
Results
Participants included 206 pwMS and 150 age- and gender-matched controls (Supplementary Materials 3 contains participant flow chart). PwMS had a mean age of 40.9 years (standard deviation (SD) = 9.9), disease duration of 8.7 years (SD = 7.2) and last reported relapse 2.8 years ago (SD = 3.4). Most (80.1%) pwMS reported having relapsing–remitting MS and 74.7% reported taking DMT (demographic data in Tables 1 and 2).
Demographic data for pwMS and controls.
Participants in this category chose to self-identify their gender, rather than selecting one of the three categories (Woman, Man, Non-Binary Person).
Ethnicity categories were adapted from the 2022 Irish Census categories.
RRMS = relapsing–remitting MS; SPMS = secondary progressive MS; PPMS = primary progressive MS.
See Supplementary Materials 3 for further information on additional neurodevelopmental/neurological conditions.
Prevalence of common MS symptoms self-reported by pwMS.
Most pwMS (65.5%) and controls (90.0%) were recruited through social media. There was no significant main effect of recruitment stream (CRI (p = 0.022–0.822), CLS (p = 0.032–0.362), MFIS (p = 0.238–0.945), HADS (p = 0.173–0.225), MSNQ (p = 0.012)). Thus, our method of recruitment was deemed robust.
CR statistics
PwMS and controls had relatively high CRI scores (Tables 3 and 4). PwMS reported high levels of MS-impact and fatigue, with a large proportion exceeding the clinical cut-off for depression (43.7%), anxiety (59.2%) and cognitive difficulty (52.9%) (Tables 5 and 6).
Descriptive statistics of CR measures for pwMS and controls.
CLS = Cognitive Leisure Scale (raw scores can range from 7 to 35); CRI = Cognitive Reserve Index questionnaire (low (< 70), medium-low (70–84), medium (85–114), medium-high (115–130), high (>130)); significant differences are highlighted in bold.
Group comparisons conducted using Mann–Whitney U tests.
Effect size is given by rank biserial correlation (values between 0 and|0.29| interpreted as small effect size, between|0.30| and|0.49| as moderate effect size and between|0.50| and|1| as large effect size).
Frequency of pwMS and controls in each of total CRI groups.
CRI = Cognitive Reserve Index questionnaire.
Descriptive statistics of self-report measures for pwMS and controls.
MSIS-29 = MS Impact Scale (raw scores can range from 29 to 145); MFIS = Modified Fatigue Impact Scale (total raw scores can range from 0 to 84, with scores >38 indicating high levels of fatigue); HADS = Hospital Anxiety and Depression Scale (raw scores can range from 0 to 21 on each subscale, with scores >7 indicating presence of anxiety/depression); MSNQ = MS Neuropsychological Questionnaire (raw scores can range from 0 to 60, with scores >27 indicating presence of cognitive difficulty).
Significant differences are highlighted in bold.
Group comparisons conducted using Mann–Whitney U tests.
Effect size is given by rank biserial correlation (values between 0 and|0.29| interpreted as small effect size, between|0.30| and|0.49| as moderate effect size and between|0.50| and|1| as large effect size).
Frequency of pwMS and controls with clinical levels of common MS symptoms.
MFIS = Modified Fatigue Impact Scale (total raw scores can range from 0 to 84); HADS = Hospital Anxiety and Depression Scale (raw scores can range from 0 to 21 on each subscale); MSNQ = MS Neuropsychological Questionnaire (raw scores can range from 0 to 60).
Recent CR-building and neuropsychological outcomes in pwMS
Recent engagement in cognitively enriching leisure activities (CLS Recent) was negatively associated (weak-moderate) with self-reported cognitive difficulties (MSNQ) (rho = −0.31, p < 0.001). Thus, greater engagement in cognitively enriching activities was associated with less cognitive difficulty.
Recent engagement in cognitively enriching leisure activities was also negatively associated (weak-moderate) with cognitive fatigue (MFIS cognitive; rho = −0.27, p < 0.001) and total fatigue (MFIS total; rho = −0.24, p < 0.001), and depression (HADS-D; rho = −0.31, p < 0.001). There was a trend towards significance with MS-impact (MSIS-29; rho = −0.19, p = 0.005), physical fatigue (MFIS physical; rho = −0.19, p = 0.006) and anxiety (HADS-A; rho = −0.21, p = 0.003).
Controlling for fatigue (cognitive and total) and depression in a partial correlation, the association between recent leisure and cognitive difficulty was not significant (p = 0.017).
Differences in CR across pwMS and controls
Early 20s and recent engagement in cognitively enriching leisure activities
Consistent with our hypotheses, pwMS and controls did not differ in engagement in cognitively enriching leisure activities reported during their early 20s (CLS 20s; W = 15,852, p = 0.675). However, they differed in recent engagement (CLS Recent; W = 11,072, p < 0.001, effect size (rank biserial correlation) = −0.28), with controls (median = 16) reporting greater engagement in cognitively enriching leisure activities than pwMS (median = 14) (Figure 1).

Recent engagement in cognitively enriching leisure activities (CLS Recent) across pwMS and controls.
Controls’ recent level of engagement in cognitively enriching leisure activities did not differ from their early 20s (V = 4724.5, p = 0.052), while pwMS reported higher engagement (V = 13,948, p < 0.001, effect size (rank biserial correlation) = 0.60) in their early 20s (median = 17) compared to recent engagement (median = 14) (Figure 2).

PwMS’ engagement in cognitively enriching leisure activities during their early 20s (CLS 20s) versus last year (CLS Recent).
CR developed throughout the lifespan
There was a trend towards pwMS having lower CRI-Education scores than controls (W = 12,806, p = 0.006, MedianPwMS = 109, MedianControls = 113). PwMS had higher CRI-Work scores than controls (W = 19,206, p < 0.001, MedianPwMS = 105, MedianControls = 101, effect size (rank biserial correlation) = 0.24). A Kruskal–Wallis test revealed a difference in CRI-Work even when controlling for education (X2(1, 356) = 15.37, p < 0.001, effect size [ε2] = 0.04). There was no evidence groups differing in CRI-Leisure (W = 15,430, p = 0.984) or total CRI (W = 15,896, p = 0.642). CRI scores were not correlated with any self-report measure.
The relationship of common MS symptoms with CR
The multiple regression model predicting recent engagement in cognitively enriching leisure activities (CLS Recent, Table 7) revealed that higher levels of depression (HADS-D) and self-reported cognitive difficulties (MSNQ) were associated with lower engagement.
Summary of the multiple regression model predicting CLS Recent.
Eleven influential cases were removed (see Supplementary Materials 4 for original model).
Adjusted R2 = 16%; F(9, 185) = 5.16, p < 0.001.
CI = confidence interval; LL = lower limit; UL = upper limit; MSIS-29 = MS Impact Scale; MFIS = Modified Fatigue Impact Scale; HADS = Hospital Anxiety and Depression Scale; MSNQ = MS Neuropsychological Questionnaire.
Significant predictors are highlighted in bold.
Higher levels of depression (HADS-D) were also associated with a higher discrepancy (i.e. lower CLS Recent compared to CLS 20s scores, resulting in positive and higher discrepancy scores) between recent engagement in cognitively enriching leisure activities and engagement in the early 20s (Table 8).
Summary of the multiple regression model predicting CLS 20s – CLS Recent discrepancy scores.
Eleven influential cases were removed (see Supplementary Materials 4 for original model).
Adjusted R2 = 29%; F(9, 185) = 9.86, p < 0.001.
CI = confidence interval; LL = lower limit; UL = upper limit; MSIS-29 = MS Impact Scale; MFIS = Modified Fatigue Impact Scale; HADS = Hospital Anxiety and Depression Scale; MSNQ = MS Neuropsychological Questionnaire.
Significant predictors are highlighted in bold.
In contrast, greater occupational achievement (CRI-Work, Table 9) and leisure activity across the adult lifespan (CRI-Leisure, Table 10) were only associated with older age.
Summary of the multiple regression model predicting CRI-Work.
14 influential cases were removed (see Supplementary Materials 4 for original model); adjusted R2 = 36%; F(9, 182) = 13.01, p < 0.001.
CI = confidence interval; LL = lower limit; UL = upper limit; MSIS-29 = MS Impact Scale; MFIS = Modified Fatigue Impact Scale; HADS = Hospital Anxiety and Depression Scale; MSNQ = MS Neuropsychological Questionnaire.
Significant predictors are highlighted in bold.
Summary of the multiple regression model predicting CRI-Leisure.
12 influential cases were removed (see Supplementary Materials 4 for original model).
Adjusted R2 = 44%.
F(9, 184) = 18.09, p < 0.001.
CI = confidence interval; LL = lower limit; UL = upper limit; MSIS-29 = MS Impact Scale; MFIS = Modified Fatigue Impact Scale; HADS = Hospital Anxiety and Depression Scale; MSNQ = MS Neuropsychological Questionnaire.
Significant predictors are highlighted in bold.
Discussion
This study aimed to achieve a better understanding of CR-building in MS by investigating how engagement in enriching activities is associated with common invisible MS symptoms. We found that higher levels of recent engagement in cognitively enriching leisure activities were associated with lower levels of self-reported cognitive difficulty in pwMS, but only when fatigue and depression were not controlled for in the analysis. This raises the possibility that previously reported associations between CR and cognitive outcomes may be attributed, at least in part, to these factors.
PwMS and controls did not differ in reported engagement in cognitively enriching leisure activities during their early 20s. However, pwMS reported lower levels of recent engagement in cognitively enriching leisure activities compared to controls during the last year. PwMS also reported a decrease in engagement during the last year compared to their early 20s, while controls experienced no change between the two timepoints. These results align with our hypotheses and are consistent with prior research reporting that pwMS experienced greater decreases in leisure activities than controls, and that an association between leisure and cognitive outcomes was not significant when controlling for depression. 12 Correspondingly, our regression models revealed that higher levels of depression were associated with lower and decreased engagement in cognitive leisure activities in pwMS.
In contrast, greater occupational achievement (CRI-Work) and engagement in a broader set of leisure activities undertaken across the entire adult lifespan (CRI-Leisure) were only associated with older age. The CRIq was developed for an older adult population. This could explain age as the only predictor in the context of our comparatively young sample. In addition, self-report measures, such as the ones used to assess participants’ experience of common MS symptoms, may be less related to lifetime enrichment as they only assess symptoms experienced during the last few weeks.
Previous research on CR and MS symptoms tended to investigate CR as a predictor, not an outcome. For example, a recent study investigated the moderating role of CR in the relationship between fatigue and depression. 23 In a similar study, CR was estimated only through pre-MS enrichment. 24 Thus, this study makes a unique contribution by focussing on CR-building throughout the lifespan (including post-diagnosis enrichment) and the role of MS symptoms in pwMS’ ability to engage in enriching activities.
Limitations
Further factors and symptoms may have contributed to pwMS’ engagement in enriching activities. Notably, given the survey-based nature of this research, we did not collect data on participants’ disability level, for example using the Expanded Disability Status Scale. 25 While the MSIS-29 captures the self-reported impact of physical and psychological symptoms on everyday life, future research should aim to more exhaustively assess and investigate possible MS-impact. For example, future research could use a self-report measure of disability, such as the Patient-Determined Disease Steps (PDDS). 26 Another limitation of this research is that we administered the CRIq via a survey, instead of the traditional semi-structured interview. We could not verify MS diagnoses and relied on self-report. It is unlikely that participants accidentally self-reported living with MS as they were asked detailed questions about MS (e.g. MS duration, time since last relapse, DMT). Yet, this limitation remains. Similarly, there is a risk of self-report bias in using self-report measures of common MS symptoms and CR, albeit all measures used in this study have been validated.
Implications and conclusion
Leisure activity may be the most modifiable aspect of CR post-diagnosis. Our findings highlight the importance of considering and addressing depression and fatigue, particularly in the context of lifestyle recommendations in clinical practice. Our PPI panel expressed that they would appreciate clinicians providing guidance around enriching activities and support in the ability to engage with these activities. Depression and fatigue are modifiable through pharmacological and non-pharmacological interventions.27,28 Around two thirds of our PPI panel also highlighted that they purposefully engage in cognitive leisure activities now, that they would not have pursued prior to their diagnosis. Some of these activities may not be well captured in existing measures assessing engagement in more traditional activities. In supporting pwMS in engaging in enriching leisure activities, through managing depression and fatigue, and building their CR, we may be able to better support pwMS in achieving better cognitive outcomes and quality of life.
Supplemental Material
sj-docx-1-msj-10.1177_13524585251338757 – Supplemental material for Cognitive reserve in multiple sclerosis: The role of depression and fatigue
Supplemental material, sj-docx-1-msj-10.1177_13524585251338757 for Cognitive reserve in multiple sclerosis: The role of depression and fatigue by Clara Stein, Fiadhnait O’Keeffe, Méadhbh Brosnan, Claire Flynn, Christopher McGuigan and Jessica Bramham in Multiple Sclerosis Journal
Footnotes
Data availability
Declaration of Conflicting Interests
The author(s) declared the following potential conflicts of interest with respect to the research, authorship and/or publication of this article: Christopher McGuigan reports a relationship with Biogen that includes consulting or advisory, funding grants, and speaking and lecture fees. Christopher McGuigan reports a relationship with Novartis that includes consulting or advisory, funding grants, and speaking and lecture fees. Christopher McGuigan reports a relationship with Roche that includes consulting or advisory, funding grants, and speaking and lecture fees. Christopher McGuigan reports a relationship with Bristol Myers Squibb Co that includes consulting or advisory and speaking and lecture fees. Christopher McGuigan reports a relationship with Janssen that includes consulting or advisory and speaking and lecture fees. Christopher McGuigan reports a relationship with Merck that includes consulting or advisory and speaking and lecture fees.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship and/or publication of this article: This publication has emanated from research conducted with the financial support of Taighde Éireann – Research Ireland under grant number GOIPG/2022/659. Taighde Éireann – Research Ireland had no role in study design, in collection, analysis and interpretation of data, in writing of the report or in the decision to submit this article for publication.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
