Abstract
Background
The early detection of Alzheimer’s disease (AD) requires an understanding of the relationships between a wide range of features. Conditional independencies and partial correlations are suitable measures for these relationships, because they can identify the effects of confounding and mediating variables.
Objective
To estimate conditional dependencies and partial correlations between relevant features in AD using a Bayesian approach to Gaussian copula graphical models (GCGMs). This approach has two key advantages. First, it includes binary, discrete, and continuous variables. Second, it quantifies the uncertainty of the estimates. Despite these advantages, Bayesian GCGMs have not been applied to AD research yet.
Methods
We design a GCGM to find the conditional dependencies and partial correlations among brain-region specific gray matter volume and glucose uptake, amyloid-beta levels, demographic information, and cognitive test scores. We applied our model to
Results
We found that aging reduces cognition through three indirect pathways: hippocampal volume loss, posterior cingulate cortex (PCC) volume loss, and amyloid-beta accumulation. We found a positive partial correlation between being woman and cognition, but also discovered four indirect pathways that dampen this association in women: lower hippocampal volume, lower PCC volume, more amyloid-beta accumulation, and less education. We found limited relations between brain-region specific glucose uptake and cognition, but discovered that the hippocampus and PCC volumes are related to cognition.
Conclusions
This study shows that the use of GCGMs offers valuable insights into AD pathogenesis.
Keywords
Introduction
Alzheimer’s disease (AD) is clinically characterized by amyloid-beta and tau accumulation. AD is the primary cause of dementia, a condition defined by a decline in cognitive and executive functions. 1 Despite extensive research, underlying causes of pathological changes in AD remain unknown. 2
Traditional research in AD typically selects a set of (dependent) variables and assesses the statistical associations with other variables (predictors).3,4 Although this approach can lead to valuable insights, it overlooks the complex network of relations underlying AD pathogenesis. For instance, predictor variables may influence each other (a phenomenon known as collinearity), or a confounding variable may obscure the true relationship between predictors and dependent variables, potentially leading to unreliable results.
Beyond this traditional approach, literature therefore increasingly treats relations between variables from a network perspective. A popular example of this perspective is the field of brain connectivity, which studies the network of relationships between different brain regions. 5 Brain connectivity has three subfields: structural, functional, and effective connectivity. Structural connectivity uncovers the physical relations among brain regions, 6 for instance using diffusion tensor imaging. 7 Functional connectivity involves the covariance, correlation, or other statistical dependency among brain regions. 8 Effective connectivity discovers the causal relations among brain regions 9 ; a common statistical technique to study effective connectivity is Dynamic Causal Modeling. 10
The present article studies the network of associations between regional gray matter volume and glucose metabolism, but goes beyond the standard brain connectivity approach by also including demographic factors, cognitive scores, and the global amyloid-beta accumulation. In total, we included 19 features that have been shown to play a role in the pathogenesis of AD. Network models between these variables are not new in AD literature and are predominantly causal of nature. A popular tool for causal inference is Structural Equation Modeling (SEM), a family of statistical techniques that, given the causal relations between variables, can estimate the effect size of each relationship. 11 Mediation analysis is part of the SEM family and studies the contribution of a third variable to the causal dependency between two other variables. It is a common technique in AD research.12–14 Other applications of SEM in AD include path analysis, 15 factor analysis, 16 and structural regression. 17 For causal inference in AD research, there are various alternatives to SEM including Structural Causal models, 18 System Dynamic models, 19 and Dynamic Causal Modeling. 10
This article considers undirected graphs. The resulting relations are therefore not causal of nature, as opposed to the directed and causal relations studied by SEMs. Undirected graphs have three main advantages over classical SEMs. First, undirected networks allow cycles. Often a variable A causes B and B causes A. We refer to such relation as a cycle. Cycles are common in AD pathology. SEMs, however, assume the network is acyclic and are therefore not suitable for inference on cyclic relations. Second, causal relations are hard to detect and generally need large sample sizes and longitudinal data. These data are costly to obtain. Inference on undirected networks is possible with smaller sample sizes and does not require longitudinal data. Lastly, undirected networks do not require prior knowledge about the structure of the graph. They can, therefore, be used without limitations on the structure. SEMs do need a causal relation graph as input. SEMs are able to refine the causal structure of this input graph, but these refinements suffer from a poor performance. 18 SEMs are therefore often restricted to variables and relations of which the causal structure is available a priori. Undirected networks, like the graphical model estimated in this article, can facilitate to form hypotheses about the structure of a causal network. Thus, they have the potential to improve the performance of SEMs and other causal inference methods.
Formally, in an undirected network, an edge between two variables represents some measure of statistical dependency. A common choice for this dependency is the Pearson’s correlation or the covariance. However, these metrics can lead to spurious associations by overlooking confounding or mediating factors. Ideally one wants a correlation that is corrected for such factors. Such a correlation exists and is called the partial correlation. Like the Pearson correlation, the partial correlation takes on a value in the range from
Conditional dependencies, partial correlations, and graphical models are commonly estimated using a frequentist approach. This approach can estimate partial correlations and predict whether any two variables are conditionally dependent or not. In the field of brain connectivity in AD, there are two articles applying frequentist graphical models to uncover conditional dependencies between brain region-specific gray matter volume and glucose uptake.23,24 Although frequentist approaches are relatively straightforward, they are not able to provide any uncertainty around the estimated conditional dependencies and partial correlations, a concept referred to as model uncertainty. To overcome this limitation, we employed a Bayesian approach, which offers a key advantage: it not only estimates conditional (in)dependence and partial correlations but also quantifies the uncertainty of these estimates.
Quantifying this uncertainty is important. Conditional independence, and statistical associations in general, are not black and white; based on the data, relations can be opaque. Consider, for example, the ambiguous role that sex plays in the pathology of AD. 25 When answering the question “Are two variables conditionally dependent?”, a simple yes or no might overlook the complexity of the relation. Instead, the answer “There is conditional dependence with 75%”, gives more color. Uncertainty also allows researchers to state that, based on the data, it is not clear if some variables are conditionally dependent. Quantifying uncertainty becomes even more pivotal if conditional dependence graphs are used as a starting point to develop a causal model, in which mistakes in the starting graph might trickle down to spurious causal results. 18
Despite the advantage that model uncertainty provides, the Bayesian approach is still uncommon in the field of AD research. This is largely due to the dated notion that the Bayesian approach is complex and inefficient. Although this claim is historically true, recent advancements have made Bayesian methods more computationally efficient,26,27 making their application to AD research possible. For example, Bayesian methods have been applied to estimate conditional dependence between brain regions22,28 and to determine the uncertainty of functional connectivity estimates. 29 All these applications, however, used so-called Gaussian graphical models (GGMs). In GGMs, all variables are assumed to follow a multivariate normal distribution. In the present study, we employed Gaussian copula graphical models (GCGMs). This methodology enabled the integration of non-normal variables, such as discrete (e.g., amyloid-beta levels), binary (e.g., sex) and continuous variables (e.g., MRI, FDG-PET).
This study presents a Bayesian approach to GCGMs. Our methodology has three capabilities. (i) the estimation of an undirected network depicting the conditional dependencies and partial correlations between variables, (ii) the quantification of the uncertainty of these estimates and, (iii) the inclusion of all types of variables whether normally distributed or not. Bayesian GCGMs have been successfully applied in other domains,30–32 but remain, to the best of our knowledge, unexplored in the AD domain.
The application of GCGMs to AD, allowed us to study the conditional dependence structure among 19 relevant features. Specifically, our primary objective was to identify the conditional dependence pathways between demographic variables and cognition (i.e., memory and executive function scores), and between neuro-imaging variables (i.e., gray matter volume, glucose uptake along with amyloid-beta levels) and cognition. Furthermore, we explored the conditional dependency pathways through which demographic variables influence gray matter volume and glucose uptake, and investigated the conditional dependencies between brain region-specific volume and glucose metabolism.
Methods
Subjects
We obtained the data for this study from the Alzheimer’s Disease Neuroimaging Initiative (ADNI), which provides a public database for AD research including clinical, neuropsychological, neuroimaging, and biomarker data. A complete description of the ADNI and up-to-date information is available at https://adni.loni.usc.edu. For this study, we selected the baseline examinations of the ADNI-GO and ADNI-2 phases. The final dataset included
After initial quality control and data preparation, the final sample included 345 cognitively normal control subjects (CN), 297 patients with amnestic early mild cognitive impairment (EMCI), 205 patients with amnestic late mild cognitive impairment (LMCI), and 175 patients with AD. We included two cognitive composite scores assessing memory (ADNI-MEM) and executive function (ADNI-EF). ADNI-MEM is a weighted average of seven different memory tests.
33
Similarly, ADNI-EF combines eleven different executive functions tests in a single score.
34
These composite scores provide a higher robustness than individual test scores and a sound psychometric ability to differentiate between different cognitive profiles. Both ADNI-MEM and ADNI-EF range between
Subject characteristics per diagnosis group. Values denote the mean and standard deviation (in parentheses).
Data preparation and feature extraction
In this study, we included 19 variables: three demographic variables, two composite cognitive test scores, the number of APOE4 alleles, the amyloid stage, the gray matter volume of six brain regions, and the glucose metabolism of the same six regions. Supplemental Table 1 in the Supplemental Material lists all the variables along with their abbreviations and their data type (continuous, discrete, binary or categorical). In this subsection we discuss how we obtained and prepared these variables.
The six brain regions were selected based on our hypotheses and a priori literature findings of early involvement in neurodegenerative processes in AD: hippocampus, caudate, putamen, thalamus, posterior cingulate cortex (PCC), and precuneus. 35 All six regions are defined by the Harvard-Oxford atlas. 36 For each region, we took the average of the left and right brain regions. This avoided the number of variables becoming too large, which would hinder the interpretability of the results. In order to test the robustness of our model, we ran it a second time, this time including the left and right regions separately.
This study used three biomarkers, all associated with AD: amyloid-beta accumulation, 1 glucose metabolism, 37 and gray matter volume. 38 They were measured using AV45-PET, FDG-PET, and T1 weighted MRI scans, respectively. The data resulting from these scans were processed as in earlier article.22,35,39 The MRI scans were segmented into gray matter, white matter, and cerebrospinal fluid and spatially normalized to an aging/AD-specific reference template using SPM8 (Wellcome Centre for Human Neuroimaging, University College London) and VBM8 (Structural Brain Mapping Group, University of Jena) toolboxes, and the DARTEL algorithm. 40 FDG- and AV45-PET scans were co-registered to the T1 scan and spatially normalized by applying the deformation fields of the T1 scan. To reduce the effect of partial volume signal arising from the low spatial resolution of PET scans, we applied partial volume correction using a three-compartment model and the MRI-derived tissue segments. 41 We scaled the regional gray matter volumes proportionally by the total intracranial volume, the regional FDG-PET values by pons uptake, and the regional AV45-PET values by whole-cerebellum uptake. As amyloid-beta spreading has been shown to follow a specific sequence, we captured the amyloid-beta accumulation in a single five-level amyloid score reflecting the global severity of amyloid-beta deposition. 39 Glucose metabolism and gray matter volume were obtained for each of the six brain regions of interest.
We included the three demographic variables that are well-known to modulate the risk of AD: age, sex, and education. 1 Sex is represented as a binary variable, equal to one for women and zero for men. Education is expressed in the number of years of formal education received. The number of APOE4 alleles is strongly associated with amyloid-beta production and AD 1 and, therefore, included as a variable in our analysis. We coded this variable as binary, i.e., zero for patients with no APOE4 allele and one for patients with at least one APOE4 allele. Lastly, we included memory and executive function composite scores named ADNI-MEM and ADNI-EF, respectively.
Modeling: Bayesian inference in GCGMs
We used a Bayesian framework within GCGMs. This framework combines three essential components: graphical models for estimating conditional dependencies and partial correlations, Bayesian methods for determining the uncertainty of those estimates, and the Gaussian copula for accommodating diverse data types (continuous, discrete, and binary). In this section, we provide a detailed explanation of each component.
Graphical models
20
represent conditional dependencies between variables in the form of a graph
The aim of GGMs is to use observations of the variables to estimate the precision matrix
Before obtaining any data, a researcher can already have a belief about
So far, we have assumed that the data
We refer interested readers to a more detailed explanation of Bayesian Gaussian copula graphical models. 31 For guidance on implementing this approach, we refer readers to the R package BDgraph. 47 To ensure reproducibility, the R scripts used to produce our results can be found on the GitHub page https://github.com/lucasvogels33/Modeling-AD-Bayesian-GCGM-from-Demographic-Cognitive-and-Neuroimaging-Data.
Results
This section presents the results. It contains the estimated conditional dependency networks and the corresponding estimated partial correlations, but also showcases the uncertainty of these estimates. We also briefly discuss how the results change as the disease progresses and what the impact is of considering both the left and right side of each brain region.
Figure 1(a) displays all conditional dependencies in a network. In such a network, an edge between a pair of conditionally dependent variables (e.g., age and executive function) is also called a direct pathway. Some pairs of variables are connected via two or more edges. We refer to such connections as indirect conditional dependence pathways. We observe conditional dependency pathways (both direct and indirect), between age and cognition (Figure 1(b)), as well as between sex and cognition (Figure 1(c)). We observe in Figure 1(d) that the amyloid stage and brain-region specific gray matter volume are conditionally dependent with cognition, but report limited conditional dependency between brain-region specific glucose uptake and cognition. Figure 1(e) shows that both old age and being a woman are predominantly negatively partially correlated with brain-region specific volume and glucose metabolism. Lastly, Figure 1(f) depicts the ten conditional dependencies between brain-region specific volume and glucose uptake.

Visualization of conditional dependence among brain-region specific glucose uptake (G), brain-region specific gray matter volume (V), and demographic variables. An edge between variables indicates a conditional dependence with a probability of at least
The conditional dependence networks in Figure 1 reveal what variables were likely to be conditionally dependent. They do not reveal, however, the strength of this dependence. These are given by the partial correlations and are shown, alongside the Pearson correlations in Figure 2. Pearson correlations were set to zero when the

Pearson correlations (left) and partial correlations (right) among brain-region specific glucose uptake (G), brain-region specific gray matter volume (V), and demographic variables. Pearson correlations are set to zero when p-value
We applied GCGMs to AD primarily to discover the conditional dependencies related to cognition (i.e., memory and executive function). Figure 3 presents the ten variables that were most likely conditionally dependent with memory. For each variable, the figure displays the probability of conditional dependence (left) and the mean partial correlation (right). Memory was partially correlated with hippocampus volume (

The probability of being conditionally dependent with memory (left) and the partial correlation with memory (right).

The probability of being conditionally dependent with executive function (left) and the partial correlation with executive function (right).
The main advantage of the Bayesian approach is its ability to compute the uncertainty of its estimates. We showcase this in Figure 5 which presents the probability density plots of four selected partial correlations. The spike at zero in some of these plots denotes the probability that the partial correlation is zero, i.e., the probability that the variables were conditionally independent. The partial correlations depicted in the plots have low standard deviations (

Estimated probability density plots of the partial correlations of four selected pairs of variables. (a) Age and memory; (b) Hippocampus volume and memory; (c) Amyloid stage and memory; (d) Executive function and education.
So far, we have considered the results of
We also conducted a separate analysis in which we included the left and right brain regions separately. The resulting network with
Discussion
This section interprets the results of the previous section and compares them with the existing results in the literature. We also discuss the limitations of our work and end with a conclusion.
Interpretation of results
The interpretation of all conditional (in)dependencies and partial correlations goes beyond the scope of this paper. Instead, we interpret here those associations that we deem relevant.
We first elucidate the conditional dependencies (direct and indirect) between the demographic variables (age, sex, and education) and cognition (memory and executive function), starting with age. It is well-established in the literature that age is the biggest risk factor for AD.
1
In line with this, we found negative Pearson correlations between age and cognition (Figure 2(a)) and a negative partial correlation between age and executive function (Figure 4). However, we found a surprising positive partial correlation between age and memory. Specifically, we estimated that age and memory are conditionally dependent with
The positive partial correlation between age and memory also suggested that the main indirect pathways through which age contributes to memory decline were captured in our model. Figure 1(b) shows two such pathways. Aging increased amyloid-beta deposition and reduced the gray matter volume of the hippocampus and PCC, impairing memory and executive function. Both associations were confirmed in the literature.1,48,49 The GCGM model allowed us to estimate the uncertainty of these estimates. For example, with more than
Next, we look at the relation between sex and cognition. We found a positive partial correlation between being a woman and memory (Figure 2(b)). The Pearson correlation between sex and memory was weaker (Figure 2(a)). This suggested that there may exist indirect conditional dependency pathways between sex and cognition, each of which dampening the positive effect of the observed direct partial correlation. Figure 1(c) depicts four such pathways. First, women in our dataset have spent, on average, one year less in education. This effect was also observed in literature.1,50,51 The density plot in Figure 5(d) suggested that education and executive function were conditionally dependent with a probability of
Next, we identified the conditional dependency pathways between neuro-imaging variables (gray matter volume, glucose uptake and amyloid-beta accumulation) and cognition. Figure 1(d) depicts all such dependencies. We reported a conditional dependency between the hippocampal volume and memory with a probability of one, see Figure 3. This supported the established notion that the hippocampus is associated with memory.
56
Figure 4 shows an almost certain conditional dependency between the PCC volume and executive function, confirming a theory that PCC is involved in attention.
57
Our findings suggested that the high Pearson correlations between brain-region specific volume and cognition (Figure 2(a)) were solely due to each region’s conditional dependence with the hippocampus and PCC volume. Corrected for other variables, we found no relation between glucose metabolism and cognition. The link between brain-region specific glucose uptake and cognition has not been widely studied, although there is evidence for an association between PCC glucose uptake and cognition.
58
We found a conditional dependence between these two variables with a
Third, we investigated the conditional dependencies between demographic variables (sex and age) and brain-region specific glucose uptake and volume. Figure 1(e) depicts such dependencies. We found that age and gender showed more conditional dependencies with brain-region specific volume than with brain-region specific glucose uptake. Age was negatively partially correlated with the volume of the putamen, hippocampus, PCC and thalamus. Age induced atrophy in these regions was also described in literature. 59 We reported negative partial correlations between being female and the volume of three brain regions: the hippocampus, precuneus and PCC. We also found a positive partial correlation between being a woman and the volume of the putamen, an association also reported by others. 60 Concerning glucose uptake, age was only negatively partially correlated with the caudate. This aligns with earlier findings that the precuneus cortex, hippocampus, thalamus, and putamen are among the regions whose metabolism is least affected by aging. 61
Lastly, we looked at the conditional dependencies between brain-region specific volume and glucose metabolism. They are depicted in Figure 1(f). We found ten such conditional dependencies. Supplemental Figure 4 in the Supplemental Material shows that these conditional dependencies increased in number as the disease progresses. Among EMCI patients, we found almost no conditional dependencies between brain volume and glucose uptake, whereas in AD patients several such conditional dependencies can be observed. Among AD patients, the volume and glucose uptake of the hippocampus were positively partially correlated. The same was true for the thalamus and the putamen. This was in line with the hypothesis that in AD reduced glucose metabolism precedes neuronal loss and brain volume reduction. 37
Limitations
Our Bayesian approach to GCGMs has three main limitations. First, it becomes slow for practical applications when the number of variables
The second limitation of the GCGM is its linearity assumption. More specifically, partial correlations represent the strength of a linear relationship with the effect of other variables removed. Partial correlations can be over-, or underestimated, when the underlying relationship is not linear.
Lastly, GCGMs are undirected. This comes with advantages. GCGMs can deal with cyclic networks, require relatively few observations and do not need prior knowledge of the structure. However, the undirected nature of GCGMs make them not suited for identifying causal effects, such as the impact of a treatment on amyloid-beta accumulation, or the effect of a lifestyle change on cognition. The undirected networks provided by GCGMs can, however, be used as a starting point for causal analysis.
The particular application of GCGMs described in this article also comes with three caveats, each opening an avenue for further research. First, apart from education, we did not include any lifestyle variables in our model. These variables account for an estimated
Conclusions
In this article we present a Bayesian approach to GCGMs. This approach has three capabilities: (i) the estimation of an undirected network depicting the conditional dependencies and partial correlations among variables, (ii) the quantification of the uncertainty of these estimates and, (iii) the inclusion of all types of variables whether normally distributed or not. Bayesian GCGMs have been successfully applied in other domains,30–32 but remain, to the best of our knowledge, unexplored in the AD domain.
Our GCGM uncovered the partial correlations and conditional dependencies among demographic data, the global amyloid stage, cognitive test scores, brain-region specific gray matter volume, and brain-region specific glucose uptake. Our Bayesian approach enabled us to estimate the uncertainties of these estimates too.
As expected, we observed that the partial correlations and their corresponding conditional dependency networks were sparser than the commonly used Pearson correlation or covariance measures. Our study confirmed existing knowledge, but also opened up new hypotheses. We found three indirect pathways through which old age reduces cognition: hippocampal volume loss, PCC volume loss, and amyloid-beta accumulation. Moreover, we found that women performed better on cognitive tests, but also discovered four indirect pathways that dampen this effect: lower hippocampal volume, lower PCC volume, more amyloid-beta accumulation, and less education. We also found that the hippocampus and PCC volumes are conditionally dependent on cognition, but found limited conditional dependence between brain-region specific glucose uptake and cognition. We found that age and sex were more conditionally dependent with brain-region specific volume than with brain-region specific glucose uptake. Lastly, we discovered that the conditional dependence between brain-region specific volume and glucose metabolism increased as the disease progresses.
Supplemental Material
sj-pdf-1-alz-10.1177_13872877251337944 - Supplemental material for Modeling Alzheimer’s disease: Bayesian copula graphical model from demographic, cognitive, and neuroimaging data
Supplemental material, sj-pdf-1-alz-10.1177_13872877251337944 for Modeling Alzheimer’s disease: Bayesian copula graphical model from demographic, cognitive, and neuroimaging data by Lucas Vogels, Reza Mohammadi, Marit Schoonhoven, Ş Ilker Birbil, Martin Dyrba and in Journal of Alzheimer's Disease
Footnotes
Acknowledgements
Data collection and sharing for this project was funded by the Alzheimer’s Disease Neuroimaging Initiative (ADNI) (National Institutes of Health Grant U01 AG024904) and DOD ADNI (Department of Defense award number W81XWH-12-2-0012), and the Alzheimer’s Disease Metabolomics Consortium (National Institute on Aging Grants R01AG046171, RF1AG051550 and 3U01AG024904-09S4). The ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through generous contributions from the following: AbbVie, Alzheimer’s Association; Alzheimer’s Drug Discovery Foundation; Araclon Biotech; BioClinica, Inc.; Biogen; Bristol-Myers Squibb Company; CereSpir, Inc.; Cogstate; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; EuroImmun; F. Hoffmann-La Roche Ltd and its affiliated company Genentech, Inc.; Fujirebio; GE Healthcare; IXICO Ltd.; Janssen Alzheimer Immunotherapy Research & Development, LLC.; Johnson & Johnson Pharmaceutical Research & Development LLC.; Lumosity; Lundbeck; Merck & Co., Inc.; Meso Scale Diagnostics, LLC.; NeuroRx Research; Neurotrack Technologies; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Takeda Pharmaceutical Company; and Transition Therapeutics. The Canadian Institutes of Health Research is providing funds to support ADNI clinical sites in Canada. Private sector contributions are facilitated by the Foundation for the National Institutes of Health (
).
Lastly, we acknowledge Elias Dubbeldam, PhD student at the Amsterdam Business School, for his feedback on the article. In particular his suggestions on the visualization of the conditional dependencies improved the article.
Ethical considerations
Not applicable.
Consent to participate
Not applicable.
Consent for publication
Not applicable.
Author contribution(s)
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
Declaration of conflicting interest
The authors declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: For this research we collaborated with Stefan Teipel. He is a Guest Editor of the supplemental issue, “Early Detection of Alzheimer’s Disease: From Multiplex Assays and Imaging to AI-Based Functional Monitoring”, to which this manuscript is submitted. This forms a potential conflict of interest. However, Dr. Teipel was not involved in handling or review of this submission. The authors declared no other potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Data availability
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
