Abstract
Alzheimer’s disease is characterized by regional reductions in cerebral blood flow (CBF). Although the gold standard for measuring CBF is [15O]H2O PET, proxies of relative CBF, derived from the early distribution phase of amyloid and tau tracers, have gained attention. The present study assessed precision of [15O]H2O derived relative and absolute CBF, and compared precision of these measures with that of (relative) CBF proxies. Dynamic [15O]H2O, [18F]florbetapir and [18F]flortaucipir PET test-retest (TrT) datasets with eleven, nine and fourteen subjects, respectively, were included. Analyses were performed using an arterial input model and/or a simplified reference tissue model, depending on the data available. Relative CBF values (i.e. K1/K1′ and/or R1) were obtained using cerebellar cortex as reference tissue and TrT repeatability (i.e. precision) was calculated and compared between tracers, parameters and clinical groups. Relative CBF had significantly better TrT repeatability than absolute CBF derived from [15O]H2O (r = −0.53), while best TrT repeatability was observed for [18F]florbetapir and [18F]flortaucipir R1 (r = −0.23, r = −0.33). Furthermore, only R1 showed, better TrT repeatability for cognitively normal individuals. High precision of CBF proxies could be due to a compensatory effect of the extraction fraction, although changes in extraction fraction could also bias these proxies, but not the gold standard.
Introduction
In Alzheimer’s disease (AD), regional reductions in cerebral blood flow (CBF) have been reported in the temporal, parietal and posterior cingulate regions,1–3 predominantly in the later phases of the disease.4,5 As perfusion is tightly coupled to metabolism, 6 CBF measures may have clinical relevance in terms of determining disease severity as an indirect marker of neurodegeneration or for differential diagnosis.5,7,8 Moreover, these reductions in perfusion have been linked to cognitive decline in AD. 9
The gold standard technique for measuring CBF is [15O]H2O positron emission tomography (PET). However, the short half-life of oxygen-15 (122 sec) restricts its application to a few specialised PET centres equipped with an on-site cyclotron. During the last decade, several studies have evaluated whether a proxy of CBF can be derived from the early distribution phase of PET tracers that measure amyloid-β (Aβ) or tau burden.7,9–12 Promising results from studies investigating these proxies of relative CBF (i.e. R1 or the early frame standardized uptake value ratio) have led to an increased interest in so called dual-phase or dual-time window acquisition protocols for these tracers, given that they allow for extracting two different biomarkers.12–15 Apart from these PET-based methods, many other techniques exist for measuring CBF, such as arterial spin labelling (ASL) MRI, which has commonly been used in AD research. 16
During the last decade, longitudinal PET studies have become increasingly prevalent in AD research, which emphasizes the importance of understanding the intrinsic variability of CBF measures to determine what magnitude of change signifies an actual change. Repeatability of [15O]H2O PET derived absolute CBF measures has previously been characterized17,18 and more recently, test-retest (TrT) repeatability has been characterized for a global cortical volume of interest (VOI) for [18F]florbetapir derived R1 and across various ROIs for [11C]PiB derived R1.19,20 The repeatability for these CBF proxies was substantially better than TrT repeatability of [15O]H2O PET derived absolute CBF measures. 17 It has been hypothesized that the lower TrT repeatability of the absolute CBF measures is mainly due to large global variations in CBF, which are normalized when calculating a relative measure of CBF. To contribute to the understanding of repeatability of CBF measures, the main purpose of the present study was to compare repeatability of [15O]H2O PET derived relative and absolute CBF measures. In addition, repeatability of these [15O]H2O PET derived measures was also compared with that of relative CBF proxies (i.e. relative tracer delivery K1/K1′ and/or R1) estimated from [18F]florbetapir and [18F]flortaucipir scans across a range of VOIs. A secondary aim was to assess whether repeatability of relative CBF proxies was stable across diagnostic groups for [18F]florbetapir and [18F]flortaucipir.9,21
Materials and methods
Participants & image acquisition
The following three separate datasets were retrospectively included. Before participating in the study, all participants provided written informed consent in accordance with the Declaration of Helsinki. Study protocols were approved by the local Medical Ethics Review Committee of the Amsterdam UMC, VUmc and in case of the [15O]H2O study, also by the local Medical Ethics Review Committee of the Amsterdam UMC, AMC.
[15O]H2O dataset
Eleven healthy control participants underwent repeated dynamic [15O]H2O PET scanning with arterial blood sampling (described below) on the same day. 22 Briefly, a low-dose CT was acquired for attenuation and scatter correction purposes and then, a 10 min dynamic PET scan was performed starting at tracer injection. PET scans were acquired on a Philips Gemini TF-64 PET/CT system (Philips Healthcare, Cleveland, TN, USA) and reconstructed into 25 frames of progressively increasing duration using the row action maximum likelihood algorithm (LOR-RAMLA) reconstruction algorithm, with the vendors’ default settings. 23 T1-weighted MRI scans were acquired for anatomical reference 1–7 days prior to the PET session at a Philips 3 T Intera system (Philips Healthcare, Best, the Netherlands). 18
[18F]florbetapir dataset
Four cognitively normal (CN), Aβ-negative subjects and five AD dementia (Aβ-positive) patients underwent repeated dynamic [18F]florbetapir PET scans (average interval: 4.5 ± 3.0 weeks) with arterial blood sampling using a Philips Ingenuity TF PET/CT (Philips Medical Systems, Best, the Netherlands). Prior to the start of a 90 minutes dynamic PET scan, a low-dose CT was acquired. PET images were reconstructed into 22 frames using the BLOB (rotationally symmetric volume elements) ordered-subsets time of flight (BLOB-OS-TF) reconstruction algorithm, with the vendors’ default settings. 24 T1-weighted MRI scans were acquired on either a Signa HDxt MRI (General Electric, Milwaukee, WI) or an Ingenuity TF PET/MR (Philips Medical Systems, Cleveland, OH) scanner. 19
[18F]flortaucipir dataset
A group of 14 participants, consisting of six CN participants (all tau-negative)25,26 and eight patients with mild cognitive impairment due to AD or AD dementia (three tau-negative, five tau-positive),25,26 underwent repeated dual-time window [18F]flortaucipir PET scans (average interval 3.0 ± 1.0 weeks) on a Philips Ingenuity TF PET/CT (Philips Medical Systems, Best, the Netherlands). A low-dose CT was acquired prior to the first phase of the [18F]flortaucipir PET scan (0–60 min post injection, p.i.). After a 20-min break, the low-dose CT was repeated and the second phase of the PET scan was acquired (80 to 130 min p.i.). PET images were reconstructed into 29 frames using BLOB-OS-TF reconstruction algorithm. T1-weighted MRI images were acquired <6 months from the PET scan on a 3.0 T Philips Ingenuity Time-of-Flight PET/MR scanner. 25
Arterial sampling procedure
Arterial blood concentrations were measured continuously using an online blood sampler system. 22 In addition, manual samples were drawn at different times, i.e. at 5.5, 8 and 10 min for [15O]H2O PET scans and at 5, 10, 20, 40, 60, 75 and 90 min for [18F]florbetapir PET scans. These samples were used to calibrate the online sampler curve and, for [18F]florbetapir, to estimate plasma-to-whole blood ratios and correct for plasma metabolite fractions. A metabolite corrected plasma input function was obtained after the aforementioned corrections were applied to the continuous online whole blood sampler curve.
Image processing
During the acquisition of the PET scans, movement was checked regularly using laser beams, and head position was corrected if necessary. A visual quality control was used to assess between-frame motion and scans with severe motion were not included in the present study. Between-frame motion of less than 5 mm was corrected using frame to frame ridged co-registration in VINCI software. 27 For all scans, T1-weighted MR images were coregistered to their corresponding PET images and the coregistered MR was segmented into grey matter, white matter and cerebrospinal fluid (CSF) using SPM8. 28 For [18F]flortaucipir, the two parts of the PET scan were first combined after coregistering them using VINCI software (Max Plank Institute, Cologne, Germany). 27 Next, volumes of interest (VOI) were delineated based on the Hammers atlas 29 as implemented in PVE-lab. 30 Time-activity curves were obtained for the following grey matter VOIs: medial and lateral anterior temporal lobe, posterior temporal lobe, superior, middle and inferior temporal gyrus, fusiform gyrus, parahippocampal and ambient gyrus, anterior and posterior cingulate gyrus, middle and orbitofrontal gyrus, gyrus rectus, inferior and superior frontal gyrus, pre- and post-central gyrus, superior parietal gyrus and the (infero)lateral remainder of the parietal lobe, and a region consisting of all grey matter voxels of the brain, total grey matter.
Kinetic modelling
The [15O]H2O PET dataset had arterial plasma input data available and therefore, the single-tissue compartment model with two rate constants and blood volume fraction parameter was used to estimate K1, which equals CBF (F) as the extraction fraction (E) is essentially equal to 100% (K1 = E · F). In addition, to correct for global variations in perfusion, regional K1 values were normalised by K1′ (rate of influx of the tracer into the reference tissue) to obtain a measure of relative CBF (K1/K1′). For the second dataset consisting of [18F]florbetapir PET scans and arterial plasma input data, both the reversible two-tissue compartment model with four rate constants and additional blood volume fraction parameter (2T4k_Vb) and the simplified reference tissue model (SRTM) 31 were used to determine K1, K1/K1′ and R1, respectively. Finally, for [18F]flortaucipir PET scans, no plasma input data were available and, therefore, only SRTM was used to derive regional R1 values. 19 For all three tracers included in this study, the cerebellar grey matter was used as reference tissue.
Statistical tests
All statistical analyses were performed in R (version: 4.0.2; R Foundation for Statistical Computing, Vienna, Austria).
32
Results with p < 0.05 were considered statistically significant. The rank-biserial correlation r for non-parametric tests was used as a measure of effect size because it can be used for between and within study designs.33–35 The rank_biserial function from the effectsizes package in R was used to compute this measure. Potential between-tracer differences in sex were investigated using a chi-square test, while differences in age were assessed using Kruskal-Wallis
36
and Mann Whitney U tests.
37
TrT repeatability was calculated according to equation (1) and, for purposes of visualizing TrT distributions, also non-absolute values were calculated and shown in Violin plots.
Next, Bland-Altman analyses 38 were used to assess whether there was a bias between test and retest measures and to visualize measurement variability. Finally, potential differences in TrT repeatability were assessed for different tracers, metrics, diagnostic groups and groups based on the presence of the target pathology in case of the Aβ and tau tracers. Specifically, Mann-Whitney U tests were used for comparing metrics between different tracers and comparisons between diagnostic groups, while Wilcoxon Signed-Rank tests 39 were used for within tracer comparisons between metrics.
Results
An overview of the characteristics of the three datasets can be found in Table 1. The only between-tracer difference was in age (χ2 = 21.89, p < 0.001), with the [15O]H2O dataset consisting of significantly younger participants compared with the other two datasets (both p < 0.001, r = −1.00). Relative CBF values per tracer, diagnostic group and for both test and retest measurements can be found in Supplementary Table 1. Here, it can be observed that for both cognitively normal and cognitively impaired individuals, relative CBF values were comparable between tracers.
Subject demographics.
CN: cognitively normal; AD: Alzheimer’s disease dementia; MCI: mild cognitive impairment. Values are depicted as mean ± SD.
Figure 1 shows the distribution of (non-absolute) TrT values for each tracer and parameter. Bland-Altman analyses showed that average differences (mean ± SD) between test and retest measures ranged from −0.1 to −2.0% for relative measures: [15O]H2O K1/K1′: −2.0 ± 7.8%, [18F]florbetapir K1/K1′: −1.3 ± 5.4%, [18F]florbetapir R1: −1.7 ± 4.1%, [18F]flortaucipir R1: −0.1 ± 4.2,% while for the absolute measure (i.e. [15O]H2O K1) it was −5.7 ± 14.6% (Figure 2). The highest variability between test and retest measures was observed for [15O]H2O K1. Of note, for [15O]H2O K1, a cluster of data points with larger differences between test and retest measures was observed, corresponding to a single subject (Figure 2).

Violin plot showing the distribution of (non-absolute) test-retest values (%) for each tracer and parameter. Dotted coloured lines correspond to quartiles and coloured dashed lines to the median.

Bland-Altman plots illustrating the test-retest repeatability (%) for (a) [15O]H2O K1, (b) [15O]H2O K1/K1′, (c) [18F]florbetapir K1, (d) [18F]florbetapir K1/K1′, (e) [18F]florbetapir R1 and (f) [18F]flortaucipir R1. Dotted lines correspond to 95% Limits of Agreement and dashed lines to the average % difference.
Test-retest repeatability
[15O]H2O
Across all participants, average TrT repeatability for K1 was best in the orbitofrontal gyrus 7.8 ± 12.3% and worst in fusiform gyrus 17.7 ± 10.2. For K1/K1′, TrT repeatability ranged from 3.1 ± 3.0 in total grey matter to 10.5 ± 6.1 in the fusiform gyrus (Table 2). Overall, TrT repeatability significantly improved for K1/K1′ compared with K1 (V = 7510, p < 0.001, r = −0.53).
Average test-retest repeatability (%) of [15O]H2O K1 and K1/K1′.
All values are depicted as mean ± SD.
[18F]florbetapir
Across participants, average TrT repeatability K1 ranged from 14.7 ± 8.0% in the middle and inferior temporal gyri to 19.8 ± 10.0% in the inferolateral remainder of parietal lobe (Supplementary Table 2). TrT repeatability for K1 was worse in CN (Aβ-negative) subjects compared with AD (Aβ-positive) patients (U = 6419, p = 0.008, r = 0.21). More specifically, for CN subjects, average TrT repeatability for K1 ranged from 15.5 ± 4.0% in the middle and inferior temporal gyri to 22.8 ± 12.5% in the posterior part of the gyrus cinguli, while in case of AD patients, TrT repeatability for K1 ranged from 11.2 ± 9.9% in the parahippocampal and ambient gyri to 20.1 ± 11.9% in the inferolateral remainder of parietal lobe. For K1/K1′, average TrT repeatability ranged from 1.4 ± 1.4% in total grey matter to 6.3 ± 6.7% in the orbitofrontal gyrus (Table 3). There was no significant difference in TrT repeatability for K1/K1′ between diagnostic groups (r = 0.00). For R1, average TrT repeatability across subjects ranged from 2.1 ± 1.1% in total grey matter to 5.2 ± 2.0% in the fusiform gyrus (Table 4). Overall, TrT repeatability for R1 was better in CN (Aβ-negative) subjects compared with AD (Aβ-positive) patients (U = 4136, p = 0.007, r = −0.22). More specifically, for CN subjects, average TrT repeatability for R1 ranged from 1.0 ± 0.9% in the insula to 6.0 ± 4.4% in the posterior part of the gyrus cinguli, while in case of AD patients, TrT repeatability for R1 ranged from 1.7 ± 0.9% in the superior temporal gyrus to 6.4 ± 4.0% in the orbitofrontal gyri. There was no significant difference in TrT repeatability between K1/K1′ and R1 (r = 0.13), while both measures showed better TrT repeatability than K1 (U = 20477, p < 0.001, r = −0.90 and U = 21046, p < 0.001, r = −0.96, for K1/K1′ and R1, respectively).
Average test-retest repeatability (%) of [18F]florbetapir K1/K1′.
All values are depicted as mean ± SD; CN: cognitively normal; AD: Alzheimer’s disease dementia.
Average test-retest repeatability (%) of [18F]florbetapir R1.
All values are depicted as mean ± SD. CN: cognitively normal; AD: Alzheimer’s disease dementia.
[18F]flortaucipir
Across participants, average TrT repeatability for R1 ranged from 1.8 ± 2.0% in total grey matter to 4.3 ± 3.3% in the medial part of the anterior temporal lobe (Table 5). TrT repeatability was better in case of CN participants compared with AD patients (U = 10504, p = 0.008, r = −0.17). In CN participants, average TrT repeatability for R1 ranged from 0.6 ± 0.5% in the posterior temporal lobe to 4.8 ± 3.3% in the gyrus rectus. In AD patients, it ranged from 1.4 ± 1.0% in the precentral gyrus to 8.5 ± 8.3% in the orbitofrontal gyri. There were no differences in TrT repeatability between tau-negative and tau-positive groups (r = −0.04).
Average test-retest repeatability (%) of [18F]flortaucipir R1.
All values are depicted as mean ± SD, CN: cognitively normal, AD: Alzheimer’s disease dementia.
Tracer comparisons
Between tracer comparisons showed that [15O]H2O derived K1 had better TrT repeatability than [18F]florbetapir derived K1 (U = 35851, p < 0.001, r = −0.37). Nonetheless, [18F]florbetapir derived K1/K1′ and R1 (U = 20323, p < 0.001, r = −0.22 and U = 20064, p < 0.001, r = −0.23, respectively), and [18F]flortaucipir derived R1 (U = 27096, p < 0.001, r = −0.33) had better TrT repeatability than [15O]H2O K1/K1′. Furthermore, [18F]flortaucipir derived R1 showed better TrT repeatability than [18F]florbetapir derived R1 (U = 28608, p = 0.006, r = −0.14).
Discussion
The present study assessed precision of absolute and relative CBF measures through retrospective analysis of a dynamic [15O]H2O PET dataset. Furthermore, precision of [15O]H2O derived absolute/relative CBF was compared with that of (relative) CBF proxies (i.e. K1, K1/K1′ and R1) derived from dynamic [18F]florbetapir and [18F]flortaucipir PET scans.
As expected, for [15O]H2O PET, TrT repeatability of relative CBF was higher than that of absolute CBF and the same was found for [18F]florbetapir. The finding that K1/K1′ is less variable than K1, might be because it contains an intrinsic correction for global fluctuations in CBF, 17 and/or because any measurement errors in the arterial input function is cancelled out.
Furthermore, better TrT repeatability was observed for [15O]H2O derived K1 compared with [18F]florbetapir derived K1. A factor contributing to this finding could be the difference in acquisition time between test and retest [18F]florbetapir scans. 40 For [18F]florbetapir and [18F]flortaucipir, TrT repeatability of relative CBF (K1/K1′ and/or R1) was significantly better than that of [15O]H2O PET with a higher effect size for [18F]flortaucipir compared with [18F]florbetapir. Apart from differences in age and group composition, which could have affected TrT repeatability and will therefore be discussed in more detail later, this finding may be explained by several methodological factors. First, for tracers other than [15O]H2O, K1 is not only determined by flow, but also by the extraction fraction (K1 = E · F). Thus, fluctuations in flow might be compensated by changes in extraction fraction. Although higher TrT repeatability (i.e. higher precision) is desirable, it is important to note that this higher repeatability of these relative CBF proxies may, at least in part, be due to dissociation from CBF itself (i.e. by a compensatory change in extraction fraction), which of course is not the case for [15O]H2O PET. Another plausible explanation for the better TrT repeatability observed with [18F]florbetapir and [18F]flortaucipir, is the fact that oxygen-15 has a half-life of only 2 min, which means that the total number of counts in the [15O]H2O scans was much lower than in the [18F]florbetapir and [18F]flortaucipir scans. This results in higher noise levels in the [15O]H2O scans, and hence poorer measurement repeatability. The improved TrT repeatability observed for the relative CBF proxies does not necessarily indicate that this measure would be preferred over the gold standard, [15O]H2O PET. As mentioned above, the relative CBF proxies R1 or K1/K1′ might be biased through changes in extraction fraction, making them less accurate measures than K1 or K1/K1′ derived from [15O]H2O PET. Furthermore, an important disadvantage of these relative CBF proxies is that, by definition, they can only be used to measure relative changes in flow. Therefore, they cannot be used in research studies that aim to investigate (or are affected by) global changes in CBF. Finally, when designing a research study, it should also be taken into account that R1 might be less sensitive than the gold standard for measuring changes over time, as reported previously. 11
In the diagnostic group comparisons, better TrT repeatability was observed for CN participants compared with the cognitively impaired groups for R1 derived from [18F]florbetapir and [18F]flortaucipir scans, which might be related to the small datasets used for this comparison and R1’s relatively small SD. Furthermore, it should be noted that there was a clear difference in age and group composition for the [15O]H2O PET dataset compared with the [18F]florbetapir and [18F]flortaucipir datasets, possibly impacting the results. Furthermore, to date, it remains unclear whether TrT repeatability is comparable between young ([15O]H2O dataset) and elderly ([18F]florbetapir and [18F]flortaucipir datasets) CN participants, which could also have had an effect on the present results. Evidently, in an ideal scenario, repeatability of all tracers would have been compared within the same participant/patient sample. However, considering ethical regulations regarding radiation exposure of healthy individuals, such a design is not feasible, at least not for the sole reason of comparing K1 or R1 repeatability.
Regional differences in TrT repeatability were also observed for all tracers, although no clear pattern could be established. These regional differences may be related to various methodological factors such as size of the region, signal strength, effects of signal spill-in/spill-out from/to adjacent regions, but also biological factors such as atrophy or ageing, considering that these effects are not uniform across the brain.41,42 Nonetheless, across tracers, best TrT repeatability of relative CBF was observed for the largest region, which comprised total grey matter. The magnitude of the observed TrT repeatability of R1 estimated from [18F]florbetapir and [18F]flortaucipir scans was very comparable to what has previously been reported for [11C]PiB, despite the older scanner (Siemens ECAT EXACT HR+) that was used in that study. More specifically, across a nearly identical set of regions and in a group of CN participants, and MCI and AD dementia patients, [11C]PiB R1 TrT repeatability ranged from 1.5 to 5.8%, while in the present study R1 TrT repeatability was 2.1–5.2% for [18F]florbetapir and 1.8–4.3% for [18F]flortaucipir. This suggests that despite distinct tracer kinetics and differences in group composition, R1 remains a stable metric.
Furthermore, it is important to note, that there was a difference in timing between scans in the [15O]H2O dataset, where all participants received their repeat scan within one day, compared with the [18F]florbetapir and [18F]flortaucipir datasets, where participants received their repeat scan within a few weeks. Although in a prospective study, timing between repeat scans ideally would have been similar between studies, no changes in CBF are to be expected within a few weeks,43,44 thus no considerable effects on the results were expected. Finally, for [18F]flortaucipir, no arterial blood data had been collected, which prevented a direct comparison of repeatability of the K1/K1′ parameter between all three tracers. However, from a theoretical perspective, no substantial differences were expected in TrT between K1/K1′ and R1, which was also confirmed by comparisons performed using the [18F]florbetapir dataset.
Conclusion
Relative CBF showed higher precision than absolute CBF derived from [15O]H2O PET scans. Furthermore, relative CBF proxies derived from commonly used amyloid-β and tau tracers appeared to have even higher precision, possibly due to a compensatory effect of extraction fraction. It is important to keep in mind that changes in extraction fraction may bias these proxies, but not the gold standard, [15O]H2O PET.
Supplemental Material
sj-pdf-1-jcb-10.1177_0271678X221135270 - Supplemental material for Precision estimates of relative and absolute cerebral blood flow in Alzheimer’s disease and cognitively normal individuals
Supplemental material, sj-pdf-1-jcb-10.1177_0271678X221135270 for Precision estimates of relative and absolute cerebral blood flow in Alzheimer’s disease and cognitively normal individuals by Fiona Heeman, Denise Visser, Maqsood Yaqub, Sander Verfaillie, Tessa Timmers, Yolande AL Pijnenburg, Wiesje M van der Flier, Bart NM van Berckel, Ronald Boellaard, Adriaan A Lammertsma, Sandeep SV Golla in Journal of Cerebral Blood Flow & Metabolism
Footnotes
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The acquisitions mentioned in the Acknowledgements section are supported by grants from ZonMW and from the Nuts-Ohra Foundation (Amsterdam, The Netherlands): 0903-044 and 1002-03.
Acknowledgements
The authors would like to thank the staff of the department of Radiology and Nuclear Medicine of the Amsterdam UMC, location VUmc for skilful acquisition of the scans. Acquisition of [18F]flortaucipir and [18F]florbetapir PET scans were made possible by Avid Radiopharmeuticals Inc., a wholly owned subsidiary of Eli Lilly and Company (NYSE: LLY).
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Authors’ contributions
FH, DV, AAL and SSVG contributed to the concept and design of the study. FH, DV, MY, SV, TT, RB, YALP contributed to the data acquisition and analysis. FH, DV, SSVG and AAL interpreted the data and drafted the manuscript. FH, DV, MY, SV, TT, YALP, WMF, BNMB, RB, AAL and SSVG read, critically reviewed, and approved the final manuscript.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
