Dynamic functional connectivity metrics have much to offer to the neuroscience of individual differences of cognition. Yet, despite the recent expansion in dynamic connectivity research, limited resources have been devoted to the study of the reliability of these connectivity measures. To address this, resting-state functional magnetic resonance imaging data from 100 Human Connectome Project subjects were compared across 2 scan days. Brain states (i.e., patterns of coactivity across regions) were identified by classifying each time frame using k means clustering. This was done with and without global signal regression (GSR). Multiple gauges of reliability indicated consistency in the brain-state properties across days and GSR attenuated the reliability of the brain states. Changes in the brain-state properties across the course of the scan were investigated as well. The results demonstrate that summary metrics describing the clustering of individual time frames have adequate test/retest reliability, and thus, these patterns of brain activation may hold promise for individual-difference research.
Get full access to this article
View all access options for this article.
References
1.
AbrolA, ChazeC, DamarajuE, CalhounVD. 2016. The chronnectome: evaluating replicability of dynamic connectivity patterns in 7500 resting fMRI datasets. Conf Proc IEEE Eng Med Biol Soc, 2016:5571–5574.
2.
AllenEA, DamarajuE, PlisSM, ErhardtEB, EicheleT, CalhounVD. 2014. Tracking whole-brain connectivity dynamics in the resting state. Cereb Cortex, 24:663–676.
3.
BaumannH, BaumannR, GurkC, WolterF. 1968. Electrophysiological studies of central nervous performance during monotony. Electroencephalogr Clin Neurophysiol, 24:259–273.
4.
BirnRM, MolloyEK, PatriatR, ParkerT, MeierTB, KirkGR, et al.2013. The effect of scan length on the reliability of resting-state fMRI connectivity estimates. Neuroimage, 83:550–558.
5.
ChangC, GloverGH. 2010. Time–frequency dynamics of resting-state brain connectivity measured with fMRI. Neuroimage, 50:81–98.
6.
ChangC, LeopoldDA, SchölvinckML, MandelkowH, PicchioniD, LiuX, et al.2016. Tracking brain arousal fluctuations with fMRI. Proc Natl Acad Sci U S A, 113:4518–4523.
ChenS, LangleyJ, ChenX, HuX. 2016. Spatiotemporal modeling of brain dynamics using resting-state functional magnetic resonance imaging with Gaussian hidden Markov model. Brain Connect, 6:326–334.
9.
ChoeAS, NebelMB, BarberAD, CohenJR, XuY, PekarJJ, et al.2017. Comparing test-retest reliability of dynamic functional connectivity methods. Neuroimage, 158:155–175.
10.
CocchiL, ZaleskyA, FornitoA, MattingleyJB. 2013. Dynamic cooperation and competition between brain systems during cognitive control. Trends Cogn Sci, 17: 493–501.
11.
DemirtaşM, TornadorC, FalcónC, López‐SolàM, Hernández‐RibasR, PujolJ, et al.2016. Dynamic functional connectivity reveals altered variability in functional connectivity among patients with major depressive disorder. Hum Brain Mapp, 37:2918–2930.
12.
EverittBS, LandauS, LeeseM, StahlD. 2011. An Introduction to Classification and Clustering. Cluster Analysis, 5th ed. Hoboken, NJ: Wiley.
13.
FornitoA, HarrisonBJ, ZaleskyA, SimonsJS. 2012. Competitive and cooperative dynamics of large-scale brain functional networks supporting recollection. Proc Natl Acad Sci U S A, 109:12788–12793.
14.
GlasserMF, SotiropoulosSN, WilsonJA, CoalsonTS, FischlB, AnderssonJL, et al.2013. The minimal preprocessing pipelines for the Human Connectome Project. Neuroimage, 80:105–124.
15.
GoldmanRI, SternJM, EngelJJr., CohenMS. Simultaneous EEG and fMRI of the alpha rhythm. Neuroreport, 2002; 13:2487–2492.
16.
GriffantiL, Salimi-KhorshidiG, BeckmannCF, AuerbachEJ, DouaudG, SextonCE, et al.ICA-based artefact removal and accelerated fMRI acquisition for improved resting state network imaging. Neuroimage, 2014; 95:232–247.
17.
HandwerkerDA, OllingerJM, D'EspositoM. 2004. Variation of BOLD hemodynamic responses across subjects and brain regions and their effects on statistical analyses. Neuroimage, 21:1639–1651.
18.
HindriksR, AdhikariMH, MurayamaY, GanzettiM, MantiniD, LogothetisNK, DecoG. 2016. Can sliding-window correlations reveal dynamic functional connectivity in resting-state fMRI?. Neuroimage, 127:242–256.
19.
HutchisonRM, WomelsdorfT, AllenEA, BandettiniPA, CalhounVD, CorbettaM, et al.2013. Dynamic functional connectivity: promise, issues, and interpretations. Neuroimage, 80:360–378.
20.
KhannaA, Pascual-LeoneA, MichelCM, FarzanF. 2015. Microstates in resting-state EEG: current status and future directions. Neurosci Biobehav Rev, 49:105–113.
21.
KimHY. 2013. Statistical notes for clinical researchers: evaluation of measurement error 1: using intraclass correlation coefficients. Restor Dent Endod, 38:98–102.
22.
LaumannTO, SnyderAZ, MitraA, GordonEM, GrattonC, AdeyemoB, et al.2017. On the stability of BOLD fMRI correlations. Cereb Cortex, 27:4719–4732.
23.
LiaoXH, XiaMR, XuT, DaiZJ, CaoXY, NiuHJ, et al.2013. Functional brain hubs and their test–retest reliability: a multiband resting-state functional MRI study. Neuroimage, 83:969–982.
24.
LiuTT, NalciA, FalahpourM. 2017. The global signal in fMRI: nuisance or information?. Neuroimage, 150:213–229.
25.
LiuX, DuynJH. 2013. Time-varying functional network information extracted from brief instances of spontaneous brain activity. Proc Natl Acad Sci U S A, 110:4392–4397.
26.
LiuZ, de ZwartJA, YaoB, van GelderenP, KuoLW, DuynJH. 2012. Finding thalamic BOLD correlates to posterior alpha EEG. Neuroimage, 63:1060–1069.
27.
MajeedW, MagnusonM, HasenkampW, SchwarbH, SchumacherEH, BarsalouL, KeilholzSD. 2011. Spatiotemporal dynamics of low frequency BOLD fluctuations in rats and humans. Neuroimage, 54:1140–1150.
28.
McGrawKO, WongSP. 1996. Forming inferences about some intraclass correlation coefficients. Psychol Methods, 1:30–46.
29.
MurphyK, FoxMD. 2017. Towards a consensus regarding global signal regression for resting state functional connectivity MRI. Neuroimage, 154:169–173.
30.
NomiJS, VijSG, DajaniDR, SteimkeR, DamarajuE, RachakondaS, et al.2017. Chronnectomic patterns and neural flexibility underlie executive function. Neuroimage, 147:861–871.
31.
OlbrichS, MulertC, KarchS, TrennerM, LeichtG, PogarellO, HegerlU. 2009. EEG-vigilance and BOLD effect during simultaneous EEG/fMRI measurement. Neuroimage, 45: 319–332.
32.
PetridouN, GaudesCC, DrydenIL, FrancisST, GowlandPA. 2013. Periods of rest in fMRI contain individual spontaneous events which are related to slowly fluctuating spontaneous activity. Hum Brain Mapp, 34:1319–1329.
33.
PowerJD, BarnesKA, SnyderAZ, SchlaggarBL, PetersenSE. 2012. Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion. Neuroimage, 59:2142–2154.
34.
PowerJD, MitraA, LaumannTO, SnyderAZ, SchlaggarBL, PetersenSE. 2014. Methods to detect, characterize, and remove motion artifact in resting state fMRI. Neuroimage, 84:320–341.
35.
PrichardD, TheilerJ. 1994. Generating surrogate data for time series with several simultaneously measured variables. Phys Rev Lett, 73:951–954.
Salimi-KhorshidiG, DouaudG, BeckmannCF, GlasserMF, GriffantiL, SmithSM. 2014. Automatic denoising of functional MRI data: combining independent component analysis and hierarchical fusion of classifiers. Neuroimage, 90:449–468.
38.
ShahLM, CramerJA, FergusonMA, BirnRM, AndersonJS. 2016. Reliability and reproducibility of individual differences in functional connectivity acquired during task and resting state. Brain Behav, 6:e00456.
39.
ShakilS, LeeCH, KeilholzSD. 2016. Evaluation of sliding window correlation performance for characterizing dynamic functional connectivity and brain states. Neuroimage, 133:111–128.
40.
ShehzadZ, KellyAM, ReissPT, GeeDG, GotimerK, UddinLQ, et al.2009. The resting brain: unconstrained yet reliable. Cereb Cortex, 19:2209–2229.
41.
ShirerWR, RyaliS, RykhlevskaiaE, MenonV, GreiciusMD. 2012. Decoding subject-driven cognitive states with whole-brain connectivity patterns. Cereb Cortex, 22:158–165.
SiegelJS, PowerJD, DubisJW, VogelAC, ChurchJA, SchlaggarBL, PetersenSE. 2014. Statistical improvements in functional magnetic resonance imaging analyses produced by censoring high‐motion data points. Hum Brain Mapp, 35:1981–1996.
44.
TagliazucchiE, BalenzuelaP, FraimanD, ChialvoDR. 2012. Criticality in large-scale brain fMRI dynamics unveiled by a novel point process analysis. Front Physiol, 3:15.
45.
TagliazucchiE, LaufsH. 2014. Decoding wakefulness levels from typical fMRI resting-state data reveals reliable drifts between wakefulness and sleep. Neuron, 82:695–708.
46.
ThompsonG, MagnusonM, MerrittM, SchwarbH, PanW, McKinleyA, et al.2013. Short time windows of correlation between large scale functional brain networks predict vigilance intra-individually and inter-individually. Hum Brain Mapp, 34:3280–3298.
47.
Van EssenDC, SmithSM, BarchDM, BehrensTE, YacoubE, UgurbilK; WU-Minn HCP Consortium. 2013. The WU-Minn Human Connectome Project: an overview. Neuroimage, 80:62–79.
48.
VarikutiDP, HoffstaedterF, GenonS, SchwenderH, ReidAT, EickhoffSB. 2017. Resting-state test–retest reliability of a priori defined canonical networks over different preprocessing steps. Brain Struct Funct, 222:1447–1468.
49.
WardJH. 1963. Hierarchical grouping to optimize an objective function. J Am Stat Assoc, 58:236–244.
50.
WongCW, DeYoungPN, LiuTT. 2016. Differences in the resting-state fMRI global signal amplitude between the eyes open and eyes closed states are related to changes in EEG vigilance. Neuroimage, 124(Pt A):24–31.
51.
WongCW, OlafssonV, TalO, LiuTT. 2013. The amplitude of the resting-state fMRI global signal is related to EEG vigilance measures. Neuroimage, 83:983–990.
52.
YousefiB, ShinJ, SchumacherEH, KeilholzSD. 2018. Quasi-periodic patterns of intrinsic brain activity in individuals and their relationship to global signal. Neuroimage, 167:297–308.
53.
ZuoXN, XuT, JiangL, YangZ, CaoXY, HeY, et al.2013. Toward reliable characterization of functional homogeneity in the human brain: preprocessing, scan duration, imaging resolution and computational space. Neuroimage, 65:374–386.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
