Though previous examinations of intrinsic resting-state networks (RSNs) in healthy populations have consistently identified several RSNs that represent connectivity patterns evoked by cognitive and sensory tasks, the effects of different analytic approaches on the reliability and reproducibility of these RSNs have yet to be fully explored. Thus, the primary aim of the current study was to investigate the effect of method (independent component analyses [ICA] vs. seed-based analyses) on RSN reproducibility (independent datasets) for ICA and reliability (independent time points) in both methods using functional magnetic resonance imaging. Good to excellent reproducibility was observed in 9 out of 10 commonly identified RSNs, indicating the robustness of these intrinsic fluctuations at the group level. Reliability analyses showed that results were dependent on three main methodological factors: (1) group versus subject-level analyses (group>subject); (2) whether data from different visits were analyzed separately or jointly with ICA (combined>separate ICA); and (3) whether ICA output was used to directly assess reliability or to inform seed-based analyses (seed-based>ICA). These results suggest that variations in the analytic technique have a significant impact on individual reliability measurements, but do not significantly affect the reproducibility or reliability of RSNs at the group level. Further investigation into the effect of the analytic technique on RSN quantification is warranted to increase the utility of RSN analyses in clinical studies.
Get full access to this article
View all access options for this article.
References
1.
Abou-ElseoudA, StarckT, RemesJ, NikkinenJ, TervonenO, KiviniemiV. 2010. The effect of model order selection in group PICA. Hum Brain Mapp, 1216:1207–1216.
2.
AllenEa, ErhardtEB, WeiY, EicheleT, CalhounVD. 2012. Capturing inter-subject variability with group independent component analysis of fMRI data: a simulation study. NeuroImage, 59:4141–4159.
3.
BeckmannCF, DeLucaM, DevlinJT, SmithSM. 2005. Investigations into resting-state connectivity using independent component analysis. Philos Trans R Soc Lond Ser B Biol Sci, 360:1001–1013.
4.
BellAJ, SejnowskiTJ. 1997. The “independent components” of natural scenes are edge filters. Vision Res, 37:3327–3338.
5.
BiswalB, MennesM, ZuoX, GohelS, KellyAet al.2010. Toward discovery science of human brain function. Proc Natl Acad Sci U S A, 107:4734–4739.
6.
BiswalB, YetkinF, HaughtonV. 1995. Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magn Reson, 537–541.
7.
BroydSJ, DemanueleC, DebenerS, HelpsSK, JamesCJ, Sonuga-BarkeEJS. 2009. Default-mode brain dysfunction in mental disorders: a systematic review. Neurosci Biobehav Rev, 33:279–296.
8.
CabezaR, LocantoreJK, AndersonND. 2003. Lateralization of prefrontal activity during episodic memory retrieval: evidence for the production-monitoring hypothesis. J Cogn Neurosci, 15:249–259.
9.
CalhounV, AdaliT, PearlsonG. 2001. A method for making group inferences from functional MRI data using independent component analysis. Hum Brain Mapp, 151:140–151.
10.
CalhounVD, KiehlKA, PearlsonGD. 2008a. Modulation of temporally coherent brain networks estimated using ICA at rest and during cognitive tasks. Hum Brain Mapp, 29:828–838.
11.
CalhounVD, MaciejewskiPK, PearlsonGD, KiehlKA. 2008b. Temporal lobe and “default” hemodynamic brain modes discriminate between schizophrenia and bipolar disorder. Human Brain Mapp, 29:1265–1275.
ColeDM, SmithSM, BeckmannCF. 2010. Advances and pitfalls in the analysis and interpretation of resting-state FMRI data. Front Syst Neurosci, 4:8.
14.
CoxRW. 1996. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res, 29:162–173.
15.
DamoiseauxJS, GreiciusMD. 2009. Greater than the sum of its parts: a review of studies combining structural connectivity and resting-state functional connectivity. Brain Struct Funct, 213:525–533.
16.
DamoiseauxJS, RomboutsSARB, BarkhofF, ScheltensP, StamCJ, SmithSM, BeckmannCF. 2006. Consistent resting-state networks across healthy subjects. Proc Natl Acad Sci U S A, 103:13848–13853.
17.
De LucaM, BeckmannCF, De StefanoN, MatthewsPM, SmithSM. 2006. fMRI resting state networks define distinct modes of long-distance interactions in the human brain. NeuroImage, 29:1359–1367.
18.
DijkKR, Van, SabuncuMR, BucknerRL. 2012. The influence of head motion on intrinsic functional connectivity MRI. NeuroImage, 59:431–438.
19.
ErhardtEB, RachakondaS, BedrickEJ, AllenEA, AdaliT, CalhounVD. 2010. Comparison of multi-subject ICA methods for analysis of fMRI data. Hum Brain Mapp, 2095:2075–2095.
20.
FilippiniN, MacIntoshBJ, HoughMG, GoodwinGM, FrisoniGB, SmithSM, MatthewsPM, BeckmannCF, MackayCE. 2009. Distinct patterns of brain activity in young carriers of the APOE-epsilon4 allele. Proc Natl Acad Sci U S A, 106:7209–7214.
21.
FoxM, SnyderA, VincentJ, CorbettaM, Van EssenDC, RaichleME. 2005. The human brain is intrinsically organized into dynamic, anticorrelated functional networks. PNAS, 102:9673–9678.
22.
FoxMD, RaichleME. 2007. Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging. Nat Rev Neurosci, 8:700–711.
HimbergJ, HyvärinenA, EspositoF. 2004. Validating the independent components of neuroimaging time series via clustering and visualization. NeuroImage, 22:1214–1222.
26.
HoneyC, SpornsO, CammounL, GigandetX, ThiranJP, MeuliR, HagmannP. 2009. Predicting human resting-state functional connectivity from structural connectivity. Proc Natl Acad Sci U S A, 106:2035.
27.
KimDI, ManoachDS, MathalonDH, TurnerJA, MannellM, BrownGG, FordJM, GollubRL, WhiteT, WibleC, BelgerA, BockholtHJ, ClarkVP, LaurielloJ, O'LearyD, MuellerBA, LimKO, AndreasenN, PotkinSG, CalhounVD. 2009. Dysregulation of working memory and default-mode networks in schizophrenia using independent component analysis, an fBIRN and MCIC study. Hum Brain Mapp, 30:3795–3811.
28.
KiviniemiV, StarckT, RemesJ, LongX, NikkinenJ, HaapeaM, VeijolaJ, MoilanenI, IsohanniM, ZangY-F, TervonenO. 2009. Functional segmentation of the brain cortex using high model order group PICA. Hum Brain Mapp, 30:3865–3886.
29.
LandisJR, KochGG. 2011. An application of hierarchical among agreement of majority in the assessment statistics multiple observers. Society, 33:363–374.
30.
LaufsH, KleinschmidtA, BeyerleA, EgerE, Salek-HaddadiA, PreibischC, KrakowK. 2003. EEG-correlated fMRI of human alpha activity. NeuroImage, 19:1463–1476.
31.
LiY-O, AdaliT, CalhounVD. 2007. Estimating the number of independent components for functional magnetic resonance imaging data. Hum Brain Mapp, 28:1251–1266.
32.
MannellMV, FrancoAR, CalhounVD, CañiveJM, ThomaRJ, MayerAR. 2010. Resting state and task-induced deactivation: a methodological comparison in patients with schizophrenia and healthy controls. Hum Brain Mapp, 31:424–437.
33.
MarguliesDS, BöttgerJ, LongX, LvY, KellyC, SchäferA, GoldhahnD, AbbushiA, MilhamMP, LohmannG, VillringerA. 2010. Resting developments: a review of fMRI post-processing methodologies for spontaneous brain activity. Magma: New York, N.Y.. 23:289–307.
34.
MayerAR, FrancoAR, LingJ, CañiveJM. 2007. Assessment and quantification of head motion in neuropsychiatric functional imaging research as applied to schizophrenia. J Int Neuropsychol Soci, 839–845.
35.
MurphyK, BirnR, HandwerkerD, JonesT. 2009. The impact of global signal regression on resting state correlations: are anti-correlated networks introduced?Neuroimage, 44:893–905.
36.
Rack-GomerAL, LiauJ, LiuTT. 2009. Caffeine reduces resting-state BOLD functional connectivity in the motor cortex. NeuroImage, 46:56–63.
37.
RaichleM, MacLeodA, SnyderA, PowersW, GusnardD, ShulmanG. 2001. A default mode of brain function. Proc Natl Acad Sci U S A, 98:676–682.
SmithS, JenkinsonM, WoolrichM, BeckmannC, BehrensT, Johansen-BergH, BannisterP, De LucaM, DrobnjakI, FlitneyDE, NiazyR, SaundersJ, VickersJ, ZhangY, De StefanoN, BradyJ, MatthewsP. 2004. Advances in functional and structural MR image analysis and implementation as FSL. NeuroImage, 23,Suppl 1:S208–S219.
43.
SmithSM, FoxPT, MillerKL, GlahnDC, FoxPM, MackayCE, FilippiniN, WatkinsKE, ToroR, LairdAR, BeckmannCF. 2009. Correspondence of the brain's functional architecture during activation and rest. Proc Natl Acad Sci U S A, 106:13040–13045.
44.
SnyderAZ, RaichleME. 2012. A brief history of the resting state: The Washington University perspective. NeuroImage, 62:902–910.
45.
TalairachJ, TournouxP. 1988. Co-Planar Stereotaxic Atlas of the Human Brain: 3-D Proportional System: An Approach to Cerebral Imaging. New York, NY: Thieme Medical Publishers.
Van de VenVG, FormisanoE, PrvulovicD, RoederCH, LindenDEJ. 2004. Functional connectivity as revealed by spatial independent component analysis of fMRI measurements during rest. Hum Brain Mapp, 22:165–178.
48.
Van den HeuvelMP, MandlRCW, KahnRS, Hulshoff PolHE. 2009. Functionally linked resting-state networks reflect the underlying structural connectivity architecture of the human brain. Human Brain Mapp, 30:3127–3141.
49.
Van DijkKRA, HeddenT, VenkataramanA, EvansKC, LazarSW, BucknerRL. 2010. Intrinsic functional connectivity as a tool for human connectomics: theory, properties, and optimization. J Neurophysiol, 103:297–321.
50.
WylieGR, GenovaH, DelucaJ, ChiaravallotiN, SumowskiJF. 2013. Functional magnetic resonance imaging movers and shakers: does subject-movement cause sampling bias?Hum Brain Mapp[Epub ahead of print]10.1002/hbm.22150.
51.
ZuoX-N, Di MartinoA, KellyC, ShehzadZE, GeeDG, KleinDF, CastellanosFX, BiswalBB, MilhamMP. 2010a. The oscillating brain: complex and reliable. NeuroImage, 49:1432–1445.
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
