Functional MRI Can Be Highly Reliable,but It Depends on What You Measure: A Commentary on Elliott et al. (2020)

Abstract

Get full access to this article

View all access options for this article.

References

Bland

J. M.

Altman

D. G.

(1996). Measurement error. The BMJ, 312(7047), Article 1654. https://doi.org/10.1136/bmj.312.7047.1654

Cohen

(2020, June 25). Duke University researchers say every brain activity study you’ve ever read is wrong. https://www.fastcompany.com/90520750/duke-university-researchers-say-every-brain-activity-study-youve-ever-read-is-wrong

Cosme

Zeithamova

Stice

Berkman

E. T.

(2020). Multivariate neural signatures for health neuroscience: Assessing spontaneous regulation during food choice. Social Cognitive and Affective Neuroscience, 15(10), 1120–1134. https://doi.org/10.1093/scan/nsaa002

Davis

K. D.

Aghaeepour

Ahn

A. H.

Angst

M. S.

Borsook

Brenton

Burczynski

M. E.

Crean

Edwards

Gaudilliere

Hergenroeder

G. W.

Iadarola

M. J.

Iyengar

Jiang

Kong

J.-T.

Mackey

Saab

C. Y.

Sang

C. N.

Scholz

. . . Pelleymounter

M. A.

(2020). Discovery and validation of biomarkers to aid the development of safe and effective pain therapeutics: Challenges and opportunities. Nature Reviews Neurology, 16, 381–400.

Dinga

Schmaal

Penninx

B. W. J. H.

van Tol

M. J.

Veltman

D. J.

van Velzen

Mennes

van der Wee

N. J. A.

Marquand

A. F.

(2019). Evaluating the evidence for biotypes of depression: Methodological replication and extension of Drysdale et al. (2017). NeuroImage, 22, Article 101796. https://doi.org/10.1016/j.nicl.2019.101796

Drysdale

A. T.

Grosenick

Downar

Dunlop

Mansouri

Meng

Fetcho

R. N.

… Liston

(2017). Resting-state connectivity biomarkers define neurophysiological subtypes of depression. Nature Medicine, 23(1), 28–38.

Dubois

Adolphs

(2016). Building a science of individual differences from fMRI. Trends in Cognitive Sciences, 20(6), 425–443.

Duff

E. P.

Moultrie

van der Vaart

Goksan

Abos

Fitzgibbon

S. P.

Baxter

Wager

T. D.

Slater

(2020). Inferring the infant pain experience: A translational fMRI-based signature study. bioRxiv. https://doi.org/10.1101/2020.04.01.998864

Eklund

Nichols

T. E.

Knutsson

(2016). Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates. Proceedings of the National Academy of Sciences, USA, 113(28), 7900–7905.

10.

Elliott

M. L.

Knodt

A. R.

Ireland

Morris

M. L.

Poulton

Ramrakha

Sison

M. L.

Moffitt

T. E.

Caspi

Hariri

A. R.

(2020). What is the test-retest reliability of common task-functional MRI measures? New empirical evidence and a meta-analysis. Psychological Science, 31(7), 792–806. https://doi.org/10.1177/0956797620916786

11.

FDA-NIH Biomarker Working Group. (2016). BEST (biomarkers, endpoints, and other tools) resource. Food and Drug Administration.

12.

Finn

E. S.

Shen

Scheinost

Rosenberg

M. D.

Huang

Chun

M. M.

Papademetris

Constable

R. T.

(2015). Functional connectome fingerprinting: Identifying individuals using patterns of brain connectivity. Nature Neuroscience, 18(11), 1664–1671.

13.

Geuter

Losin

E. A. R.

Mathieu Roy

Lauren

Schmidt

Krishnan

Koban

Wager

T. D.

Lindquist

M. A.

(2020). Multiple brain networks mediating stimulus–pain relationships in humans. Cerebral Cortex, 30(7), 4204–4219.

14.

Gianaros

P. J.

Kraynak

T. E.

Kuan

D. C.-H.

Gross

J. J.

McRae

Hariri

A. R.

Manuck

S. B.

Rasero

Verstynen

T. D.

(2020). Affective brain patterns as multivariate neural correlates of cardiovascular disease risk. Social Cognitive and Affective Neuroscience, 15(10), 1034–1045. https://doi.org/10.1093/scan/nsaa050

15.

Gianaros

P. J.

Sheu

L. K.

Uyar

Koushik

Jennings

J. R.

Wager

T. D.

Verstynen

T. D.

(2017). A brain phenotype for stressor-evoked blood pressure reactivity. Journal of the American Heart Association, 6(9), Article e006053. https://doi.org/10.1161/JAHA.117.006053

16.

Haxby

J. V.

Gobbini

M. I.

Furey

M. L.

Ishai

Schouten

J. L.

Pietrini

(2001). Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science, 293(5539), 2425–2430.

17.

Hedge

Powell

Sumner

(2018). The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences. Behavior Research Methods, 50(3), 1166–1186.

18.

Jepma

Koban

van Doorn

Jones

Wager

T. D.

(2018). Behavioural and neural evidence for self-reinforcing expectancy effects on pain. Nature Human Behaviour, 2(11), 838–855.

19.

Kamitani

Tong

(2005). Decoding the visual and subjective contents of the human brain. Nature Neuroscience, 8(5), 679–685.

20.

Kragel

P. A.

Kano

Van Oudenhove

H. G.

Dupont

Rubio

Delon-Martin

Bonaz

B. L.

Manuck

S. B.

Gianaros

P. J.

Ceko

Reynolds Losin

E. A.

Woo

C.-W.

Nichols

T. E.

& Wager

T. D

. (2018). Generalizable representations of pain, cognitive control, and negative emotion in medial frontal cortex. Nature Neuroscience, 21(2), 283–289.

21.

Kragel

P. A.

Koban

Barrett

L. F.

Wager

T. D.

(2018). Representation, pattern information, and brain signatures: From neurons to neuroimaging. Neuron, 99(2), 257–273.

22.

Momennejad

Otto

A. R.

Daw

N. D.

Norman

K. A.

(2018). Offline replay supports planning in human reinforcement learning. eLife, 7, Article e32548. https://doi.org/10.7554/elife.32548

23.

Rosenberg

M. D.

Finn

E. S.

Scheinost

Papademetris

Shen

Constable

R. T.

Chun

M. M.

(2016). A neuromarker of sustained attention from whole-brain functional connectivity. Nature Neuroscience, 19(1), 165–171.

24.

Streiner

D. L.

(2003). Starting at the beginning: An introduction to coefficient alpha and internal consistency. Journal of Personality Assessment, 80(1), 99–103.

25.

Vul

Harris

Winkielman

Pashler

(2009). Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition. Perspectives on Psychological Science, 4(3), 274–290. https://doi.org/10.1111/j.1745-6924.2009.01125.x

26.

Wager

T. D.

Atlas

L. Y.

Lindquist

M. A.

Roy

Woo

C.-W.

Kross

(2013). An fMRI-based neurologic signature of physical pain. The New England Journal of Medicine, 368(15), 1388–1397.

27.

Woo

C.-W.

Chang

L. J.

Lindquist

M. A.

Wager

T. D.

(2017). Building better biomarkers: Brain models in translational neuroimaging. Nature Neuroscience, 20(3), 365–377.

28.

Woo

C.-W.

Schmidt

Krishnan

Jepma

Roy

Lindquist

M. A.

Atlas

L. Y.

Wager

T. D.

(2017). Quantifying cerebral contributions to pain beyond nociception. Nature Communications, 8, Article 14211. https://doi.org/10.1038/ncomms14211

29.

Woo

C.-W.

Wager

T. D.

(2016). What reliability can and cannot tell us about pain report and pain neuroimaging. Pain, 157(3), 511–513. https://doi.org/10.1097/j.pain.0000000000000442

30.

Zuo

X. N.

Xing

X. X.

(2014). Test-retest reliabilities of resting-state FMRI measurements in human brain functional connectomics: A systems neuroscience perspective. Neuroscience & Biobehavioral Reviews, 45, 100–118. https://doi.org/10.1016/j.neubiorev.2014.05.009

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

4.32 MB