Predicting cognitive decline from neuropsychiatric symptoms and Alzheimer's disease biomarkers: A machine learning approach to a population-based data

Abstract

Background

The aim of this study was to examine the potential added value of including neuropsychiatric symptoms (NPS) in machine learning (ML) models, along with demographic features and Alzheimer's disease (AD) biomarkers, to predict decline or non-decline in global and domain-specific cognitive scores among community-dwelling older adults.

Objective

To evaluate the impact of adding NPS to AD biomarkers on ML model accuracy in predicting cognitive decline among older adults.

Methods

The study was conducted in the setting of the Mayo Clinic Study of Aging, including participants aged ≥ 50 years with information on demographics (i.e., age, sex, education), NPS (i.e., Neuropsychiatric Inventory Questionnaire; Beck Depression and Anxiety Inventories), at least one AD biomarker (i.e., plasma-, neuroimaging- and/or cerebrospinal fluid [CSF]-derived), and at least 2 repeated neuropsychological assessments. We trained and tested ML models using a stepwise feature addition approach to predict decline versus non-decline in global and domain-specific (i.e., memory, language, visuospatial, and attention/executive function) cognitive scores.

Results

ML models had better performance when NPS were included along with a) neuroimaging biomarkers for predicting decline in global cognition, as well as language and visuospatial skills; b) plasma-derived biomarkers for predicting decline in visuospatial skills; and c) CSF-derived biomarkers for predicting decline in attention/executive function, language, and memory.

Conclusions

NPS, added to ML models including demographic and AD biomarker data, improves prediction of downward trajectories in global and domain-specific cognitive scores among community-dwelling older adults, albeit effect sizes are small. These preliminary findings need to be confirmed by future cohort studies.

Keywords

Alzheimer's disease biomarkers cognitive trajectory machine learning neuropsychiatric symptoms

Get full access to this article

View all access options for this article.

References

Lyketsos

Lopez

Jones

, et al. Prevalence of neuropsychiatric symptoms in dementia and mild cognitive impairment: results from the Cardiovascular Health Study. JAMA 2002; 288: 1475–1483.

Geda

Roberts

Knopman

, et al. Prevalence of neuropsychiatric symptoms in mild cognitive impairment and normal cognitive aging: population-based study. Arch Gen Psychiatry 2008; 65: 1193–1198.

Steinberg

. A social neuroscience perspective on adolescent risk-taking. Dev Rev 2008; 28: 78–106.

Geda

Roberts

Mielke

, et al. Baseline neuropsychiatric symptoms and the risk of incident mild cognitive impairment: a population-based study. Am J Psychiatry 2014; 171: 572–581.

Wilson

Krueger

Arnold

, et al. Loneliness and risk of Alzheimer disease. Arch Gen Psychiatry 2007; 64: 234–240.

Rosenberg

Mielke

Appleby

, et al. The association of neuropsychiatric symptoms in MCI with incident dementia and Alzheimer disease. Am J Geriatr Psychiatry 2013; 21: 685–695.

Palmer

Di Iulio

Varsi

, et al. Neuropsychiatric predictors of progression from amnestic-mild cognitive impairment to Alzheimer’s disease: the role of depression and apathy. J Alzheimers Dis 2010; 20: 175–183.

Pink

Stokin

Bartley

, et al. Neuropsychiatric symptoms, APOE ε4, and the risk of incident dementia: a population-based study. Neurology 2015; 84: 935–943.

Ramakers

IHGB

Visser

Aalten

, et al. Affective symptoms as predictors of Alzheimer’s disease in subjects with mild cognitive impairment: a 10-year follow-up study. Psychol Med 2010; 40: 1193–1201.

10.

Kassem

Ganguli

Yaffe

, et al. Anxiety symptoms and risk of dementia and mild cognitive impairment in the oldest old women. Aging Ment Health 2018; 22: 474–482.

11.

Krell-Roesch

Rakusa

Syrjanen

, et al. Association between CSF biomarkers of Alzheimer’s disease and neuropsychiatric symptoms: Mayo Clinic Study of Aging. Alzheimers Dement 2023; 19: 4498–4506.

12.

Burhanullah

Tschanz

Peters

, et al. Neuropsychiatric symptoms as risk factors for cognitive decline in clinically normal older adults: the Cache County Study. Am J Geriatr Psychiatry 2020; 28: 64–71.

13.

Chiew

Rosa-Neto

, et al. Associations of AT(N) biomarkers with neuropsychiatric symptoms in preclinical Alzheimer’s disease and cognitively unimpaired individuals. Transl Neurodegener 2021; 10: 11.

14.

Pink

Krell-Roesch

Syrjanen

, et al. A longitudinal investigation of Aβ, anxiety, depression, and mild cognitive impairment. Alzheimers Dement 2022; 18: 1824–1831.

15.

Pink

Krell-Roesch

Syrjanen

, et al. Interactions between neuropsychiatric symptoms and Alzheimer’s disease neuroimaging biomarkers in predicting longitudinal cognitive decline. Psychiatr Res Clin Pract 2023; 5: 4–15.

16.

Krell-Roesch

Syrjanen

Vassilaki

, et al. Brain regional glucose metabolism, neuropsychiatric symptoms and the risk of incident mild cognitive impairment: the Mayo Clinic Study of Aging. Am J Geriatr Psychiatry 2021; 29: 179–191.

17.

Chang

C-H

Lin

C-H

Lane

H-Y

. Machine learning and novel biomarkers for the diagnosis of Alzheimer’s disease. Int J Mol Sci 2021; 22: 2761.

18.

Myszczynska

Ojamies

Lacoste

AMB

, et al. Applications of machine learning to diagnosis and treatment of neurodegenerative diseases. Nat Rev Neurol 2020; 16: 440–456.

19.

Falahati

Westman

Simmons

. Multivariate data analysis and machine learning in Alzheimer’s disease with a focus on structural magnetic resonance imaging. J Alzheimers Dis 2014; 41: 685–708.

20.

Meeker

Luckett

Barthélemy

, et al. Comparison of cerebrospinal fluid, plasma and neuroimaging biomarker utility in Alzheimer’s disease. Brain Commun 2024; 6: fcae081.

21.

Shah

Rahman Siddiquee

Krell-Roesch

, et al. Neuropsychiatric symptoms and commonly used biomarkers of Alzheimer’s disease: a literature review from a machine learning perspective. J Alzheimers Dis 2023; 92: 1131–1146.

22.

Gill

Mouches

, et al. Using machine learning to predict dementia from neuropsychiatric symptom and neuroimaging data. J Alzheimers Dis 2020; 75: 277–288.

23.

Roberts

Geda

Knopman

, et al. The Mayo Clinic Study of Aging: design and sampling, participation, baseline measures and sample characteristics. Neuroepidemiology 2008; 30: 58–69.

24.

Kokmen

Smith

Petersen

, et al. The short test of mental status. Correlations with standardized psychometric testing. Arch Neurol 1991; 48: 725–728.

25.

Petersen

. Mild cognitive impairment as a diagnostic entity. J Intern Med 2004; 256: 183–194.

26.

Rey

. L’examen clinique en psychologie. 2e éd. Paris: Presses universitaires de France, 1964.

27.

Wechsler

. WMS-R: Wechsler Memory Scale–Revised: manual. San Antonio: Psychological Corp.: Harcourt Brace Jovanovich, 1987.

28.

Kaplan

Goodglass

Weintraub

. The Boston naming test. 2nd Edition. Philadelphia: Lea & Febiger, 1983.

29.

Lucas

Ivnik

Smith

, et al. Mayo’s older Americans normative studies: category fluency norms. J Clin Exp Neuropsychol 1998; 20: 194–200.

30.

Wechsler

. WAIS-R: manual : Wechsler adult intelligence scale–revised. New York, NY: Harcourt Brace Jovanovich [for] Psychological Corp, 1981.

31.

Reitan

. Validity of the Trail Making Test as an indicator of organic brain damage. Percept Mot Skills 1958; 8: 271–276.

32.

Jack

Wiste

Algeciras-Schimnich

, et al. Predicting amyloid PET and tau PET stages with plasma biomarkers. Brain 2023; 146: 2029–2044.

33.

Bermudez

Graff-Radford

Syrjanen

, et al. Plasma biomarkers for prediction of Alzheimer’s disease neuropathologic change. Acta Neuropathol 2023; 146: 13–29.

34.

Van Harten

Wiste

Weigand

, et al. CSF Biomarkers in Olmsted County. Neurology 2020; 95: e256–e267.

35.

Jack

Wiste

Weigand

, et al. Defining imaging biomarker cut points for brain aging and Alzheimer’s disease. Alzheimers Dement 2017; 13: 205–216.

36.

Landau

Harvey

Madison

, et al. Associations between cognitive, functional, and FDG-PET measures of decline in AD and MCI. Neurobiol Aging 2011; 32: 1207–1218.

37.

Minoshima

Frey

Foster

, et al. Preserved pontine glucose metabolism in Alzheimer disease: a reference region for functional brain image (PET) analysis. J Comput Assist Tomogr 1995; 19: 541–547.

38.

Mielke

Dage

Frank

, et al. Performance of plasma phosphorylated tau 181 and 217 in the community. Nat Med 2022; 28: 1398–1405.

39.

Lowe

Kemp

Jack

, et al. Comparison of 18F-FDG and PiB PET in cognitive impairment. J Nucl Med 2009; 50: 878–886.

40.

Jack

Lowe

Senjem

, et al. 11C Pib and structural MRI provide complementary information in imaging of Alzheimer’s disease and amnestic mild cognitive impairment. Brain 2008; 131: 665–680.

41.

Kaufer

Cummings

Ketchel

, et al. Validation of the NPI-Q, a brief clinical form of the neuropsychiatric inventory. J Neuropsychiatry Clin Neurosci 2000; 12: 233–239.

42.

Beck

Steer

Brown

. BDI-II, Beck depression inventory: manual. Second edition. San Antonio, TX, Boston: Psychological Corp.; Harcourt Brace, 1996.

43.

Beck

Steer

. BAI: Beck Anxiety inventory: manual. San Antonio, TX: Psychological Corp., Harcourt Brace, 1993.

44.

Müller

Guido

. Introduction to machine learning with Python: a guide for data scientists. Sebastopol, CA: O’Reilly Media, Inc., 2016.

45.

Liashchynskyi

. Grid search, random search, genetic algorithm: A big comparison for NAS, http://arxiv.org/abs/1912.06059 (2019, accessed 25 October 2023).

46.

Erickson

Korfiatis

Akkus

, et al. Machine learning for medical imaging. Radiographics 2017; 37: 505–515.

47.

Pepe

Fan

Feng

, et al. The Net Reclassification Index (NRI): a misleading measure of prediction improvement even with independent test data sets. Stat Biosci 2014; 7: 282.

48.

Hilden

Gerds

. A note on the evaluation of novel biomarkers: do not rely on integrated discrimination improvement and net reclassification index. Stat Med 2014; 33: 3405–3414.

49.

Demler

Pencina

D’Agostino

. Misuse of DeLong test to compare AUCs for nested models. Stat Med 2012; 31: 2577–2587.

50.

Mallo

Valladares-Rodriguez

Facal

, et al. Neuropsychiatric symptoms as predictors of conversion from MCI to dementia: a machine learning approach. Int Psychogeriatr 2020; 32: 381–392.

51.

Almgren

Camacho

Hanganu

, et al. Machine learning-based prediction of longitudinal cognitive decline in early Parkinson’s disease using multimodal features. Sci Rep 2023; 13: 13193.

52.

Lundberg

Lee

S-I

. A unified approach to interpreting model predictions. arXiv. DOI: https://doi.org/10.48550/arXiv.1705.07874

53.

Qiu

Joshi

Miller

, et al. Development and validation of an interpretable deep learning framework for Alzheimer’s disease classification. Brain 2020; 143: 1920–1933.

54.

Hüllermeier

Fober

Mernberger

, et al. Inductive bias. In: Dubitzky

Wolkenhauer

Cho

K-H

(eds) Encyclopedia of systems biology. New York, NY: Springer, 2013, pp.1018–1018.

55.

St Sauver

Grossardt

Leibson

, et al. Generalizability of epidemiological findings and public health decisions: an illustration from the Rochester Epidemiology Project. Mayo Clin Proc 2012; 87: 151–160.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.53 MB