Incorporation of cognitive screening into the busy primary care will require the development of highly efficient screening tools. We report the convergence validity of a very brief, self-administered, computerized assessment protocol against one of the most extensively used, clinician-administered instruments—the Montreal Cognitive Assessment (MoCA).
Method:
Two hundred six participants (mean age = 67.44, standard deviation [SD] = 11.63) completed the MoCA and the computerized test. Three machine learning algorithms (ie, Support Vector Machine, Random Forest, and Gradient Boosting Trees) were trained to classify participants according to the clinical cutoff score of the MoCA (ie, < 26) from participant performance on 25 features of the computerized test. Analysis employed Synthetic Minority Oversampling TEchnic to correct the sample for class imbalance.
Results:
Gradient Boosting Trees achieved the highest performance (accuracy = 0.81, specificity = 0.88, sensitivity = 0.74, F1 score = 0.79, and area under the curve = 0.81). A subsequent K-means clustering of the prediction features yielded 3 categories that corresponded to the unimpaired (mean = 26.98, SD = 2.35), mildly impaired (mean = 23.58, SD = 3.19), and moderately impaired (mean = 17.24, SD = 4.23) ranges of MoCA score (F = 222.36, P < .00). In addition, compared to the MoCA, the computerized test correlated more strongly with age in unimpaired participants (ie, MoCA ≥26, n = 165), suggesting greater sensitivity to age-related changes in cognitive functioning.
Conclusion:
Future studies should examine ways to improve the sensitivity of the computerized test by expanding the cognitive domains it measures without compromising its efficiency.
Alzheimer’s Association. Alzheimer’s disease facts and figures. Alzheimers Dement. 2015;11(3):332–384.
2.
DaviglusMLBellCCBerrettiniW. National institutes of health state-of-the- science conference statement: preventing Alzheimer disease and cognitive decline. Ann Intern Med. 2010;153(3):176–181.
3.
HampelHFrankRBroichK. Biomarkers for Alzheimer’s disease: academic, industry, and regulatory perspectives. Nat Rev Drug Discov. 2010;9(7):560–574.
4.
ListaSDuboisBHampelH. Paths to Alzheimer’s disease prevention: from modifiable risk factors to biomarker enrichment strategies. J Nutr Health Aging. 2015;19(2):154–163.
5.
ScanlonLO’SheaEO’CaoimhR. Usability and validity of a batter computerized cognitive screening tests for detecting cognitive impairment. Gerontology. 2016;62(2):247–252.
6.
GroberEMowreyWBEhrlichAR. Two-stage screening for early dementia in primary care. J Clin Exp Neuropsychol. 2016;38(9):1038–1049.
7.
ClionskyMClionskyE. Dementia screening: saying no to the USPSTF and yes to brief cognitive evaluation. J Alzheimer’s Dis Parkinsonism. 2014;4(3):e132.
8.
LinzerMBittonATuSP. The end of the 15-20 minute primary care visit. J Gen Intern Med. 2015;30(11):1584–1586.
9.
MoyerVA; US Preventive Services Task Force. Screening for cognitive impairment in older adults: US Preventive Services Task Force recommendation statement. Ann Intern Med. 2014;160(11):791–797.
10.
BellevilleSFouquetCDuchesneSCollinsDLHudonC. Detecting early preclinical Alzheimer’s disease via cognition, neuropsychiatry, and neuroimaging: qualitative review and recommendations for testing. J Alzheimer’s Dis. 2014;42(suppl 4):S375–S382.
11.
de VugtMEVerheyFR. The impact of early dementia diagnosis and intervention on informal caregivers. Prog Neurobiol. 2013;110:54–62.
12.
DuboisBPadovaniAScheltensP. Timely diagnosis for Alzheimer’s disease: a literature review on benefits and challenges. J Alzheimer’s Dis. 2016;49(3):617–631.
13.
GeldmacherDSKirsonNYBirnbaumHG. Implications of early treatment among Medicaid patients with Alzheimer’s disease. J Alzheimer’s Assoc. 2014;10(2):214–224.
14.
SøgaardRSørensenJWaldorffFB. Cost analysis of early psychosocial intervention in Alzheimer’s disease. Dement Geriatr Cognitive Disorders. 2014;37:141–153.
15.
LevyBTsoyEGableS. Developing cognitive markers of Alzheimer’s disease for primary care: Implications for behavioral and global prevention. J Alzheimers Dis. 2016;54(4):1259–1272.
16.
LeiferBP.Early diagnosis of Alzheimer’s disease: clinical and economic benefits. J Am Geriatr Soc. 2003;51(5):S281–S288.
17.
OzakiAUchiyamaMTagayaHOhidaTOgiharaR. The Japanese Centenarian Study: autonomy was associated with health practices as well as physical status. J Am Geriatr Soc2007;55(1):95–101.
18.
NganduTLehtisaloJKivipeltoM. A 2-year multidomain intervention of diet, exercise, cognitive training, and vascular risk monitoring versus control to prevent cognitive decline in at-risk elderly people (FINGER): A randomized controlled trial. Lancet. 2015;385(9984):2255–2263.
MattsonMP. Energy intake and exercise as determinants of brain health and vulnerability to injury and disease. Cell Metab. 2012;16(6):706–722.
21.
MattsonMP. Evolutionary aspects of human exercise—born to run purposefully. Ageing Res Rev. 2012;11(3):347–352.
22.
GardTHölzelBKLazarSW. The potential effects of meditation on age-related cognitive decline: a systematic review. Ann N Y Acad Sci. 2014;1307:89–103.
23.
InnesKESelffeTK. Meditation as therapeutic intervention for adults at risk for Alzheimer’s disease—potential benefits and underlying mechanisms. Front Psychiatry. 2015;5(40):1–9.
24.
AnsteyKJvon SandenCSalimAO’KearneyR. Smoking as a risk factor for dementia and cognitive decline: a meta-analysis of prospective studies. Am J Epidemiol. 2017;166(4):367–378.
25.
GottesmanRFAlbertMSAlonsoA. Associations between midlife vascular risk factors and 25-year incident dementia in the Atherosclerosis Risk in Communities (ARIC) cohort. JAMA Neurol. 2017;74(10):1246–1254.
26.
ProfennoLAPorsteinssonAPFaraoneSV. Meta-analysis of Alzheimer’s disease risk with obesity, diabetes, and related disorders. Biol Psychiatry. 2010;67(6):505–512.
27.
HughesTFGanguliM. Modifiable midlife risk factors for late-life cognitive impairment and dementia. Curr Psychiatry Rev. 2009;5(2):73–92.
28.
LuchtmanDWSongC. Cognitive enhancement by omega-3 fatty acids from childhood to old age: findings from animal and clinical studies. Neuropharmacology. 2013;64:550–565.
29.
LautenschlagerNTCoxKLFlickerLE. Effect of physical activity on cognitive function in older adults at risk for Alzheimer disease. JAMA. 2008;300(9):1027–1037.
30.
WinchesterJDickMBGillenD. Walking stabilizes cognitive functioning in Alzheimer’s disease (AD) across one year. Arch Gerontol Geriatr. 2013;56(1):96–103.
31.
JamesBDWilsonRSBarnesLLBennettDA. Late-life social activity and cognitive decline in old age. J Int Neuropsychol Soc. 2011;17(6):998–1005. doi:10.1017/S1355617711000531.
32.
LevyBGableSTsoyE. Machine learning detection of cognitive impairment in primary care. Alzheimers Dis Dement. 2017;1(2):38–46.
33.
LevyBCelen-DemirtasSSurguladzeTEranioSEllisonJ. Neuropsychological screening as a standard of care during discharge from psychiatric hospitalization: the preliminary psychometrics of the CNS screen. Psychiatry Res. 2014;215(3):790–796.
34.
ReitanRM. Validity of the trail making test as an indicator of organic brain damage. Perceptual Motor Skills. 1958;8(3):271–276.
35.
LezakMDHowiesonDBBiglerED. Neuropsychological Assessment. Oxford, United Kingdom: Oxford University Press; 2012.
36.
Arevalo-RodriguezISmailagicNRoquéIF. Mini-Mental State Examination (MMSE) for the detection of Alzheimer’s disease and other dementias in people with mild cognitive impairment (MCI) (review). Cochrane Database Syst Rev. 2015;(3):1–76.
37.
MitchellAJ. A meta-analysis of the accuracy of the Mini-Mental State Examination in the detection of dementia and mild cognitive impairment. University of York Centre for Reviews and Dissemination. J Psychiatr Res. 2009;43(4):411–431.
38.
TrepaczPTHochstetlerHWangSWalkerBSaykinAJ; Alzheimer’s Disease Neuroimaging Initiative. Relationship between the Montreal Cognitive Assessment and Mini-Mental State Examination for assessment of mild cognitive impairment in older adults. BMC Geriatr. 2015;15:107–116.
39.
NasreddineZSPhillipsNABédirianV. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc2005;53(4):695–699.
40.
DongYSharmaVKChanBP. The Montreal Cognitive Assessment (MoCA) is superior to the Mini-Mental State Examination (MMSE) for the detection of vascular cognitive impairment after acute stroke. J Neurol Sci. 2010;299(1-2):15–18.
41.
SmithTGildehNHolmesC. The Montreal Cognitive Assessment: validity and utility in a memory clinic setting. Can J Psychiatry. 2007;52(5):329–332.
42.
KroenkeKSpitzerRLWilliamsJBLöweB. An ultra-brief screening scale for anxiety and depression: the PHQ-4. Psychosomatics. 2009;50(6):613–621.
