Cognitive impairments post-stroke are common. Assessment of cognition typically involves pen-and-paper tasks, which are often reliant on linguistic and motor function, creating barriers for many stroke survivors. The characteristics of stroke survivors excluded from cognitive assessments have never been investigated.
Aims
(1) To determine if the stroke samples included in studies evaluating clinimetric properties of cognitive assessments represent the stroke population, (2) to identify the different modes of cognitive assessments, and (3) to ascertain whether the different modes of cognitive assessments influence the stroke samples used in the studies.
Summary of review
We systematically reviewed studies that evaluated at least one clinimetric property of a cognitive assessment in adult stroke survivors from January 2000 to October 2013. Eligibility criteria, reasons for drop-outs and missing data were extracted. A theming process was employed to synthesize the data. From the initial yield of 3731 articles, 109 were included. Six broad categories describing reasons for exclusion were identified. Cognitive impairments were the most common (68%), then communication issues (62%), endurance problems (42%), sensory loss (39%), psychiatric illness (38%) and motor limitations (27%). The most prevalent assessment mode was pen-and-paper (73%), then virtual reality (11%), computer (6%), observational functional performance (5%), informant (3%) and telephone (3%). Regardless of mode, issues with cognition and communication were the most frequently used exclusion criteria.
Conclusions
Our findings indicate that cognitive assessments are not tested in representative stroke samples. Research is needed to identify valid and reliable cognitive assessments that are feasible in a wider range of stroke survivors.
LindénTSkoogIFagerbergBSteenBBlomstrandC. Cognitive impairment and dementia 20 months after stroke. Neuroepidemiology2004; 23: 45–52.
2.
ÖnesKYalçinkayaEYTokluBCÇaglarN. Effects of age, gender, and cognitive, functional and motor status on functional outcomes of stroke rehabilitation. Neurorehabilitation2009; 25: 241–9.
3.
KihunCWanheeL. Cognitive factors associated with activities of daily living in post-stroke patients. J Phys Ther Sci2012; 24: 779–82.
4.
WangYCKapelluschJGargA. Important factors influencing the return to work after stroke. Work2014; 47: 553–9.
5.
NarasimhaluKAngSDe SilvaDA. The prognostic effects of poststroke cognitive impairment no dementia and domain-specific cognitive impairments in nondisabled ischemic stroke patients. Stroke2011; 42: 883–8.
6.
PatelMDCoshallCRuddAGWolfeCD. Cognitive impairment after stroke: Clinical determinants and its associations with long-term stroke outcomes. J Am Geriatr Soc2002; 50: 700–6.
7.
MelkasSOksalaNKJJokinenH. Poststroke dementia predicts poor survival in long-term follow-up: Influence of prestroke cognitive decline and previous stroke. J Neurol Neurosurg Psychiatry2009; 80: 865.
8.
HachinskiVKalariaRNVintersHV. National Institute of Neurological Disorders and Stroke-Canadian Stroke Network vascular cognitive impairment harmonization standards. Stroke2006; 37: 2220–41.
9.
BodeRKHeinemannAWSemikPMallinsonT. Relative importance of rehabilitation therapy characteristics on functional outcomes for persons with stroke. Stroke2004; 35: 2537–42.
10.
FrankelTPennCOrmond-BrownD. Executive dysfunction as an explanatory basis for conversation symptoms of aphasia: A pilot study. Aphasiology2007; 21: 814–28.
LeesRFearonPHarrisonJKBroomfieldNMQuinnTJ. Cognitive and mood assessment in stroke research: Focused review of contemporary studies. Stroke2012; 43: 1678–80.
13.
EngelterSTGostynskiMPapaS. Epidemiology of aphasia attributable to first ischemic stroke: Incidence, severity, fluency, etiology, and thrombolysis. Stroke2006; 37: 1379–84.
14.
BroeksJGLankhorstGJRumpingKPrevoAJ. The long-term outcome of arm function after stroke: Results of a follow-up study. Disabil Rehabil1999; 21: 357–64.
15.
AlvanRF. An additional basic science for clinical medicine: IV. The development of clinimetrics. Ann Intern Med1983; 99: 843.
16.
CummingTBBrodtmannADarbyDBernhardtJ. Cutting a long story short: Reaction times in acute stroke are associated with longer term cognitive outcomes. J Neurol Sci2012; 322: 102–6.
17.
ShopinLShenhar-TsarfatySAssayagBen E. Cognitive assessment in proximity to acute ischemic stroke/transient ischemic attack: Comparison of the Montreal Cognitive Assessment test and Mind-Streams Computerized Cognitive Assessment battery. Dement Geriatr Cogn Disord2013; 36: 36–42.
18.
BuxbaumLJDawsonAMLinsleyD. Reliability and validity of the Virtual Reality Lateralized Attention Test in assessing hemispatial neglect in right-hemisphere stroke. Neuropsychology2012; 26: 430–41.
19.
CederfeldtMWidellYAnderssonEEDahlin-IvanoffSGosman-HedströmG. Concurrent validity of the Executive Function Performance Test in people with mild stroke. Br J Occup Ther2011; 74: 443–9.
20.
LamYSManDWTamSFWeissPL. Virtual reality training for stroke rehabilitation. Neurorehabilitation2006; 21: 245–53.
21.
MoherDLiberatiATetzlaffJAltmanDG. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. Ann Intern Med2009; 151: 264–9.
22.
BoyatzisRE. Transforming Qualitative Information: Thematic Analysis and Code Development. Thousand Oaks, CA, Sage Publications, 1998.
23.
BaileyMJRiddochMJCromeP. Evaluation of a test battery for hemineglect in elderly stroke patients for use by therapists in clinical practice. Neurorehabilitation2000; 14: 139–50.
24.
ChenH-CKohC-LHsiehC-LHsuehIP. Test of Everyday Attention in patients with chronic stroke: Test–retest reliability and practice effects. Brain Inj2013; 27: 1148–54.
25.
de KoningIDippelDWJvan KootenFKoudstaalPJ. A short screening instrument for poststroke dementia: The R-CAMCOG. Stroke2000; 31: 1502–8.
26.
LeedsLMearaRJWoodsRHobsonJP. A comparison of the new executive functioning domains of the CAMCOG-R with existing tests of executive function in elderly stroke survivors. Age Ageing2001; 30: 251–4.
27.
PendleburySTMarizJBullLMehtaZRothwellPM. MoCA, ACE-R, and MMSE versus the National Institute of Neurological Disorders and Stroke-Canadian Stroke Network Vascular Cognitive Impairment Harmonization Standards Neuropsychological Battery after TIA and stroke. Stroke2012; 43: 464–9.
28.
HargraveDDNuppJMEricksonRJ. Two brief measures of executive function in the prediction of driving ability after acquired brain injury. Neuropsychol2012; 22: 489–500.
29.
ChibaYHagaN. Analysing non-motor bias in unilateral neglect with a new variant of the line bisection task. Brain Inj2008; 22: 952–9.
30.
LeibovitchFSVasquezBPEbertPLBeresfordKLBlackSE. A short bedside battery for visuoconstructive hemispatial neglect: Sunny-brook Neglect Assessment Procedure (SNAP). J Clin Exp Neuropsychol2012; 34: 359–68.
31.
MattingleyJBBerberovicNCorbenLSlavinMJNichollsMEBradshawJL. The greyscales task: A perceptual measure of attentional bias following unilateral hemispheric damage. Neuropsychologia2004; 42: 387–94.
32.
WoodsAJMarkVW. Convergent validity of executive organization measures on cancellation. J Clin Exp Neuropsychol2007; 29: 719–23.
33.
ThommessenBThoresenGEBautz-HolterELaakeK. Validity of the aphasia item from the Scandinavian Stroke Scale. Cerebrovasc Dis2002; 13: 184–6.
34.
MastBTMacNeillSELichtenbergPA. Clinical utility of the Normative Studies Research Project Test battery among vascular dementia patients. Clin Neuropsychol2000; 14: 173–80.
35.
McKinneyMBlakeHTreeceKALincolnNBPlayfordEDGladmanJRF. Evaluation of cognitive assessment in stroke rehabilitation. Clin Rehabil2002; 16: 129–36.
36.
WendelKRisbergJPessah-RasmussenHStahlAIwarssonS. Long-term cognitive functional limitations post stroke: Objective assessment compared with self-evaluations and spouse reports. Int J Rehabil Res2008; 31: 231–9.
37.
WeissPLNavehYKatzN. Design and testing of a virtual environment to train stroke patients with unilateral spatial neglect to cross a street safely. Occup Ther Int2003; 10: 39–55.
38.
RandDKatzNWeissPL. Evaluation of virtual shopping in the VMall: Comparison of post-stroke participants to healthy control groups. Disabil Rehabil2007; 29: 1710–9.
39.
MazerBLSoferSKorner-BitenskyNGelinasI. Use of the UFOV to evaluate and retrain visual attention skills in clients with stroke: A pilot study. Am J Occup Ther2001; 55: 552–7.
40.
GeorgeSClarkMCrottyM. Validation of the Visual Recognition Slide Test with stroke: A component of the New South Wales occupational therapy off-road driver rehabilitation program. Aust Occup Ther J2008; 55: 172–9.
41.
BaumCMConnorLTMorrisonTHahnMDromerickAWEdwardsDF. Reliability, validity, and clinical utility of the Executive Function Performance Test: A measure of executive function in a sample of people with stroke. Am J Occup Ther2008; 62: 446–55.
42.
WolfTJStiftSConnorLTBaumC. Feasibility of using the EFPT to detect executive function deficits at the acute stage of stroke. Work2010; 36: 405–12.
43.
Wolf TJ, Stift S, Connor LT, Baum C, Cognitive Rehabilitation Research Group. Feasibility of using the EFPT to detect executive function deficits at the acute stage of stroke. Work2010; 36: 405–12.
44.
CederfeldtMGosman-HedstromGSavborgMTarkowskiE. Influence of cognition on personal activities of daily living (P-ADL) in the acute phase: The Gothenburg Cognitive Stroke Study in Elderly. Arch Gerontol Geriatr2009; 49: 118–22.
45.
MaromBJarusTJosmanN. The relationship between the assessment of motor and process skills (AMPS) and the large Allen cognitive level (LACL) test in clients with stroke. Phys Occup Ther Geriatr2006; 24: 33–50.
46.
Cuberos-UrbanoGCaracuelAVilar-LopezRValls-SerranoCBatemanAVerdejo-GarciaA. Ecological validity of the Multiple Errands Test using predictive models of dysexecutive problems in everyday life. J Clin Exp Neuropsychol2013; 35: 329–36.
47.
AbenLKesselMADuivenvoordenHJ. Metamemory and memory test performance in stroke patients. Neuropsychol Rehabil2009; 19: 742–53.
48.
BarberMStottDJ. Validity of the Telephone Interview for Cognitive Status (TICS) in post-stroke subjects. Int J Geriatr Psychiatry2004; 19: 75–9.
49.
MakiNIkedaMHokoishiK. Validity of the Short-Memory Questionnaire in vascular dementia. Int J Geriatr Psychiatry2000; 15: 1143–6.
50.
HigginsonCIJohnson-GreeneDLangrallS. Neurocognitive predictors of performance on a telephone task following stroke. J Clin Exp Neuropsychol2010; 32: 528–35.
51.
PendleburySTWelchSJVCuthbertsonFCMarizJMehtaZRothwellPM. Telephone assessment of cognition after transient ischemic attack and stroke: Modified Telephone Interview of Cognitive Status and Telephone Montreal Cognitive Assessment versus face-to-face Montreal Cognitive Assessment and neuropsychological battery. Stroke2013; 44: 227–9.
52.
GavettBECranePKDams-O'ConnorK. Bi-factor analyses of the Brief Test of Adult Cognition by telephone. Neurorehabilitation2013; 32: 253–65.
53.
The National Stroke Foundation. The National Stroke Foundation Clinical Guidelines for Stroke Management. Melbourne, Vic, National Stroke Foundation, 2010.
54.
SIGN. Management of Patients with Stroke: Rehabiliation, Prevention and Management of Complications, and Discharge Planning. A National Clinical Guideline. Edinburgh, Scottish Intercollegiate Guidelines Network, 2010.
55.
Stroke Foundation of New Zealand and New Zealand Guidelines Group. Clinical Guidelines for Stroke Management 2010. Wellington, Stroke Foundation of New Zealand, 2010.
56.
HarrissonJKMcArthurKSQuinnTJ. Assessment scales in stroke: Clinimetric scales in stroke. Clin Interv Aging2013; 8: 201–11.
57.
DekkerJDallmeijerAJLankhorstGJ. Clinimetrics in rehabilitation medicine: Current issues in developing and applying measurement instruments 1. J Rehabil Med2005; 37: 193–201.
58.
SaposnikGCoteRRochonPA. Care and outcomes in patients with ischemic stroke with and without preexisting dementia. Neurology2011; 77: 1664–73.
59.
LiuJZhaoDWangWSunJYLiYJiaYN. [Trends regarding the incidence of recurrent stroke events in Beijing]. Zhonghua Liu Xing Bing Xue Za Zhi2007; 28: 437–40.
60.
KnopmanDSRobertsROGedaYE. Association of prior stroke with cognitive function and cognitive impairment: A population-based study. Arch Neurol2009; 66: 614–9.
61.
FengWHendryRMAdamsRJ. Risk of recurrent stroke, myocardial infarction, or death in hospitalized stroke patients. Neurology2010; 74: 588–93.
62.
HackettMLPicklesK. Part I: Frequency of depression after stroke: An updated systematic review and meta-analysis of observational studies. Int J Stroke2014; 9: 1017–25.
63.
RizzoASKimGJ. A SWOT analysis of the field of virtual reality rehabilitation and therapy. Presence (Camb)2005; 14: 119–46.
64.
LaverKGeorgeSThomasSDeutschJECrottyM. Virtual reality for stroke rehabilitation. Stroke2012; 43: e20–1.
65.
Saposnik G, Levin M, Outcome Research Canada (SORCan) Working Group. Virtual reality in stroke rehabilitation: A meta-analysis and implications for clinicians. Stroke2011; 42: 1380–6.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
