Tele-neuropsychology has already been employed in neurocognitive disorders, however, in Italy, the evidence of its psychometric quality and satisfaction is still limited.
Objective
This study aimed to: (1) evaluate the reliability of a standardized battery of neuropsychological screening and domain-specific tests delivered at home via videoconference to a sample of Italian people with cognitive disorders, compared with traditional face-to-face administration; (2) assess the feasibility and satisfaction about remote administration.
Methods
This crossover study enrolled patients with subjective cognitive disorder, mild neurocognitive disorder, or dementia. All participants performed a brief neuropsychological screening assessment in face-to-face or remote mode. People with milder cognitive disorders (Mini-Mental State Examination ≥ 20) also performed an extended neuropsychological battery. After 15 days, each participant repeated the same assessment in the opposite mode. Finally, participants completed a satisfaction questionnaire.
Results
114 participants were initially enrolled in the study and 100 individuals performed both face-to-face and remote assessments (14 dropouts). All neuropsychological tests showed agreement between the two modes of administration, except for the Digit Span Forward (p = 0.009) and oral-Symbol Digit Modalities Test (p < 0.001). According to Lin's concordance correlation coefficient (LCCCs), tests also showed good or excellent reliability (LCCCs between 0.609 and 0.964); only the Digit Span Backward and the Stroop test showed moderate reliability (LCCCs =0.514–0.441, respectively). Among 100 participants, 65 patients answered the satisfaction questionnaire, declaring high satisfaction for the remote evaluation.
Conclusions
Tele-neuropsychology seems to work with in-home assessments among Italian patients with cognitive disorders and seems to be acceptable to them.
Alzheimer Europe. Dementia in Europe Yearbook 2019: estimating the prevalence of dementia in Europe. Senningerberg, Luxembourg: Alzheimer Europe, 2019.
2.
ColucciLBoscoMFasanaroAM, et al.Alzheimer's disease costs: what we know and what we should take into account. J Alzheimers Dis2014; 42: 1311–1324.
3.
GroschMCGottliebMCCullumCM. Initial practice recommendations for teleneuropsychology. Clin Neuropsychol2011; 25: 1119–1133.
4.
BenaqueAGurruchagaMJAbdelnourC, et al.Dementia care in times of COVID-19: experience at Fundacio ACE in Barcelona, Spain. J Alzheimers Dis2020; 76: 33–40.
5.
AdamsJLMyersTLWaddellEM, et al.Telemedicine: a valuable tool in neurodegenerative diseases. Curr Geriatr Rep2020; 9: 72–81.
6.
CoralloFMarescaGBonannoL, et al.Importance of telemedicine in mild cognitive impairment and Alzheimer disease patients’ population during admission to emergency departments with COVID-19. Medicine (Baltimore)2023; 102: e32934.
7.
HammersDB. Teleneuropsychology and applications of technology. In: BushSSYochimBP (eds) A handbook of geriatric neuropsychology, practice essentials. New York: Routledge, 2022, pp.267–285.
8.
MillerJBBarrWB. The technology crisis in neuropsychology. Arch Clin Neuropsychol2017; 32: 541–554.
9.
BilderRMPostalKSBarisaM, et al.Inter organizational practice committee recommendations/guidance for teleneuropsychology in response to the COVID-19 pandemic. Clin Neuropsychol2020; 34: 1314–1334.
10.
GeddesMRO’ConnellMEFiskJD, et al.Remote cognitive and behavioral assessment: report of the Alzheimer society of Canada task force on dementia care best practices for COVID-19. Alzheimers Dement (Amst)2020; 12: e12111.
11.
PostalKSBilderRMLancaM, et al.Inter organizational practice committee guidance/recommendation for models of care during the novel coronavirus pandemic. Clin Neuropsychol2021; 35: 81–98.
12.
HildebrandRChowHWilliamsC, et al.Feasibility of neuropsychological testing of older adults via videoconference: implications for assessing the capacity for independent living. J Telemed Telecare2004; 10: 130–134.
13.
CullumCMWeinerMFGehrmannHR, et al.Feasibility of telecognitive assessment in dementia. Assessment2006; 13: 385–390.
14.
LohPDonaldsonMFlickerL, et al.Development of a telemedicine protocol for the diagnosis of Alzheimer’s disease. J Telemed Telecare2007; 13: 90–94.
15.
McEachernWKirkAMorganDG, et al.Reliability of the MMSE administered in-person and by telehealth. Can J Neurol Sci2008; 35: 643–646.
16.
CullumCMHynanLSGroschM, et al.Teleneuropsychology: evidence for video teleconference-based neuropsychological assessment. J Int Neuropsychol Soc2014; 20: 1028–1033.
17.
HarrellKMWilkinsSSConnorMK, et al.Telemedicine and the evaluation of cognitive impairment: the additive value of neuropsychological assessment. J Am Med Dir Assoc2014; 15: 600–606.
18.
WadsworthHEGalusha-GlasscockJMWomackKB, et al.Remote neuropsychological assessment in rural American Indians with and without cognitive impairment. Arch Clin Neuropsychol2016; 31: 420–425.
19.
BrearlyTWShuraRDMartindaleSL, et al.Neuropsychological test administration by videoconference: a systematic review and meta-analysis. Neuropsychol Rev2017; 27: 174–186.
20.
LindauerASeelyeALyonsB, et al.Dementia care comes home: patient and caregiver assessment via telemedicine. Gerontologist2017; 57: e85–e93.
21.
WadsworthHEDhimaKWomackKB, et al.Validity of teleneuropsychological assessment in older patients with cognitive disorders. Arch Clin Neuropsychol2018; 33: 1040–1045.
22.
ParikhMGroschMCGrahamLL, et al.Consumer acceptability of brief videoconference-based neuropsychological assessment in older individuals with and without cognitive impairment. Clin Neuropsychol2013; 27: 808–817.
23.
ApplemanERO'ConnorMKBoucherSJ, et al.Teleneuropsychology clinic development and patient satisfaction. Clin Neuropsychol2021; 35: 819–837.
24.
ElbazSCinaliogluKSekhonK, et al.A systematic review of telemedicine for older adults with dementia during COVID-19: an alternative to in-person health services?Front Neurol2021; 14: 761965.
25.
NandaMSharmaR. A review of patient satisfaction and experience with telemedicine: a virtual solution during and beyond COVID-19 pandemic. Telemed J E Health2021; 27: 1325–1331.
26.
ParsonsMWGardnerMMShermanJC, et al.Feasibility and acceptance of direct-to-home tele-neuropsychology services during the COVID-19 pandemic. J Int Neuropsychol Soc2022; 28: 210–215.
27.
SumpterRCamseyEMeldrumS, et al.Remote neuropsychological assessment: acceptability and feasibility of direct-to-home teleneuropsychology methodology during the COVID-19 pandemic. Clin Neuropsychol2023; 37: 432–447.
28.
AngelopoulouEPapachristouNBougeaA, et al.How telemedicine can improve the quality of care for patients with Alzheimer's disease and related dementias? A narrative review. Medicina (Kaunas)2022; 58: 1705.
29.
Martínez-AlcaláCIPliego-PastranaPRosales-LagardeA, et al.Information and communication technologies in the care of the elderly: systematic review of applications aimed at patients with dementia and caregivers. JMIR Rehabil Assist Technol2016; 3: e6.
30.
StraussEShermanEMSSpreenO. Norms selection in neuropsychological assessment. In: StraussEShermanEMSSpreenO (eds) A compendium of neuropsychological tests: administration, norms, and commentary. 3rd edition. Oxford: University Press, 2006, pp.44–54.
31.
ZaninEAielloENDianaL, et al.Tele-neuropsychological assessment tools in Italy: a systematic review on psychometric properties and usability. Neurol Sci2022; 43: 125–138.
32.
MarraDEHamletKMBauerRM, et al.Validity of teleneuropsychology for older adults in response to COVID-19: a systematic and critical review. Clin Neuropsychol2020; 34: 1411–1452.
33.
SperlingSAAchesonSKFox-FullerJ, et al.Tele-neuropsychology: from science to policy to practice. Arch Clin Neuropsychol2024; 39: 227–248.
34.
AlegretMEspinosaAOrtegaG, et al.From face-to-face to home-to-home: validity of a teleneuropsychological battery. J Alzheimers Dis2021; 81: 1541–1553.
35.
BarcellosLFHortonMShaoX, et al.A validation study for remote testing of cognitive function in multiple sclerosis. Mult Scler2021; 27: 795–798.
36.
ChapmanJEGardnerBPonsfordJ, et al.Comparing performance across in-person and videoconference-based administrations of common neuropsychological measures in community-based survivors of stroke. J Int Neuropsychol Soc2021; 27: 697–710.
37.
HarderLHernandezAHagueC, et al.Home-based pediatric teleneuropsychology: a validation study. Arch Clin Neuropsychol2020; 35: 1266–1275.
38.
WorhachJBoduchMZhangB, et al.Remote assessment of pediatric patients with daytime sleepiness and healthy controls: a pilot study of feasibility and reliability. Neurol Open2021; 8: 2329048X–211048064.
39.
BinngDSplonskowskiMJacovaC. Distance assessment for detecting cognitive impairment in older adults: a systematic review of psychometric evidence. Dement Geriatr Cogn Disord2020; 49: 456–470.
40.
HunterMBJenkinsNDolanC, et al.Reliability of telephone and videoconference methods of cognitive assessment in older adults with and without dementia. J Alzheimers Dis2021; 81: 1625–1647.
SalaEGaiaA. Older people’ s use of information and communications technologies in Europe. The Italian case. Autonomie Locali Serv Soc2019; 2: 163–183.
43.
JessenFAmariglioREvan BoxtelM, et al.A conceptual framework for research on subjective cognitive decline in preclinical Alzheimer's disease. Alzheimers Dement2014; 10: 844–852.
44.
MagniEBinettiGBianchettiA, et al.Mini-Mental state examination: a normative study in Italian elderly population. Eur J Neurol1996; 3: 198–202.
45.
KatzTF. A.D.L. Activities of daily living. JAMA1963; 185: 914–919.
46.
LawtonMPBrodyEM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist1969; 9: 179–186.
47.
CarlesimoGACaltagironeCGainottiG. The mental deterioration battery: normative data, diagnostic reliability and qualitative analyses of cognitive impairment. The group for the standardization of the mental deterioration battery. Eur Neurol1996; 36: 378–384.
48.
MonacoMCostaACaltagironeC, et al.Erratum to: forward and backward span for verbal and visuo-spatial data: standardization and normative data from an Italian adult population. Neurol Sci2015; 36: 345–347. Erratum for: Neurol Sci 2013; 34: 749–754.
49.
NocentiniUGiordanoADi VincenzoS, et al.The symbol digit modalities test - oral version: Italian normative data. Funct Neurol2006; 21: 93–96.
50.
AielloENEspositoAGramegnaC, et al.The frontal assessment battery (FAB) and its sub-scales: validation and updated normative data in an Italian population sample. Neurol Sci2022; 43: 979–984. Erratum in: Neurol Sci 2022; 43: 6621. Erratum in: Neurol Sci 2023; 44: 425.
CaffarraPVezzainiGDieciF, et al.A short version of the Stroop test: normative data in an Italian population sample. Nuova Riv Neurol2022; 12: 111–115.
53.
NovelliGPapagnoCCapitaniE, et al.Tre test clinici di ricerca e produzione lessicale. Taratura su soggetti normali. Arch Psicol Neurol Psichiatr1986; 4: 477–506.
54.
SpinnlerHTognoniG. Standardizzazione e taratura italiana di test neuropsicologici. Ital J Neurol Sci1987; 8: 1–120.
55.
CohenJ. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. New York, NY: Routledge Academic, 1988.
56.
LinLI. A concordance correlation coefficient to evaluate reproducibility. Biometrics1989; 45: 255–268.
57.
LinLI. A note on the concordance correlation coefficient. Biometrics2000; 56: 324–325.
58.
AltmanDG. Practical statistics for medical research. New York: Chapman and Hall/CRC, 1990.
59.
BlandJMAltmanDG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet1986; 8: 307–310.
60.
TimpanoFPirrottaFBonannoL, et al.Videoconference-based mini mental state examination: a validation study. Telemed J E Health2013; 19: 931–937.
61.
KimHJhooJHJangJ. The effect of telemedicine on cognitive decline in patients with dementia. J Telemed Telecare2017; 23: 149–154.
62.
CarotenutoAReaRTrainiE, et al.Cognitive assessment of patients with Alzheimer's disease by telemedicine: pilot study. JMIR Ment Health2018; 5: e31.
63.
VaccaroRAglieriVRossiM, et al.Remote testing in Abbiategrasso (RTA): results from a counterbalanced cross-over study on direct-to-home neuropsychology with older adults. Aging Clin Exp Res2023; 35: 699–710.
64.
JacovaCMcGrenereJLeeHS, et al.C-TOC (cognitive testing on computer): investigating the usability and validity of a novel self-administered cognitive assessment tool in aging and early dementia. Alzheimer Dis Assoc Disord2015; 29: 213–221.
65.
LuxtonDDPruittLDOsenbachJE. Best practices for remote psychological assessment via telehealth technologies. Prof Psychol Res Pr2014; 45: 27–35.
66.
BoothTMurrayAMuniz-TerreraG. Are we measuring the same thing? Psychometric and research considerations when adopting new testing modes in the time of COVID-19. Alzheimers Dement2021; 17: 251–254.
67.
GnassounouRDefontainesBDenolleS, et al.Comparison of neuropsychological assessment by videoconference and face to face. J Int Neuropsychol Soc2022; 28: 483–493.
