Sage Journals: Discover world-class research

Abstract

Introduction

The COVID-19 pandemic highlighted the potential of digital tools in clinical neuropsychology, prompting a shift from traditional paper-based assessments to digital alternatives. However, research on this topic remains limited. This study evaluates the usability of digital neuropsychological assessment tools and examines healthcare professionals’ perceptions of their reliability and efficiency in clinical settings.

Methods

A cross-sectional observational study was conducted at the Centro Neurolesi “Bonino-Pulejo.” Healthcare professionals, including neuropsychologists and clinicians, were asked to alternate between digital and traditional paper-based assessments. The usability of the digital tools was measured using the System Usability Scale (SUS), while qualitative feedback was gathered through open-ended questions.

Results

A panel of 29 healthcare professionals participated in the study. The quantitative analysis of the SUS scores revealed a mean score of 89.48 (SD = 10.12) for the digital format and 81.38 (SD = 11.49) for the traditional format. A Wilcoxon signed-rank test showed a statistically significant difference between the two conditions (p = 0.0003), indicating that participants found the digital tools to be more usable compared to the traditional assessment format. Key qualitative feedback indicated that participants appreciated the speed, efficiency, and reduced error rates of digital tools, with many noting improvements in data organization and reporting.

Conclusions

Although the study's single-center design, small sample size, and reliance on self-reported measures may limit the generalizability of the findings, the results underscore the high usability and effectiveness of digital neuropsychological assessments. Healthcare professionals reported improved efficiency, accuracy, and data organization, supporting the tool's potential integration into clinical practice. These findings underscore the promise of digital tools in modern neuropsychology, paving the way for future multicentric and longitudinal research to validate their broader applicability.

Keywords

Clinical neuropsychology digital tools health professionals neuropsychological assessments neurorehabilitation usability

Introduction

In recent years, technology has significantly impacted the medical field, extending to clinical neuropsychology, especially as the COVID-19 pandemic highlighted the potential of digital tools in healthcare delivery.¹ This rapid shift pointed out the need to explore digital solutions in neuropsychological assessment, where traditional paper-based tools continue to dominate despite notable limitations. A key limitation of paper-based assessments is their infrequent data collection, providing only a snapshot of cognitive functioning instead of capturing fluctuations over time.^2,3 Traditional assessments overlook real-time factors like fatigue and time of day, which impact cognitive performance.^4,5 Studies indicated that cognitive performance fluctuates throughout the day, with older adults generally performing better in the morning than in the afternoon or evening.^6,7

Additionally, these assessments are often time-consuming, limiting the capacity to assess more patients and contributing to longer wait times.⁸ Human error during scoring and data transcription also poses a risk, potentially affecting result accuracy and diagnostic reliability.⁹ Furthermore, paper-based tests lack adaptive testing capabilities, meaning that test difficulty remains fixed regardless of the participant's performance, unlike digital assessments that can dynamically adjust based on real-time responses.¹⁰ Another significant challenge is data management and storage. Paper records require considerable physical space, are susceptible to loss or damage, and make longitudinal tracking of cognitive changes more difficult. The absence of automated data integration further complicates research applications and clinical follow-ups.¹¹ Given these challenges, the transition to digital assessments represents a promising solution to overcome many of these limitations, offering improved efficiency, accuracy, and accessibility in neuropsychological evaluation. Digital assessments may address some of these issues. Adaptive testing enables shorter, more personalized sessions by adjusting item difficulty based on previous responses, while automated scoring enhances measurement accuracy by minimizing manual errors.^12,13 Digital formats also enable clinicians to conduct group assessments, allowing them to reach more patients within the same timeframe.^14,15 Despite these advantages, digital assessments are not yet widely adopted. A key barrier to their adoption is the perceived usability among healthcare professionals (HCPs), as their acceptance is critical for routine implementation in clinical settings. Although digital cognitive assessments can enhance testing efficiency, accuracy, and accessibility,¹⁶ many neuropsychologists’ express concerns about their reliability and validity compared to traditional methods.¹⁷ To encourage wider adoption, it is essential to ensure that digital tools meet the psychometric standards of traditional assessments. The shift from paper-based to digital neuropsychological tests offers the opportunity to improve efficiency and data collection.¹⁸ However, usability remains a critical factor for successful implementation, digital tools must be intuitive and accessible, ensuring that they measure cognitive abilities rather than users’ proficiency with the technology.¹⁹ Furthermore, HCPs must trust these tools, emphasizing the need for adequate training and support.^20,21 Most existing research has primarily focused on fully remote testing or the development of specific digital tools, often overlooking their practical implementation in clinical settings.^18,22 While studies suggest that digital cognitive assessments can improve testing efficiency, accuracy, and accessibility,¹⁶ concerns persist regarding their validity and reliability compared to traditional methods.¹⁷ Addressing these challenges, this study contributes to an emerging field by evaluating the usability and feasibility of digital neuropsychological tools when administered in person. Given these gaps in the literature, it is essential to investigate how digital neuropsychological assessments perform in real-world clinical settings and how they are perceived by HCPs. Unlike previous research, which has primarily examined fully remote assessments or the implementation of specific digital tests,^22,23 this study focuses on the usability of digitized neuropsychological assessment tools in face-to-face contexts. Additionally, it explores HCPs’ perceptions regarding their reliability, efficiency, and potential for integration into routine clinical workflows.

Methods

Study design and study population

This study is a cross-sectional observational study conducted at the IRCCS Centro Neurolesi “Bonino-Pulejo” from August 2023 to August 2024. The aim was to evaluate the usability and perception of digital neuropsychological assessment tools among HCPs. Written informed consent was obtained from all participating HCPs. The study was conducted in accordance with the Declaration of Helsinki and approved by Institutional Review Board (IRB) and Ethics Committee of IRCCS Centro Neurolesi “Bonino-Pulejo,” Messina, Italy (Ethics Approval ID: 19/2023).

The study included a diverse group of HCPs such as neuropsychologists, physiotherapists, speech therapists, and clinicians involved in cognitive and functional assessments. The inclusion criteria were: (i) a degree in a relevant healthcare field (e.g. psychology, neuropsychology, physiotherapy, speech therapy, or related disciplines); (ii) at least 1 year of experience in administering neuropsychological or functional assessments; (iii) at least basic experience with both digital and paper-based test formats, ensuring an adequate level of familiarity for a comparative evaluation; active engagement in cognitive assessment, rehabilitation, or neuropsychological testing in routine practice. Moreover, the following exclusion criteria were applied: (i) lack of prior exposure to digital neuropsychological assessments, as this could introduce variability in usability perception; (ii) limited clinical experience (i.e. professionals with less than 1 year of practice in neuropsychological or functional assessment); (iii) roles without direct involvement in patient assessment.

Procedure

Before entering the study, all HCPs attended an introductory session with an IT engineer to review the digital system's functionalities and operations. The session served as a brief refresher rather than a formal training, minimizing potential bias in usability perceptions. During the 1-year study, HCPs alternated between digital and paper-based formats for the neuropsychological assessments most used in their practice (see table 1). Both formats were integrated into routine clinical assessments, allowing HCPs to gain practical experience with digital tools while maintaining the traditional paper method as a reference.

Table 1.

Test/scale in digital format.

Test	Acronym	Description
12-item short form survey²⁰	SF-12	a self-reported outcome measure assessing the impact of health on an individual's everyday life
36-item short form survey²⁴	SF-36	an outcome measure instrument that is often used, well-researched, self-reported measure of health
Beck Depression Inventory – II²⁵	BDI-II	is a widely used 21-item self-report inventory measuring the severity of depression in adolescents and adults
Brain Injurj Sexuality Questionnaire²⁶	BIQS	a measurement tool for future traumatic brain injury sexuality research
Brief Repeatable Battery of Neuropsychological Tests in Multiple Sclerosis²⁷	BRB-NT	a sensitive measure of cognitive impairment in multiple sclerosis patients
Body Uneasiness Test²⁸	BUT	a valuable tool for the screening and the clinical assessment of abnormal body image attitudes and eating disorders
Box & Block Test²⁹	BBT	measures unilateral gross manual dexterity
Caregiver Burden Inventory³⁰	CBI	a questionnaire that aims to evaluate the specific aspects of the caregiver's burden
Child Behavior Checklist For Ages 1.5–5³¹	CBCL 1.5–5	a questionnaire that assesses a broad range of emotional and behavioral problems in children, versions for preschool (for ages 1.5–5) children
Child Behavior Checklist For Ages 6–18³¹	CBCL 6–18	a questionnaire that assesses a broad range of emotional and behavioral problems in children, versions for school-age (for ages 6–18) children
Composite Autonomic Symptom Score³²	COMPASS-31	is a validated self-assessment instrument designed for clinical autonomic research and practice
Conners 3³³		assesses cognitive, behavioral, and emotional problems, with a focus on ADHD and comorbid disorders
Coping Orientation To Problems Experienced³⁴	COPE	is a self-report questionnaire designed to measure effective and ineffective ways to cope with a stressful life event
Disability Of The Arm, Shoulder And Hand³⁵	DASH	asks about your symptoms as well asyour ability to perform certain activities
Douleur Neuropathique³⁶	DN4	a simple tool to screen for neuropathic pain
Dyadic Trust Scale³⁷	DTS	an instrument that assesses dyadic trust in fraternal relationships
Dyadic Adjustment Scale³⁸	DAS	is a measure designed to assess the relationship quality of intact (married or cohabiting) couples
Edinburgh Handedness Inventory³⁹		is a measurement scale used to assess the dominance of a person's right or left hand in everyday activities
Emotional Quotient Inventory⁴⁰	EQ	a self-report tool that assesses emotional intelligence across domains such as self-perception, and interpersonal skills
Family Relationships Index⁴¹	FRI	a self-report measure that provides an overall index of the quality of the family environment
Female Sexual Function Index⁴²	FSFI	a self-report questionnaire designed to measure sexual functioning in women
Franchay Activities Index⁴³	FAI	a measure of instrumental activities of daily living for use with patients recovering from stroke
Fugl-Meyer⁴⁴	FMA	a stroke-specific, performance-based impairment index
Goal Attainment Scale⁴⁵	GAS	a method of scoring the extent to which a patient's individual goals are achieved in the course of intervention in a standardized way as to allow statistical analysis
Hamilton Anxiety Rating Scale⁴⁶	HAM-A	a psychological questionnaire used by clinicians to rate the severity of a patient's anxiety
Hamilton Depression Rating Scale⁴⁷	HAM-D	a multiple-item questionnaire used to indicate depression
Hospital Anxiety And Depression Scale⁴⁸	HADS	a standardized questionnaire capable of identifying states of anxiety and depression in patients affected by organic diseases
Intrinsic Motivation Inventory⁴⁹	IMI	a multidimensional measurement used in assessing the subjective experiences of participants when developing an activity
International Index Of Erectile Function Questionnaire (5 Items)⁵⁰	IIEF-5	a multidimensional scale that can be used to evaluate the most relevant aspects of male sexual function (5 items)
Modified Barthel Index⁵¹		a well-established patient-centered to evaluate the functional status of patients at admission and discharge
Motricity Index⁵²	MI	an ordinal method of measuring limb strength
Non-Motor Symptoms Scale For Parkinson's Disease⁵³	NMSS	a scale to assess a wide range of non-motor symptoms in patients with Parkinson's disease
Parkinson's Disease Questionnaire⁵⁴	PDQ-39	a self-report questionnaire, which assesses Parkinson's disease-specific health related quality over the last month
Personality Inventory For DSM-5-SF⁵⁵	PID-5	a measure designed to assess dysfunctional personality
Perth Alexithymia Questionnaire⁵⁶	PAQ	a self-report measure of alexithymia
Post-Stroke Depression Rating Scale⁵⁷	PSDRS	a tool for the evaluation of early symptoms of depression in patients in the first week after cerebral stroke
Psychological Well-Being Scale⁵⁸	PWBS	a self-assessment questionnaire divided into six scales representing the dimensions of psychological well-being
Quality Of Life In Autism⁵⁹	QoLA	a validated measure of QoL for parents of autistic children
Personal Meaning Organization Assessment Questionnaire⁶⁰	QSP	a questionnaire for the evaluation of the interaction between parents and children on the development of the child
Repetitive Behaviors Scale – Revised⁶¹	RBS-R	a self-report questionnaire that is used to measure the breadth of repetitive behavior in children and adolescents with Autism Spectrum disorders
Scoring Forms For Multiple Sclerosis Quality Of Life⁶²	MSQOL-54	a battery providing a quality of life measure that is both generic and MS-specific
Semmes-Weinstein Monofilament Test⁶³	SWMT	is used to assess the threshold stimulus necessary for perception of light touch to deep pressure
Sexual Motivation Scale⁶⁴	SEXMS	measures the different types of motivation proposed by self-determination theory (SDT) and their associations to positive and negative sexual outcomes
Short Sensory Profile⁶⁵	SSP	a tool to identify the sensory profile of children and adolescents
Social Dominance Orientation-7 Scale⁶⁶	SDO-7	a measure of an individual's preference for hierarchy within any social system and the domination over lower-status groups
State-Trait Anxiety Inventory⁶⁷	STAI	a psychological inventory, it measures two types of anxiety – state anxiety and trait anxiety
Strengths And Difficulties Questionnaire⁶⁸	SDQ	a brief emotional and behavioral screening questionnaire for children and young people
System Usability Scale⁶⁸	SUS	a questionnaire-based method to assess the usability of a system or product through a series of standardized questions
Toronto Alexithymia Scale⁶⁹	TAS-20	a self-administered questionnaire that measures difficulty in identifying and describing emotions
World Health Organization Quality Of Life Brief Version⁷⁰	WHOQOL-26	a brief assessment of quality of life in large epidemiological studies and clinical trials where quality of life is of interest. In addition, the WHOQOL-BREF may be of use to health professionals in the assessment and evaluation of treatment efficacy
Youth Self-Report For Ages 11–18³¹	CBCL SELF REPORT	a widely used child-report measure that assesses problem behaviors along two “broadband scales”: Internalizing and Externalizing

The digitalization process involved Microsoft Forms, part of the Microsoft Office Suite, which was used to convert the paper-based assessment tools into an interactive digital format. The scoring of responses was conducted using Microsoft Excel, ensuring automated calculation and data organization while maintaining consistency with standard clinical scoring procedures. The digital tools used in this study were adapted from existing standardized neuropsychological assessments to ensure consistency with traditional formats. While Microsoft Forms was utilized for digitization, the structure, scoring criteria, and administration procedures remained aligned with their validated paper-based counterparts. These tools were not independently pre-validated but were designed to adhere to established clinical protocols.

At the end of the study period, a comprehensive evaluation was conducted to assess HCPs’ experiences and perceptions of both formats, focusing on usability factors such as ease of use, time efficiency, and perceived reliability. HCPs completed a detailed feedback questionnaire, facilitating a direct comparison of usability and perception between the digital and traditional formats.

Outcome measures

Usability and perception were assessed via a customized questionnaire completed by HCPs at the end of the study. The questionnaire included items on ease of use, efficiency, and reliability, with responses rated on a Likert scale ranging from “Strongly Agree” to “Strongly Disagree.” Additionally, open-ended questions allowed participants to provide qualitative feedback, capturing in-depth perspectives on both digital and traditional formats. The System Usability Scale (SUS) developed by Brooke, is a quick and reliable method for assessing the usability of design solutions.⁶⁸ In the present paper was also administered to quantify the usability of the digital format.

Statistical analysis

The statistical analysis for this study was conducted using Jamovi (Jamovi Project).⁷¹ The demographic variables were represented using descriptive statistics, with continuous variables, such as age, reported as means and standard deviations, while categorical variables, such as gender distribution, educational background, and profession, were presented as percentages. For quantitative analysis, SUS scores were assessed using non-parametric methods due to the small sample size and the non-normal distribution of data. Normality was tested using the Shapiro–Wilk test, which confirmed a non-normal distribution. Consequently, a Wilcoxon signed-rank test was used to compare the median usability scores with the reference value, with a significance level set at p < 0.05.

Additionally, a qualitative analysis was conducted on open-ended responses regarding participants’ experiences with the digital format. This involved a thematic analysis, a method used to systematically identify, analyze, and report patterns (themes) within qualitative data, as described by Braun and Clarke.⁷² The analysis aimed to uncover key themes related to usability, such as speed and efficiency, error reduction, and data organization.

Results

In this study, a total of 29 participants were included. The majority of the sample consisted of women (93.1%), while men accounted for only 6.9%. The mean age of the participant was 34 years, with a standard deviation of 6.93 years. Regarding educational background, 48.3% of the sample held a postgraduate specialization, while 10.3% were in internship or postgraduate training. In terms of profession, the largest group was composed of health researcher psychologists, representing 41.67% of the sample, while there was only one physiotherapist health researcher, accounting for 4.17% of the total sample. The second largest group consisted of psychology research trainees, who represented 25% of the participants. Both speech therapists and neuropsychomotor therapists constituted 8.33% each. Finally, professional research collaborators made up 4.17% of the sample. These results indicate a diverse range of skills among the HCPs involved in the study.

The quantitative analysis of the SUS scores revealed a mean score of 89.48 (SD = 10.12) for the digital format and 81.38 (SD = 11.49) for the traditional format. A Wilcoxon signed-rank test showed a statistically significant difference between the two conditions (W = 22.5, p = 0.0003), indicating that participants found the digital tools to be more usable compared to the traditional assessment format. For more details see Figure 1.

Figure 1.

Comparison of SUS scores between traditional and digital tools. The bar graph illustrates the mean SUS scores for traditional (orange) and digital (blue) assessment tools.

In addition to the quantitative findings, qualitative feedback from participants highlighted several key themes. The main themes that emerged, along with the corresponding percentages of participants mentioning each theme, are: speed and efficiency, with 65% of participants highlighting the time savings during administration and result processing; error reduction, with 52% of participants appreciating the increased reliability of the results due to automated scoring and reduced human errors; and data organization, which was seen as a key advantage by 48% of participants, as digital data are easier to manage, store, and retrieve for further analysis. Additionally, a theme related to the ease of use of digital tools emerged, with 38% of participants finding the devices easy to use after a brief familiarization period.

These themes indicate strong acceptance of the digital format, suggesting that participants perceived significant improvements over traditional methods in terms of efficiency, accuracy, and ease of use. The responses were coded and categorized in a way that provides a clear understanding of the perceived benefits, which supports the quantitative results and points toward a potential direction for the future adoption of these tools.

Discussion

The results of this study demonstrate a high level of usability for digital neuropsychological assessment tools, as indicated by SUS scores. The mean SUS score suggests that HCPs found the digital format effective and intuitive. Previous research has shown that usability is a critical factor in the adoption of digital tools in clinical settings, as it directly influences clinicians’ satisfaction and their willingness to integrate new technologies into their practice.^73,74 Qualitative feedback from participants further highlighted the perceived benefits of digital tools, particularly in terms of speed and efficiency. Many respondents noted significant time savings during assessments, corroborating the findings of other studies highlighting the efficiency of digital formats in clinical workflows.⁷⁵ For example, the shift to digital assessments significantly reduced the time required for patient assessments, which in turn enabled HCPs to effectively manage larger workloads.

In addition to time savings, participants also reported that digital tools enhanced the consistency of assessments.⁷⁶ The reduction in errors reported by participants aligns with existing literature, which highlights the increased accuracy associated with digital assessments.⁷⁷ Standardized prompts and automated scoring reduce variability across assessments, minimize human error in data entry and interpretation, and improve patient data reliability.^78,79 This consistency is particularly valuable in neuropsychology, where standardized assessment protocols contribute to more accurate diagnoses and treatment plans, ultimately enhancing continuity of care.⁸⁰ Furthermore, the data organization mentioned by participants is supported by research indicating that digital systems improve data management capabilities, allowing for easier retrieval and analysis of patient information. As healthcare becomes increasingly data-driven, integrating digital assessment tools can improve clinical decision-making and patient outcomes.⁸¹

Recent studies have increasingly focused on the usability and feasibility of digital neuropsychological assessments. For instance, Um Din et al.⁸² developed a supervised, tablet-based version of a cognitive and manual dexterity tests on a digital tablet to screen people with cognitive impairment. The authors demonstrated high system acceptance among older adults, despite low familiarity with technology. Similarly, Polk et al.²² evaluated remote and unsupervised cognitive assessment tools in preclinical AD samples. They reported positive usability ratings and found that remote assessments showed good construct validity with traditional neuropsychological tests.²² Moreover, baseline memory performance assessed digitally was associated with future cognitive decline, indicating the potential of such tools for monitoring Alzheimer's disease progression.⁸³ Our study systematically evaluated the usability of digitized versions of standardized neuropsychological tests administered in person, an approach that has received limited investigation. By assessing the perceptions of HCPs who routinely use these tools, our research provides insights into their practical applicability and integration into clinical workflows.⁸⁴ This combination of quantitative and qualitative approaches offers a comprehensive understanding of usability, efficiency, and potential barriers to adoption in real-world settings.⁸⁵ Collectively, these studies, including ours, highlighted the growing evidence supporting the usability and validity of digital neuropsychological assessments across various populations and settings.¹⁸ Therefore, the clinical implications of this study are significant, as they highlight the potential benefits of integrating digital assessments into routine practice. By improving usability, these tools can improve workflow efficiency, reduce errors, and ultimately lead to better patient outcomes.^18,22 Healthcare organizations should consider investing in training and support to facilitate the transition to digital formats.⁸⁶ Additionally, ongoing evaluations of usability and effectiveness are essential to ensure that these tools continue to meet the needs of both healthcare providers and patients.⁸⁷

Strengths, limitations, and future perspectives

Previous research on digital neuropsychological assessments has primarily focused on fully remote testing or developing specific digital tools, often neglecting their practical implementation in clinical settings.^22,23 Our study addresses this gap by evaluating the usability of digitalized versions of in-person standardized neuropsychological tests, an approach that has received little attention. Additionally, we assessed the perceptions of HCPs who regularly use these tools, providing insights into their practical applicability and integration into clinical workflows. By combining quantitative and qualitative approaches, this study offers a comprehensive understanding of usability, efficiency, and potential barriers to adoption in real-world settings.

Despite these contributions, several limitations must be acknowledged. Although informative, the sample of 29 participants may not fully capture the diversity of HCPs using digital assessment tools. Additionally, the monocentric design limited the ability to conduct statistically robust subgroup analyses across different professional categories. However, the inclusion of a wide range of professionals ensured a broad assessment of usability perceptions. Future research should expand the sample size across more institutions to allow for a more detailed assessment of interprofessional differences. A larger, multicenter study could provide more generalizable results, accounting for institutional and geographical differences in digital tool adoption and usability perceptions. Such studies could also explore whether usability perceptions vary across healthcare settings with different levels of technological infrastructure.

Another limitation is the gender distribution, as 93.1% of participants were female, which may impact the generalizability of the findings. Additionally, the reliance on self-report measures introduces potential biases, such as social desirability bias or overestimation of usability. The study also did not include a patient-centered assessment, which is critical to understanding the broader impact of digital tools on clinical outcomes and patient experience. Moreover, the cross-sectional design captures only a snapshot of usability perceptions at one point in time, preventing an analysis of how these perceptions evolve with increased exposure. This study does not extensively address barriers to adoption, such as cost, training, and accessibility, key factors influencing digital assessment implementation. Cost remains a key barrier, as some digital neuropsychological tools require expensive licensing fees or specialized hardware, which may not be feasible for all institutions. Additionally, training requirements must be considered, while digital tools can streamline assessment workflows, their effectiveness depends on adequate clinician training to ensure accurate administration and interpretation. Finally, infrastructure disparities across institutions may affect accessibility, with some facilities lacking the necessary technological resources to implement digital assessments seamlessly. Future studies should focus on identifying and addressing these challenges to facilitate seamless integration into routine workflows.

Finally, a potential limitation of this study is that participants had prior exposure to digital tools, as required by the inclusion criteria. While this ensured that usability evaluations were not confounded by a complete lack of digital familiarity, it may limit the generalizability of the findings to professionals without previous experience with digital neuropsychological assessments. Future studies should include clinicians with varying levels of digital proficiency to assess whether usability perceptions differ based on prior exposure. This would provide insights into potential barriers to adoption for individuals less experienced with digital tools and inform tailored training strategies.

Despite these limitations, our findings provide an important foundation for further research and clinical advances in digital neuropsychological assessments. Increasing sample size and diversity across multiple institutions will improve the generalizability of the findings. At the same time, longitudinal studies could provide deeper insights into how perceptions of usability change over time with repeated use. Incorporating patient perspectives would also offer a more holistic assessment of the impact of digital tools on neuropsychological care. Finally, identifying cost-effective implementation strategies, improving training protocols, and enhancing accessibility could help in optimizing the adoption of digital tools in clinical practice. Finally, because all participants had prior experience with digital tools as part of the inclusion criteria, this study was unable to assess how different levels of digital proficiency influence perceptions of usability. Future research should include participants with different levels of digital familiarity to explore potential differences in user experience and adoption.

Conclusions

In conclusion, this study highlights the promising potential of digital neuropsychological assessment tools to enhance clinical practice. With a high SUS score, HCPs found these tools effective and intuitive, demonstrating their readiness to integrate digital technologies into their workflow. This aligns with previous research highlighting that usability is critical for the successful integration of digital tools in healthcare settings, influencing both clinician satisfaction and technology adoption.

The study also shows significant time savings, with digital tools enabling quicker assessments and allowing clinicians to manage larger caseloads, which supports findings from other studies on the efficiency of digital formats.

Moreover, the consistency and accuracy of assessments were enhanced, with fewer errors reported by participants, which is crucial for neuropsychological evaluations.

Digital tools help standardize processes, reduce human error, and improve data reliability, contributing to more accurate diagnoses and treatment plans.

Additionally, the improved organization of patient data facilitates better decision-making and patient outcomes.

Future research should focus on multicenter validation studies to ensure that these findings are generalizable across diverse clinical settings. Investigating longitudinal usability perceptions will also be crucial to assess whether clinicians’ acceptance of digital tools changes over time as they gain more experience. Furthermore, patient-centered evaluations should complement clinician perspectives to explore how digital assessments impact patient engagement, adherence, and clinical outcomes. Integrating digital assessments into routine practice can improve efficiency, reduce errors, and enhance patient care. To maximize their benefits, healthcare organizations should prioritize training and support programs, ensuring a smooth transition to digital workflows while continuously evaluating usability to meet evolving clinical needs.

Footnotes

ORCID iDs

Maria Grazia Maggio

Fabio Mauro Giambò

Martina Barbera

Paolo De Pasquale

Francesca Bruno

Andrea Calderone

Angelo Quartarone

Amelia Rizzo

Rocco Salvatore Calabrò

Ethics considerations

The studies were conducted in compliance with local legislation and institutional requirements. Participants provided written informed consent to participate in the study. Written informed consent was also obtained from the individuals for the publication of any potentially identifiable images or data included in this article.

Author contributions/CRediT

Conceptualization, methodology, and writing—original draft preparation were done by FMG, MGM; software was done by FMG, PDP; validation was done by MGM, AR; formal analysis and data curation were done by FMG, MGM, PDP; investigation was done by FMG, MGM, AQ, RSC; resources was done by AR, MB, FB; writing—review and editing was done by MGM, AR, MB, FB, RSC; visualization and supervision were done by AQ, RSC; project administration was done by FMF, MGM, AR, PDP, AQ, RSC. All authors have read and agreed to the published version of the manuscript.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Current Research Funds, 2025, Ministry of Health, Italy.

Conflicting interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Data availability

The data supporting the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.

References

Libon

Baliga

Swenson

, et al. Digital neuropsychological assessment: new technology for measuring subtle neuropsychological behavior. J Alzheimers Dis 2021; 82: 1–4.

Matar

Shine

Halliday

, et al. Cognitive fluctuations in Lewy body dementia: towards a pathophysiological framework. Brain 2020; 143: 31–46.

Naglieri

Drasgow

Schmit

, et al. Psychological testing on the internet: new problems, old issues. Am Psychol 2004; 59: 150–162.

Donovan

Ellis

Cole

, et al. Reducing time to complete neuropsychological assessments within a memory assessment service and evaluating the wider impact. BMJ Open Qual 2020; 9: e000767.

Walters

Lesk

. Time of day and caffeine influence some neuropsychological tests in the elderly. Psychol Assess 2015; 27: 161–168.

Wilks

Aschenbrenner

Gordon

, et al. Sharper in the morning: cognitive time of day effects revealed with high-frequency smartphone testing. J Clin Exp Neuropsychol 2021; 43: 825–837.

Bell

Dodd

Jeavons

, et al. The impact of a walnut-rich breakfast on cognitive performance and brain activity throughout the day in healthy young adults: a crossover intervention trial. Food Funct 2025; 16: 1696–1707.

Gibbons

Weiss

Kupfer

, et al. Using computerized adaptive testing to reduce the burden of mental health assessment. Psychiatr Serv 2008; 59: 361–368.

Garza

Williams

Ounpraseuth

, et al. Error rates of data processing methods in clinical research: a systematic review and meta-analysis of manuscripts identified through PubMed. Int J Med Inform 2025; 195: 105749.

10.

Burr

Gale

Kisielewska

, et al. A narrative review of adaptive testing and its application to medical education. MedEdPublish (2016) 2023; 13: 21.

11.

Al Kez

Foley

Laverty

, et al. Exploring the sustainability challenges facing digitalization and internet data centers. J Cleaner Prod 2022; 371: 133633.

12.

Sternin

Burns

Owen

. Thirty-five years of computerized cognitive assessment of aging-where are we now? Diagnostics (Basel) 2019; 9: 14.

13.

Nicosia

Wang

Aschenbrenner

, et al.

To BYOD or not: are device latencies important for bring-your-own-device (BYOD) smartphone cognitive testing?

Behav Res Methods 2023; 55: 2800–2812.

14.

Harris

Tang

Birnbaum

, et al. Digital neuropsychology beyond computerized cognitive assessment: applications of novel digital technologies. Arch Clin Neuropsychol 2024; 39: 290–304.

15.

Caze

Dorsman

Carlew

, et al. Can you hear me now? Telephone-based teleneuropsychology improves utilization rates in underserved populations. Arch Clin Neuropsychol 2020/; 35: 1234–1239.

16.

Schmand

. Why are neuropsychologists so reluctant to embrace modern assessment techniques? Clin Neuropsychol 2019; 33: 209–219.

17.

Parsons

Gardner

Sherman

, et al. Feasibility and acceptance of direct-to-home tele-neuropsychology services during the COVID-19 pandemic. J Int Neuropsychol Soc 2022; 28: 210–215.

18.

Lunardini

Luperto

Romeo

, et al. Supervised digital neuropsychological tests for cognitive decline in older adults: usability and clinical validity study. JMIR Mhealth Uhealth 2020; 8: e17963.

19.

Spreij

Gosselt

Visser-Meily

JMA

, et al. The journey is just as important as the destination-digital neuropsychological assessment provides performance stability measures in patients with acquired brain injury. PLoS One 2021; 16: e0249886.

20.

Ware

Kosinski

Keller

. A 12-item short-form health survey: construction of scales and preliminary tests of reliability and validity. Med Care 1996; 34: 220–233.

21.

Wang

Thielen

De Preter

, et al. Encouraging digital technology in neuropsychology: the theory of visual attention on tablet devices. Arch Clin Neuropsychol 2021; 36: 1450–1464.

22.

Polk

Öhman

Hassenstab

, et al. A scoping review of remote and unsupervised digital cognitive assessments in preclinical Alzheimer’s disease. medRxiv. 2024;2024.09.25.24314349.

23.

Baykara

Kuhn

Linz

, et al. Validation of a digital, tablet-based version of the trail making test in the Δelta platform. Eur J Neurosci 2022; 55: 461–467.

24.

Ware

Sherbourne

. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care 1992; 30: 473–483.

25.

Beck

Steer

Ranieri

. Scale for suicide ideation: psychometric properties of a self-report version. J Clin Psychol 1988; 44: 499–505.

26.

Stolwyk

Downing

Taffe

, et al. Assessment of sexuality following traumatic brain injury: validation of the brain injury questionnaire of sexuality. J Head Trauma Rehabil 2013; 28: 164–170.

27.

Boringa

Lazeron

Reuling

, et al. The brief repeatable battery of neuropsychological tests: normative values allow application in multiple sclerosis clinical practice. Mult Scler 2001; 7: 263–267.

28.

Cuzzolaro

Vetrone

Marano

, et al. The body uneasiness test (BUT): development and validation of a new body image assessment scale. Eat Weight Disord 2006; 11: 1–13.

29.

Mathiowetz

Volland

Kashman

, et al. Adult norms for the box and block test of manual dexterity. Am J Occup Ther 1985; 39: 386–391.

30.

Novak

Guest

. Application of a multidimensional caregiver burden inventory. Gerontologist 1989; 29: 798–803.

31.

Achenbach

. Child behavior checklist. In: Kreutzer

DeLuca

Caplan

(eds) Encyclopedia of clinical neuropsychology [internet]. New York, NY: Springer, 2011 [cited 2025 Feb 14], pp.546–552. Available from: https://doi.org/10.1007/978-0-387-79948-3_1529.

32.

Greco

Di Gennaro

D’Amato

, et al. Validation of the composite autonomic symptom score 31 (COMPASS 31) for the assessment of symptoms of autonomic neuropathy in people with diabetes. Diabet Med 2017; 34: 834–838.

33.

Izzo

Donati

Novello

, et al. The conners 3-short forms: evaluating the adequacy of brief versions to assess ADHD symptoms and related problems. Clin Child Psychol Psychiatry 2019; 24: 791–808.

34.

Sica

Magni

Ghisi

, et al. Coping orientation to the problems experiences-new Italian version (COPE-NVI). Psicoterapia Cognitiva e Comportamentale 2008; 14: 27–53.

35.

Hudak

Amadio

Bombardier

. Development of an upper extremity outcome measure: the DASH (disabilities of the arm, shoulder and hand) [corrected]. the upper extremity collaborative group (UECG). Am J Ind Med. 1996; 29: 602–608.

36.

Bouhassira

Attal

Alchaar

, et al. Comparison of pain syndromes associated with nervous or somatic lesions and development of a new neuropathic pain diagnostic questionnaire (DN4). Pain 2005; 114: 29–36.

37.

Larzelere

Huston

. The dyadic trust scale: toward understanding interpersonal trust in close relationships. J Marriage Fam 1980; 42: 595–604.

38.

Spanier

. Measuring dyadic adjustment: new scales for assessing the quality of marriage and similar dyads. J Marriage Fam 1976; 38: 15.

39.

Oldfield

. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 1971; 9: 97–113.

40.

Lawrence

Shaw

Baker

, et al. Measuring empathy: reliability and validity of the empathy quotient. Psychol Med 2004; 34: 911–919.

41.

Holahan

Moos

. The quality of social support: measures of family and work relationships. Br J Clin Psychol 1983; 22: 157–162.

42.

Rosen

Brown

Heiman

, et al. The female sexual function Index (FSFI): a multidimensional self-report instrument for the assessment of female sexual function. J Sex Marital Ther 2000; 26: 191–208.

43.

Holbrook

Skilbeck

. An activities index for use with stroke patients. Age Ageing 1983; 12: 166–170.

44.

Fugl-Meyer

Jääskö

Leyman

, et al. The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. Scand J Rehabil Med 1975; 7: 13–31.

45.

Kiresuk

Sherman

. Goal attainment scaling: a general method for evaluating comprehensive community mental health programs. Community Ment Health J 1968; 4: 443–453.

46.

Hamilton

. The assessment of anxiety states by rating. Br J Med Psychol 1959; 32: 50–55.

47.

Hamilton

. A rating scale for depression. J Neurol Neurosurg Psychiatry 1960; 23: 56–62.

48.

Zigmond

Snaith

. The hospital anxiety and depression scale. Acta Psychiatr Scand 1983; 67: 361–370.

49.

Markland

Hardy

. On the factorial and construct validity of the intrinsic motivation inventory: conceptual and operational concerns. Res Q Exerc Sport 1997; 68: 20–32.

50.

Rosen

Cappelleri

Smith

, et al. Development and evaluation of an abridged, 5-item version of the international Index of erectile function (IIEF-5) as a diagnostic tool for erectile dysfunction. Int J Impot Res 1999; 11: 319–326.

51.

Shah

Vanclay

Cooper

. Improving the sensitivity of the Barthel Index for stroke rehabilitation. J Clin Epidemiol 1989; 42: 703–709.

52.

Collin

Wade

. Assessing motor impairment after stroke: a pilot reliability study. J Neurol Neurosurg Psychiatry 1990; 53: 576–579.

53.

Chaudhuri

Martinez-Martin

Schapira

AHV

, et al. International multicenter pilot study of the first comprehensive self-completed nonmotor symptoms questionnaire for Parkinson’s disease: the NMSQuest study. Mov Disord 2006; 21: 916–923.

54.

Jenkinson

Fitzpatrick

Peto

, et al. The Parkinson’s disease questionnaire (PDQ-39): development and validation of a Parkinson’s disease summary index score. Age Ageing 1997; 26: 353–357.

55.

Krueger

Derringer

Markon

, et al. Initial construction of a maladaptive personality trait model and inventory for DSM-5. Psychol Med 2012; 42: 1879–1890.

56.

Preece

Mehta

Petrova

, et al. The perth alexithymia questionnaire-short form (PAQ-S): a 6-item measure of alexithymia. J Affect Disord 2023; 325: 493–501.

57.

Gainotti

Azzoni

Marra

. Frequency, phenomenology and anatomical-clinical correlates of major post-stroke depression. Br J Psychiatry 1999; 175: 163–167.

58.

Ryff

. Happiness is everything, or is it? Explorations on the meaning of psychological well-being. J Pers Soc Psychol 1989; 57: 1069–1081.

59.

Eapen

Crnčec

Walter

, et al. Conceptualisation and development of a quality of life measure for parents of children with autism spectrum disorder. Autism Res Treat 2014; 2014: 160783.

60.

Picardi

Mannino

. Le organizzazioni di significato personale: verso una validazione empirica. Riv Psichiatr 2001; 36: 224–233.

61.

Bodfish

Symons

Parker

, et al. Varieties of repetitive behavior in autism: comparisons to mental retardation. J Autism Dev Disord 2000; 30: 237–243.

62.

Vickrey

Hays

Harooni

, et al. A health-related quality of life measure for multiple sclerosis. Qual Life Res 1995; 4: 187–206.

63.

Weinstein

. Fifty years of somatosensory research: from the semmes-weinstein monofilaments to the weinstein enhanced sensory test. J Hand Ther 1993; 6: 11–22. discussion 50.

64.

Cooper

Shapiro

Powers

. Motivations for sex and risky sexual behavior among adolescents and young adults: a functional perspective. J Pers Soc Psychol 1998; 75: 1528–1558.

65.

Dunn

. Sensory profile. San Antonio, TX Psychological Corporation.—References—Scientific Research Publishing [Internet]. [cited 2025 Feb 14]. Available from: https://www.scirp.org/reference/referencespapers?referenceid=380145. 1999.

66.

Sidanius

Kteily

, et al. The nature of social dominance orientation: theorizing and measuring preferences for intergroup inequality using the new SDO₇ scale. J Pers Soc Psychol 2015; 109: 1003–1028.

67.

Skapinakis

. Spielberger state-trait anxiety inventory. In: Michalos

(eds) Encyclopedia of quality of life and well-being research [internet]. Dordrecht: Springer Netherlands, 2014 [cited 2025 Feb 14], pp.6261–6264. Available from: https://doi.org/10.1007/978-94-007-0753-5_2825.

68.

Goodman

. The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry 1997; 38: 581–586.

69.

Bagby

Parker

Taylor

. The twenty-item Toronto alexithymia scale–I. Item selection and cross-validation of the factor structure. J Psychosom Res 1994; 38: 23–32.

70.

Development of the world health organization WHOQOL-BREF quality of life assessment. The WHOQOL group. Psychol Med 1998; 28: 551–558.

71.

jamovi—open statistical software for the desktop and cloud [Internet]. [cited 2025 Feb 14]. Available from: https://www.jamovi.org/

72.

Braun

Clarke

. Using thematic analysis in psychology. Qual Res Psychol 2006; 3: 77–101.

73.

Munro Cullum

Hynan

Grosch

, et al. Teleneuropsychology: evidence for video teleconference-based neuropsychological assessment. J Int Neuropsychol Soc 2014; 20: 1028–1033.

74.

Brearly

Shura

Martindale

, et al. Neuropsychological test administration by videoconference: a systematic review and meta-analysis. Neuropsychol Rev 2017; 27: 174–186.

75.

Fox-Fuller

Rizer

Andersen

, et al. Survey findings about the experiences, challenges, and practical advice/solutions regarding teleneuropsychological assessment in adults. Arch Clin Neuropsychol 2022; 37: 274–291.

76.

Wadsworth

Galusha-Glasscock

Womack

, et al. Remote neuropsychological assessment in rural American Indians with and without cognitive impairment. Arch Clin Neuropsychol 2016; 31: 420–425.

77.

Lacritz

Carlew

Livingstone

, et al. Patient satisfaction with telephone neuropsychological assessment. Arch Clin Neuropsychol 2020; 35: 1240–1248.

78.

Marra

Hamlet

Bauer

, et al. Validity of teleneuropsychology for older adults in response to COVID-19: a systematic and critical review. Clin Neuropsychol 2020; 34: 1411–1452.

79.

Zanin

Aiello

Diana

, et al. Tele-neuropsychological assessment tools in Italy: a systematic review on psychometric properties and usability. Neurol Sci 2022; 43: 125–138.

80.

Hildebrand

Chow

Williams

, et al. Feasibility of neuropsychological testing of older adults via videoconference: implications for assessing the capacity for independent living. J Telemed Telecare 2004; 10: 130–134.

81.

(PDF) New and Emerging Risk Factors in Occupational Health [Internet]. [cited 2025 Feb 14]. Available from: https://www.researchgate.net/publication/346974841_New_and_Emerging_Risk_Factors_in_Occupational_Health

82.

Um Din

Maronnat

Le Boterff

, et al. Contribution of a tablet-based tests to the diagnosis of neurocognitive disorders in older adults: a feasibility study. Stud Health Technol Inform 2024; 316: 1163–1164.

83.

Berron

Olsson

Andersson

, et al. Remote and unsupervised digital memory assessments can reliably detect cognitive impairment in Alzheimer’s disease. Alzheimers Dement 2024; 20: 4775–4791.

84.

Wosny

Strasser

Hastings

. Experience of health care professionals using digital tools in the hospital: qualitative systematic review. JMIR Hum Factors 2023; 10: e50357.

85.

Ahmed

Pereira

Jane

. Mixed Methods Research: Combining both qualitative and quantitative approaches. 2024.

86.

Stoumpos

Kitsios

Talias

. Digital transformation in healthcare: technology acceptance and its applications. Int J Environ Res Public Health 2023; 20: 3407.

87.

Maqbool

Herold

. Potential effectiveness and efficiency issues in usability evaluation within digital health: a systematic literature review. J Syst Softw 2023; 208: 111881.

Moving toward the digitalization of neuropsychological tests: An exploratory study on usability and operator perception

Abstract

Introduction

Methods

Results

Conclusions

Keywords

Introduction

Methods

Study design and study population

Procedure

Outcome measures

Statistical analysis

Results

Discussion

Strengths, limitations, and future perspectives

Conclusions

Footnotes

ORCID iDs

Ethics considerations

Author contributions/CRediT

Funding

Conflicting interests

Data availability

References