Test–retest reliability and criterion-related validity of Shih–Hsu test of attention between people with and without schizophrenia

Abstract

Introduction

The “Shih–Hsu Test of Attention” (SHTA) is an iPad-based attention assessment tool developed in recent years by occupational therapists and has acceptable criterion-related validity and high test–retest reliability in preliminary application. This research project explores the criterion-related validity and test–retest reliability of SHTA between people with and without schizophrenia.

Method

The participants were 76 adults with schizophrenia aged 20–64 years, and 66 adults without diagnosed mental illness aged 20–64 years were recruited in this study on a voluntary basis. Each participant was assessed twice. The participants completed both the SHTA and Chu’s Attention Test (CAT) in the first test and the SHTA after 3 weeks.

Findings

Analytical results indicate that the SHTA has satisfactory test–retest reliability (ICC = 0.67) and criterion-related validity (γ = 0.29, p < 0.05*) for adults with schizophrenia and has high test–retest reliability (ICC = 0.90) and criterion-related validity (γ = 0.25, p < 0.05*) for adults without diagnosed mental illness. The MDC% value for the subjects without diagnosed mental illness was 12.1%, indicating acceptable random measurement error.

Conclusion

Our preliminary findings show that the iPad-based attention assessment tool, SHTA, has satisfactory criterion-related validity and test–retest reliability, supporting the future application of SHTA as an attention assessment tool.