Reliability,practice effects,and change indices for Rao’s brief repeatable battery

Abstract

The role of cognitive impairment in multiple sclerosis is now widely recognized. However, there is a dearth of research on variability and practice effects of neuropsychological measures when repeated over time. The objective was to assess reliability and practice effects for Rao’s Brief Repeatable Battery of neurophysiological tests and the Stroop Test, and to provide data for correction for variability and practice effects in serial assessments.In 54 healthy controls (34 women, mean age 38.3 ± 9.1 years, mean education 12.9 ± 3.3 years), the Brief Repeatable Battery and Stroop Test were administered 3 times with an 18-month interval. Reliability was assessed by intraclass correlation coefficient and practice effects by an analysis of variance with Bonferroni’s correction for repeated measures. Test—retest reliability was from adequate to good on the Symbol Digit Modalities Test, the Stroop Test, and the Paced Auditory Serial Addition Test. The great majority of tests showed at least a moderate practice effects. Data for calculation of an individual’s change in cognitive performance for each test of the Brief Repeatable Battery and the Stroop Test were provided. Our results provide relevant information for planning and interpreting longitudinal studies on cognition and cognitive rehabilitation in multiple sclerosis.

Keywords

cognitive impairment multiple sclerosis practice effects reliability

Get full access to this article

View all access options for this article.

References

Amato MP , Zipoli V. , Portaccio E. Cognitive changes in multiple sclerosis. Expert Rev Neurother 2008; 8: 1585-1596.

Sadovnick AD , Jacobs DH MS and cognition and APOE: the ongoing conundrum about biomarkers. Neurology 2008; 70: 164-165.

O’Brien AR , Chiaravalloti N. , Goverover Y. , Deluca J. Evidenced-based cognitive rehabilitation for persons with multiple sclerosis: a review of the literature. Arch Phys Med Rehabil 2008 ; 89: 761-769.

Bornstein RA , Baker GB , Douglass AB Short-term retest reliability of the Halstead-Reitan Battery in a normal sample. J Nerv Ment Dis 1987; 175: 229-232.

Dodrill CB , Troupin AS Effects of repeated administrations of a comprehensive neuropsychological battery among chronic epileptics. J Nerv Ment Dis 1975; 161: 185-190.

Johnson BF , Hoch K. , Johnson J. Variability in psychometric test scores: the importance of the practice effect in patient study design. Prog Neuropsychopharmacol Biol Psychiatry 1991; 15: 625-635.

Uchiyama CL , D’Elia LF , Dellinger AM , et al. Alternate forms of the Auditory-Verbal Learning Test: issues of test comparability, longitudinal reliability, and moderating demographic variables. Arch Clin Neuropsychol 1995; 10: 133-145.

Solari A. , Radice D. , Manneschi L. , Motti L. , Montanari E. The multiple sclerosis functional composite: different practice effects in the three test components. J Neurol Sci 2005 ; 228: 71-74.

Rosti-Otajarvi E. , Hamalainen P. , Koivisto K. , Hokkanen L. The reliability of the MSFC and its components . Acta Neurol Scand 2008; 117: 421-427.

10.

Frerichs RJ , Tuokko HA A comparison of methods for measuring cognitive change in older adults. Arch Clin Neuropsychol 2005; 20: 321-333.

11.

Jacobson NS , Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991; 59: 12-19.

12.

Chelune GJ , Naugle RI , Luders H. , Sedlak J. , Awad IA Individual change after epilepsy surgery: Practice effects and base-rate information . Neuropsychology 1993; 7: 41-52.

13.

Barona A. , Reynolds CR , Chastain RL A demographically based index of premorbid intelligence for the WAIS-R . J Consult Clin Psychol 1984; 52: 885-887.

14.

Rao S. A manual for the Brief Repeatable Battery of neuropsychological tests in multiple sclerosis. Milwaukee, Wisconsin: Medical College of Wisconsin, 1990.

15.

Barbarotto R. , Laiacona M. , Frosio R. , Vecchio M. , Farinato A. , Capitani E. A normative study on visual reaction times and two Stroop colour-word tests. Ital J Neurol Sci 1998; 19: 161-170.

16.

Cohen J. A power primer. Psychol Bull 1992; 112: 155-159.

17.

Amato MP , Portaccio E. , Goretti B. , et al. The Rao’s Brief Repeatable Battery and Stroop Test: normative values with age, education and gender corrections in an Italian population . Mult Scler 2006; 12(6): 787-93.

18.

Benedict RH , Duquin JA , Jurgensen S. , et al. Repeated assessment of neuropsychological deficits in multiple sclerosis using the Symbol Digit Modalities Test and the MS Neuropsychological Screening Questionnaire. Mult Scler 2008; 14: 940-946.

19.

Dikmen SS , Heaton RK , Grant I. , Temkin NR Test-retest reliability and practice effects of expanded Halstead-Reitan Neuropsychological Test Battery. J Int Neuropsychol Soc 1999; 5: 346-356.

20.

Portaccio E. , Goretti B. , Zipoli V. , Siracusa G. , Amato M. A short version of Rao’s Brief Repeatable Battery as a sceening tool for cognitive impairment in multiple sclerosis . Clin Neuropsychol 2009; 23: 268-275.