Validity of an Internet version of the Multiple Sclerosis Neuropsychological Questionnaire

Abstract

Background: Neuropsychological batteries are long and require expertise to administer. For this reason, the Multiple Sclerosis Neuropsychological Questionnaire (MSNQ) was developed as it is quick and easy to complete. The informant version of the scale has proven to be a useful screen for cognitive impairment in multiple sclerosis (MS).

Objective: The objective was to validate an Internet version of the MSNQ.

Methods: The following psychometric data were collected at home over the Internet in 82 MS patients: (a) patient self-report version MSNQ (P-MSNQ), (b) informant version MSNQ (I-MSNQ), and (c) Center for Epidemiological Studies Depression Scale (CES-D). Thereafter patients underwent in-office testing with the Brief Repeatable Battery of Neuropsychological Tests (BRB-N). The sensitivity and specificity of the Internet MSNQ to detect cognitive impairment relative to the BRB-N was determined using receiver operating characteristic (ROC) curve analysis.

Results: Thirty-five percent of the sample was cognitively impaired. The P-MSNQ was correlated with depression and two tests of the BRB-N. The I-MSNQ was correlated with depression and all five tests of the BRB-N. A cut-off score of 26 on the I-MSNQ gave a sensitivity and specificity of 72% and 60% respectively. Test-retest and internal reliability analyses were strong for both the P-MSNQ and I-MSNQ.

Conclusion: This is the first attempt at an Internet validation of the MSNQ. The modest sensitivity and specificity values suggest that further research is needed before either the patient or informant version of the MSNQ can be used for neuropsychological screening purposes over the Internet.

Keywords

multiple sclerosis cognition Internet Multiple Sclerosis Neuropsychological Questionnaire MSNQ

Get full access to this article

View all access options for this article.

References

Rao SM , Leo GJ , Bernardin L. and Unverzagt F. Cognitive dysfunction in multiple sclerosis. I. Frequency, patterns prediction . Neurology 1991; 41: 685-691.

Deluca J. , Chelune GJ , Tulsky DS , Lengenfelder J. and Chiaravalloti ND

Is speed of processing or working memory the primary information processing deficit in multiple sclerosis?

J Clin Exp Neuropsychol 2004; 26: 550-562.

Benedict RH , Cookfair D. , Gavett R. , Gunther M. , Munschauer F. , Garg N. , et al. Validity of the minimal assessment of cognitive function in multiple sclerosis (MACFIMS). J Int Neuropsychol Soc 2006; 12: 549-558.

Benito-León J. , Morales JM and Rivera-Navarro J. Health-related quality of life and its relationship to cognitive and emotional functioning in multiple sclerosis patients. Eur J Neurol 2002; 9: 497-502.

Rao SM , Leo GJ , Ellington L. , Nauertz T. , Bernardin L. and Unverzagt F. Cognitive dysfunction in multiple sclerosis II. Impact on employment and social functioning. Neurology 1991; 41: 692-696.

Kalmar JH , Gaudino EA , Moore NB , Halper J. and Deluca J. The relationship between cognitive deficits and everyday functional activities in multiple sclerosis. Neuropsychology 2008 ; 22: 442-449.

Langdon DW and Thompson AJ Multiple sclerosis: a preliminary study of selected variables affecting rehabilitation outcome. Mult Scler 1999; 5: 94-100.

Hayman-Abello BA , Hayman-Abello SE and Rourke BP Human neuropsychology in Canada: The 1990’s (a review of research by Canadian neuropsychologists conducted over the past decade). Can Psychol 2003; 14: 805-814.

Minden SL , Hoaglin DC , Hadden L. , Frankel D. , Robbins T. and Perloff J. Access to and utilization of neurologists by people with multiple sclerosis . Neurology 2008; 70: 1141-1149.

10.

Kornblith AB , La Rocca NG and Baum HM Employment in individuals with multiple sclerosis . Int J Rehabil Res 1986; 9: 155-165.

11.

Rao SM A manual for the brief, repeatable battery of neuropsychological tests in multiple sclerosis. New York, NY: National Multiple Sclerosis Society, 1991.

12.

Benedict RH , Munschauer F. , Linn R. , Miller C. , Murphy E. , Foley F. , et al. Screening for multiple sclerosis cognitive impairment using a self-administered 15-item questionnaire. Mult Scler 2003; 9: 95-101.

13.

Benedict RH , Cox D. , Thompson LL , Foley F. , Weinstock-Guttman B. and Munschauer F. Reliable screening for neuropsychological impairment in multiple sclerosis. Mult Scler 2004; 10: 675-678.

14.

Vanotti S. , Benedict RH , Acion L. , Cáceres F. and Workgroup VANEM. Validation of the Multiple Sclerosis Neuropsychological Screening Questionnaire in Argentina. Mult Scler 2009; 15: 244-250.

15.

Polman CH , Reingold SC , Edan G. , Filippi M. , Hartung HP , Kappos L. , et al. Diagnostic criteria for multiple sclerosis: 2005 revisions to the ‘‘McDonald Criteria’’. Ann Neurol 2005; 58: 840-846.

16.

Radloff LS The CES-D scale: A self-report depression scale for research in the general population. Appl Psychol Meas 1977; 1: 385-401.

17.

Buschke H. and Fuld PA Evaluating storage, retention, and retrieval in disordered memory and learning . Neurology 1974; 24: 1019-1025.

18.

Rao SM , Hammeke TA , McQuillen MP , Khatri BO and Lloyd D. Memory disturbance in chronic progressive multiple sclerosis. Arch Neurol 1984; 41: 625-631.

19.

Smith A. Symbol digit modalities test: manual. Los Angeles: Western Psychological Services, 1982.

20.

Gronwall DM Paced auditory serial-addition task: a measure of recovery from concussion. Percept Mot Skills 1977; 44: 367-373.

21.

Benton AL and Hamsher KD Multilingual aphasia examination. Iowa City, IA: University of Iowa, 1976.

22.

Grober E. and Sliwinski M. Development and validation of a model for estimating premorbid verbal intelligence in the elderly. J Clin Exp Neuropsychol 1991 ; 13: 933-949.

23.

Altman DG Practical statistics for medical research. London: Chapman & Hall/CRC, 1991.

24.

O’Brien A. , Gaudino-Goering E. , Shawaryn M. , Komaroff E. , Moore NB and DeLuca J. Relationship of the Multiple Sclerosis Neuropsychological Questionnaire (MSNQ) to functional, emotional, and neuropsychological outcomes. Arch Clin Neuropsychol 2007; 22: 933-948.

25.

Beatty WW and Monson N. Metamemory in multiple sclerosis. J Clin Exp Neuropsychol 1991; 13: 309-327.

26.

Chwastiak L. , Ehde DM , Gibbons LE , Sullivan M. , Bowen JD and Kraft GH Depressive symptoms and severity of illness in multiple sclerosis: epidemiologic study of a large community sample. Am J Psychiatry 2002; 159: 1862-1868.

27.

Benedict RH , Fischer JS , Archibald CJ , Arnett PA , Beatty WW , Bobholz J. , et al. Minimal neuropsychological assessment of MS patients: a consensus approach. Clin Neuropsychol 2002; 16: 381-397.