Evidence-based measurement in multiple sclerosis: the psychometric properties of the physical and psychological dimensions of three quality of life rating scales

Abstract

The selection of measures of quality of life used in clinical trials of multiple sclerosis (MS) should be evidence-based. Head-to -head comparison of measures facilitates the selection of measures. The aim of the study was to compare the psychometric properties of the physical and psychological dimensions in three measures of quality of life to aid choice of the most appropriate scale for use in clinical trials of MS. O ne hundred and twenty-one people with MS (rehabilitation =57; steroids =64) completed a selection of health measures before and after treatment. The psychometric properties of three measures of physical function (MSIS-29 physical, SF-36 physical functioning, FA MS mobility) and three measures of psychological function (MSIS-29 psychological, SF-36 mental health, FA MS emotional well-being) were compared by examining data quality, scaling assumptions, acceptability, reliability, validity and responsiveness. Physical (0.63- 0.71) and psychological (0.70-0.75) scales were substantially correlated indicating they measure related constructs. The MSIS-29 physical and psychological scales satisfied all criteria for internal consistency reliability (physical =0.91; psychological =0.89) and validity. The SF-36 physical scale had a notable floor effect (20%). The FA MS mobility scale had lower reliability (a=0.78) compared to other measures. The MSIS-29 physical (effect size=0.91) and psychological (effect size =0.62) scales were the most responsive. In these three samples, the MSIS-29 had better measurement properties for combined physical and psychological health than the SF-36 and the FA MS.

Keywords

health outcomes measurement multiple sclerosis Multiple Sclerosis Impact Scale (MSIS-29)psychometric methods

Get full access to this article

View all access options for this article.

References

Stewart AL , Ware JR Jr eds. Measuring functioning and well-being: the medical outcomes study approach. Duke University Press: Durham, North Carolina , 1992.

Ware JE Jr , Kosinski MA , Keller SD. SF-36 physical and mental health summary scales: a user’s manual. Boston, Massachusetts: Health Institute, New England Medical Center , 1994.

Pfenning LE , Van der Ploeg HM , Cohen L , Bramsen I , Polman CH , Lankhorst GJ et al. A health-related quality of life questionnaire for multiple sclerosis patients . Acta Neruol Scand 1999; 100: 148-155 .

Hobart JC , Lamping DL , Fitzpatrick R , Riazi A , Thompson AJ. The Multiple Sclerosis Impact Scale (MSIS-29); a new patient-based outcome measure . Brain 2001; 124: 962-973 .

Cella DF , Dineen K , Arnason B , Reder A , Webster KA , Karabatsos G et al. Validation of the functional assessment of multiple sclerosis quality of life instrument . Neurology 1996; 47: 129-139 .

Ware JE Jr. SF-36 Health Survey manual and interpretation guide. Boston, Massachusetts: Nimrod Press , 1993.

Cella DF , Tulsky DS , Gray G , Sarafin B , Linn E , Bonomi A et al. The Functional Assessment of Cancer Therapy (FACT) Scale: development and validation of the general measure . J Clin Oncol 1993; 11: 570-579 .

Hobart JC , Freeman J , Lamping DL , Fitspatrick R , Thompson AJ. The SF-36 in multiple sclerosis: why basic assumptions must be tested . J Neurol Neurosurg Psychiatry 2001; 71: 363-370 .

Hobart JC , Freeman J , Thompson A. Kurtzke scales revisited: the application of psychometric methods to clinical intuition . Brain 2000; 123: 1027-1040 .

10.

McHorney CA , Ware JE Jr , Lu JFR , Sherbourne CD. The MOS 36-Item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions and reliability across diverse patient groups . Med Care 1994; 32: 40-66 .

11.

Likert RA. A technique for the development of attitudes . Arch Psyhol 1932; 140: 5-55 .

12.

Ware JE Jr , Davies-Avery A , Donald CA. Conceptualizationand measurement of health for adults in the health insurance study: Vol. V, general health perceptions. Santa Monica, California: The Rand Corporation , 1978.

13.

Eisen M , Ware JE Jr , Donald CA , Brook RH. Measuring components of children’s health status . Med Care 1979; 17: 902-921 .

14.

Holmes WC , Bix B , Shea JA. SF-20 score and item distributions in a human immunodeficiency virus-seropositive sample . Med Care 1996; 34: 562-569 .

15.

Guilford JP. Psychometric methods, second edition. New York: McGraw-Hill , 1954.

16.

Vickrey BG , Hays RD , Engel J Jr , Spritzerk K , Rogers WH , Rausch R et al. Outcome assessment for epilepsy surgery: the impact of measuring health-related quality of life . Annals of Neurology 1995; 37: 158-166 .

17.

Cronbach LJ. Coefficient alpha and the internal structure of tests . Psychometrika 1951; 16: 297-334 .

18.

Cronbach LJ , Meehl PE. Construct validity in psychological tests . Psychol Bull 1955; 52: 281-302 .

19.

Kazis LE , Anderson JJ , Meenan RF. Effect sizes for interpreting changes in health status . Med Care 1989; 27: S178-S189 .

20.

Cohen J. Statistical power analysis for the behavioural sciences, first edition. Hillside, New Jersey: Lawrence Erlbaum , 1969.

21.

Liang MH , Larson MG , Cullen KE , Schwartz JA. Comparative measurement efficiency and sensitivity of five health status instruments for arthritis research . Arthritis Rheum 1985; 28: 542-547 .

22.

McHorney CA , Tarlov AR.

Individual-patient monitoring in clinical practice: are available health status surveys adequate?

Qual Life Res 1995; 4: 293-307 .

23.

Nunnally JC , Bernstein IH. Psychometric theory, third edition. New York: McGraw-Hill , 1994.

24.

Fischer JS , La Rocca NG , Miller DM , Ritvo PG , Andrews H , Paty D et al. Recent developments in the assessment of quality of life in multiple sclerosis . Mult Scler 1999; 5: 251-259 .

25.

Freeman JA , Hobart JC , Thompson AJ.

Does adding MS-specific items to a generic measure (the SF-36) improve measurement?

Neurology 2001; 57: 68-74 .

26.

Vickrey BG , Hays RD , Harooni R , Myers LW , Ellison GW et al. A health-related quality of life measure for multiple sclerosis . Qual Life Res 1995; 4: 187-206 .

27.

Nunnally JC. Psychometric theory, second edition. NewYork: McGraw-Hill , 1978.

28.

Hobart JC , Lamping DL , Freeman JA , Langdon DW , McLellan DL , Greenwood RJ et al.

Evidence-based measurement-Which disability scale for neurologic rehabilitation?

Neurology 2001; 57: 639-644 .

29.

Rasch G. Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago Press , 1960.

30.

Lord FM , Novick MR. Statistical theories of mental test scores. Reading, Massachusetts: Addison Wesley , 1968.