Reducing survey burden: feasibility and validity of PROMIS measures in multiple sclerosis

Abstract

Background:

Patient-reported outcomes are important for clinical research and care, yet administering and scoring the questionnaires requires considerable effort and time. The Patient Reported Outcomes Measurement Information System (PROMIS) could considerably reduce administrative obstacles and lessen survey burden for participants.

Objective:

Assess the feasibility and validity of PROMIS, compared to commonly-used legacy measures for multiple sclerosis (MS).

Methods:

In this cross-sectional survey, 133 participants with confirmed MS completed legacy surveys and PROMIS Computerized Adaptive Tests (CATs) for depression, anxiety, pain, fatigue and physical function. We conducted a multi-trait, multi-method analysis and verified results with confirmatory factor analysis.

Results:

The correlations between PROMIS and the corresponding legacy measures were large (0.67 to 0.87). The multi-trait, multi-method criteria were generally well met, providing good evidence of the validity of PROMIS measures. PROMIS surveys asked fewer questions and required substantially less time to complete than the legacy scales.

Conclusions:

Our results provide evidence of the construct validity of PROMIS for use with MS patients. Several aspects of the PROMIS CATs made them an important resource, including: (a) less time was required to complete them; (b) missing data was reduced; and (c) the automatic scoring referenced the general population. Our findings support the use of PROMIS in MS research and may have broader implications for clinical care, as well.

Keywords

Computerized Adaptive Test multiple sclerosis outcome measurement PROMIS self-reporting survey design validation

Get full access to this article

View all access options for this article.

References

Hays

Reeve

. Measurement and Modeling of Health-Related Quality of Life. International encyclopedia of public health. San Diego: Acad; 2008, p. 241–252.

Cella

Riley

Stone

. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. J Clin Epidemiol 2010; 63: 1179–1194.

Polman

Reingold

Banwell

. Diagnostic criteria for multiple sclerosis: 2010 Revisions to the McDonald criteria. Ann Neurol 2011; 69: 292–302.

Beck

Ward

Mendelson

. An inventory for measuring depression. Arch Gen Psychiatry 1961; 4: 561–571.

Spielberger

. Manual for the State-Trait Anxiety Inventory STAI (form Y). Palo Alto, CA: Mind Garden; 1983.

Fisk

Ritvo

Ross

. Measuring the functional impact of fatigue: Initial validation of the fatigue impact scale. Clin Infect Dis 1994;18: S79–83.

Fischer

LaRocca

Miller

. Recent developments in the assessment of quality of life in multiple sclerosis. Mult Scler 1999; 5: 251–259.

Stewart

(ed). Measuring functioning and well-being: The medical outcomes study approach. 1st ed. City: Duke University Press Books, 1991. Durham (North Carolina).

Ware

Jr Sherbourne

. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care 1992; 30: 473–483.

10.

Brazier

Harper

Jones

. Validating the SF-36 health survey questionnaire: New outcome measure for primary care. Brit Med J 1992; 305:160–164.

11.

Rothrock

Hays

Spritzer

. Relative to the general US population, chronic diseases are associated with poorer health-related quality of life as measured by the Patient-Reported Outcomes Measurement Information System (PROMIS). J Clin Epidemiol 2010; 63:1195–1204.

12.

DeWalt

Rothrock

Yount

. Evaluation of item candidates: The PROMIS qualitative item review. Med Care 2007; 45: S12–21.

13.

Liu

Cella

Gershon

. Representativeness of the Patient-Reported Outcomes Measurement Information System Internet panel. J Clin Epidemiol 2010; 63:1169–1178.

14.

Campbell

Fiske

. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull 1959; 56: 81–105.

15.

Cronbach

. Coefficient alpha and the internal structure of tests. Psychometrika 1951; 16: 297–334.

16.

Nunnally

Bernstein

. Psychometric theory. 3rd ed. New York: McGraw-Hill, 1994.

17.

Cohen

West

. Applied multiple regression/correlation analysis for the behavioral sciences. 3rd ed. Mahwah: Lawrence Erlbaum Associates, Inc., 2003.

18.

Hayashi

Hays

. A microcomputer program for analyzing multitrait-multimethod matrices. Behav Res Meth 1987; 19: 345–348.

19.

Shinto

Yadav

Morris

. Demographic and health-related factors associated with complementary and alternative medicine (CAM) use in multiple sclerosis. Mult Scler 2006; 12: 94–100.

20.

Khanna

Maranian

Rothrock

. Feasibility and construct validity of PROMIS and “legacy” instruments in an academic scleroderma clinic. Value Health 2012; 15: 128–134.

21.

Hays

Liu

Spritzer

. Item response theory analyses of physical functioning items in the medical outcomes study. Med Care 2007; 45: S32–38.

22.

Yost

Eton

Garcia

. Minimally important differences were estimated for six Patient-Reported Outcomes Measurement Information System-Cancer scales in advanced-stage cancer patients. J Clin Epidemiol 2011; 64: 507–516.

23.

Fries

Rose

Krishnan

. The PROMIS of better outcome assessment: Responsiveness, floor and ceiling effects and Internet administration. J Rheumatol 2011; 38:1759–1764.

24.

Becker

Stuifbergen

Morrison

. Promising new approaches to assess cognitive functioning in people with multiple sclerosis. Int J MS Care 2012; 14: 71–76.

25.

Broderick

Schneider

Junghaenel

Schwartz

Stone

. Validity and reliability of patient-reported outcomes measurement information system instruments in osteoarthritis. Arthritis Care Res. 2013 Oct;65(10): 1625–1633.

26.

Askew

Kim

Chung

. Development of a crosswalk for pain interference measured by the BPI and PROMIS pain interference short form. Qual Life Res Int J Qual Life Asp Treat Care Rehabil 2013 Dec;22(10): 2769–2776.

27.

Bamer

Cook

Amtmann

. Reliability and validity of pain, fatigue, depression, and social roles participation PRO measures in populations of individuals aging with a physical disability. Qual Life Res 2012; 20: S66.

28.

Patten

Berzins

Metz

. Challenges in screening for depression in multiple sclerosis. Mult Scler 2010; 16: 1406–1411.

29.

McGuigan

Hutchinson

. Unrecognised symptoms of depression in a community-based population with multiple sclerosis. J Neurol 2006; 253: 219–223.

30.

Chwastiak

Ehde

Gibbons

. Depressive symptoms and severity of illness in multiple sclerosis: Epidemiologic study of a large community sample. Am J Psychiatry 2002; 159: 1862–1868.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.01 MB