Reliability and Validity of 6 Measures of Pain,Function,and Disability for Ankle Arthroplasty and Arthrodesis

Abstract

Background:

Patient-reported outcome measures are increasingly used evaluating clinical care. Many measures used to assess operative hindfoot interventions vary in content, and some have not been psychometrically validated in this population. The purpose of this study was to compare measurement properties of 6 lower-extremity patient-reported outcome measures, and to evaluate their reliability and validity in light of patients’ preferences.

Methods:

Cross-sectional survey of 42 preoperative and 100 postoperative patients completed 6 lower-extremity outcome measures on 2 occasions: Foot Function Index (FFI), Ankle Osteoarthritis Scale (AOS), patient-reported items of the American Orthopaedic Foot & Ankle Society Questionnaire (AOFAS), Lower Extremity Functional Scale (LEFS), Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), and the Short Musculoskeletal Function Assessment (SMFA), as well as measures of preference, and symptoms.

Results:

Internal consistency was good to excellent for all scales and subscales (α = .84-.97; ICC [2,1] = .81-.96). Correlations between scales ranged from .50 (WOMAC_Stiffness and FFI_{Activity Limitations}) to .92 (LEFS and SMFA_Overall, WOMAC_Pain and AOS_Overall, FFI_Overall and AOFAS_Overall). Higher correlations occurred within instruments (r = .97 AOS_Pain and AOS_Overall) and between similar subscales from different instruments (r = .91 WOMAC_Pain and AOS_Pain). Construct validity showed moderate to high correlations to global ratings of Pain, Stiffness, and difficulty performing Daily Activities. The highest correlations (r > .75) occurred between Pain and AOS_Overall (r = .84), stiffness and WOMAC_Stiffness (r = .81), and Daily Activities and AOS_Disability (r = .87). Patients rated instruments by preference. FFI, WOMAC, LEFS, and SMFA rated favorably for length. FFI, WOMAC, LEFS, and AOFAS rated high for understandability. FFI was rated by postoperative patients as most likely to capture change due to surgery. SMFA rated the best overall.

Conclusions:

Direct comparison of instruments revealed similarity between scales in construct validity and reliability. Patient preferences supported the use of these scales. Foot-specific instruments offered no clear advantage over lower-extremity instruments.

Level of Evidence:

Level II, prospective comparative study.

Keywords

ankle reconstruction ankle arthritis outcome measurement

Get full access to this article

View all access options for this article.

References

Agel

Beskin

Brage

. Reliability of the foot function index: a report of the AOFAS outcomes committee. Foot Ankle Int. 2005;26(11):962-967.

Baumhauer

Mcintosh

Rechtine

. Age and sex differences between patient and physician-derived outcome measures in the foot and ankle. J Bone Joint Surg Am. 2013;95(3):209-214. doi:10.2106/Jbjs.K.01467.

Bellamy

Buchanan

Goldsmith

. Validation study of WOMAC: a health status instrument for measuring clinically-important patient-relevant outcomes following total hip or knee arthroplasty in osteoarthritis. J Ortho Rheumatology. 1988;1:95-108.

Binkley

Stratford

Lott

. The Lower Extremity Functional Scale (LEFS): scale development, measurement properties, and clinical application. Phys Ther. 1999;79(4):371-383.

Budiman-Mak

Conrad

Roach

. The Foot Function Index: a measure of foot pain and disability. J Clin Epidemiol. 1991;44(6):561-570.

Domsic

Saltzman

. Ankle Osteoarthritis Scale. Foot Ankle Int. 1998;19(7):466-471.

Guyton

. Theoretical limitations of the AOFAS scoring systems: an analysis using Monte Carlo modeling. Foot Ankle Int. 2001;22(10):779-787.

Ibrahim

Beiri

Azzabi

. Reliability and validity of the subjective component of the American Orthopaedic Foot and Ankle Society clinical rating scales. J Foot Ankle Surg. 2007;46:65-74.

Juniper

Guyatt

Willan

. Determining a minimal important change in a disease-specific quality of life questionnaire. J Clin Epidemiol. 1994;47(1):81-87.

10.

Kitaoka

Alexander

Adelaar

. Clinical rating systems for the ankle-hindfoot, midfoot, hallux, and lesser toes. Foot Ankle Int. 1994;15(7):349-353.

11.

Madeley

Wing

Topliss

. Responsiveness and validity of the SF-36, Ankle Osteoarthritis Scale, AOFAS Ankle Hindfoot Score, and Foot Function Index in end stage ankle arthritis. Foot Ankle Int. 2012;33(1):57-63.

12.

Mchorney

Tarlov

. Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res. 1995;4(4):293-307.

13.

Mokkink

Terwee

Patrick

. The Cosmin study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-745.

14.

Nunnally

Bernstein

. Psychometric Theory. 3rd ed. New York, NY: McGraw-Hill; 1994.

15.

Pinsker

Daniel

Inrig

. The ability of outcome questionnaires to capture patient concerns following ankle reconstruction. Foot Ankle Int. 2013;34(1):65-74.

16.

Sangha

Stucki

Liang

. The Self-Administered Comorbidity Questionnaire: a new method to assess comorbidity for clinical and health services research. Arthritis Rheum. 2003;49(2):156-163.

17.

Shrout

Fleiss

. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420-428.

18.

Snapinn

Jiang

Snapinn

. Responder analyses and the assessment of a clinically relevant treatment effect. Trials. 2007;8:31.

19.

Soohoo

Samimi

Vyas

. Evaluation of the validity of the Foot Function Index in measuring outcomes in patients with foot and ankle disorders. Foot Ankle Int. 2006;27(1):38-42.

20.

Staquet

Hays

Fayers

. Quality of Life Assessments in Clinical Trials. New York, NY: Oxford University Press; 1998.

21.

Stone

ed. The Science of Self-Report: Implications for Research and Practice. Mahwah, NJ: Lawrence Erlbaum; 2000.

22.

Stratford

Riddle

. When minimal detectable change exceeds a diagnostic test-based threshold change value for an outcome measure: resolving the conflict. Phys Ther. 2012;92(10):1338-1347.

23.

Streiner

Norman

. Health Measurement Scales: A Practical Guide to Their Development and Use. 2nd ed. Oxford, UK: Oxford Medical; 1996.

24.

Swiontkowski

Engelberg

Martin

. Short musculoskeletal function assessment questionnaire: validity, reliability, and responsiveness. J Bone Joint Surg Am. 1999;81(9):1245-1260.

25.

Terwee

Bot

De Boer

. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42.