Feasibility,Reliability,Responsiveness,and Validity of the Patient-Reported Functional Scale for the Intensive Care Unit: A Pilot Study

Abstract

Background:

Although many performance-based measures assess patients’ physical function in intensive care unit (ICU) survivors, to our knowledge, there are no patient-reported ICU rehabilitation-specific measures assessing function. We developed the Patient-Reported Functional Scale-ICU (PRFS-ICU), which measures patients’ perceptions of their ability to perform 6 activities (rolling, sitting edge of bed, sit-to-stand and bed-to-chair transfers, ambulation, and stair climbing). Each item is scored from 0 (unable) to 10 (able to perform at pre-ICU level) to a maximum of 60.

Objectives:

Estimate the feasibility, reliability, responsiveness, and validity of the PRFS-ICU.

Methods:

This was a substudy of TryCYCLE, a single-center, prospective cohort examining the safety and feasibility of early in-bed cycling with mechanically ventilated patients (NCT01885442). To determine feasibility, we calculated the number of patients with at least 1 PRFS-ICU assessment during their hospital stay. To assess reliability, 2 raters blinded to each other’s assessments administered the PRFS-ICU within 24-hours of each other. We calculated the intraclass correlation coefficient (ICC; 95% confidence interval [CI]), standard error of measurement (SEM, 95% CI), and minimal detectable change (MDC₉₀). To assess validity, we estimated convergent validity of the PRFS-ICU with the Functional Status Score for ICU (FSS-ICU), Medical Research Council Sum Score (MRC-SS), Physical Function Test for ICU (PFIT-s), Katz Index of Independence in Activities of Daily Living (Katz ADLs), and a pooled index using Pearson's correlation coefficient (r, 95% CI).

Results:

Feasibility: 20 patients completed a PRFS-ICU assessment. Reliability and responsiveness: 16 patients contributed data. The ICC, SEM, and MDC₉₀ were 0.91 (0.76, 0.97), 4.75 (3.51, 7.35), and 11.04 points, respectively. Validity: 19 patients contributed data and correlations were (r [95% CI]): FSS-ICU (0.40 [−0.14, 0.76]), MRC-SS (0.51 [0.02, 0.80]), PFIT-s (0.43 [−0.13, 0.78]), Katz ADLs (0.53 [0.10, 0.79]), and pooled index (0.48 [−0.14, 0.82]).

Conclusions:

Our pilot work suggests the PRFS-ICU may be a useful tool to assess and monitor patients’ perceptions of function over time.

Keywords

intensive care unit outcome measure patient-report physical function reliability validity

Get full access to this article

View all access options for this article.

References

Castro-Avila

Serón

Fan

Gaete

Mickan

. Effect of early rehabilitation during intensive care unit stay on functional status: systematic review and meta-analysis. PLoS One. 2015;10(7):e0130722. doi:10.1371/journal.pone.0130722. [published Online First].

Denehy

Skinner

Edbrooke

, et al. Exercise rehabilitation for patients with critical illness: a randomized controlled trial with 12 months of follow-up. Crit Care (Lond, Engl). 2013;17(4):R156.

Calvo-Ayala

Khan

Farber

Ely

Boustani

. Interventions to improve the physical function of ICU survivors: a systematic review. Chest. 2013;144(5):1469–1480.

Connolly

. Describing and measuring recovery and rehabilitation after critical illness. Curr Opin Crit Care. 2015;21(5):445–452.

Elliott

Berney

Harrold

Skinner

. Key measurement and feasibility characteristics when selecting outcome measures. Curr Phys Med Rehabil Rep. 2015;3:255–267. doi:10.1007/s40141-015-0099-9.

Epstein

Street

. The values and value of patient-centered care. Ann Fam Med. 2011;9(2):100–103. doi:10.1370/afm.1239.

Parry

Granger

Berney

, et al. Assessment of impairment and activity limitations in the critically ill: a systematic review of measurement instruments and their clinimetric properties. Intensive Care Med. 2015;41(5):744–762. doi:10.1007/s00134-015-3672-x.

Robinson

Davis

Dinglas

, et al. A systematic review finds limited data on measurement properties of instruments measuring outcomes in adult intensive care unit survivors. J Clin Epidemiol. 2017;82:37–46. doi: 10.1016/j.jclinepi.2016.08.014.

Chan

Aronson Friedman

Dinglas

, et al.

Are physical measures related to patient-centred outcomes in ARDS survivors?

Thorax. 2017; 72(10):884–892. doi:10.1136/thoraxjnl-2016-209400.

10.

Ware

Jr Snow

Kosinski

Gandek

. SF-36 Health Survey Manual and Interpretation Guide. Boston, MA: The Health Institute, New England Medical Center Hospitals, Inc; 1993.

11.

Brooks

. EuroQol: the current state of play. Health Policy. 1996;37(1):53–72.

12.

Akerman

Fridlund

Ersson

Granberg-Axell

. Development of the 3-SET 4P questionnaire for evaluating former ICU patients’ physical and psychosocial problems over time: a pilot study. Intensive Crit Care Nurs. 2009;25(2):80–89.

13.

Horn

Jennings

Richardson

Vliet

Hefford

Abbott

. The patient-specific functional scale: psychometrics, clinimetrics, and application as a clinical outcome measure. J Orthop Sports Phys Ther. 2012;42(1):30–42. doi:10.2519/jospt.2012.3727.

14.

Stratford

Gill

Westaway

Binkley

. Assessing disability and change on individual patients: a report of a patient specific measure. Physiother Canada. 1995;47(4):258–263.

15.

Zanni

Korupolu

Fan

, et al. Rehabilitation therapy and outcomes in acute respiratory failure: an observational pilot project. J Crit Care. 2010;25(2):254–262.

16.

Ragavan

Greenwood

Bibi

. The functional status score for the intensive care unit scale: is it reliable in the intensive care unit? Can it be used to determine discharge placement? J Acute Care Phys Ther. 2016;7(3):93–100.

17.

Huang

Chan

Zanni

, et al. Functional status score for the ICU: an international clinimetric analysis of validity, responsiveness, and minimal important difference. Crit Care Med. 2016;44(12):e1155–e1164.

18.

Kho

Molloy

Clarke

, et al. TryCYCLE: a prospective study of the safety and feasibility of early in-bed cycling in mechanically ventilated patients. PLoS One. 2016;11(12):e0167561. doi: 10.1371/journal.pone.0167561.

19.

Hermans

Clerckx

Vanhullebusch

, et al. Inter-observer agreement of Medical Research Council-Sum Score and handgrip strength in the ICU. Crit Care. 2011;15(suppl 1):S186–S187.

20.

Denehy

de Morton

Skinner

, et al. A physical function test for use in the intensive care unit: validity, responsiveness, and predictive utility of the physical function ICU test (scored). Phys Ther. 2013;93(12):1636–1645. doi:10.2522/ptj.20120310.

21.

Wallace

Shelkey

Nursing

HIfG

. Katz Index of Independence in Activities of Daily Living (ADL). Urol Nurs. 2007;27(1):93–94.

22.

De Jonghe

Sharshar

Lefaucheur

, et al. Paresis acquired in the intensive care unit: a prospective multicenter study. JAMA. 2002;288(22):2859–2867.

23.

Riddle

Stratford

. Is This Change Real?: Interpreting Patient Outcomes in Physical Therapy. Philadelphia, PA: F.A. Davis Company; 2013.

24.

Weir

. Quantifying test–retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19(1):231–240. doi:10.1519/15184.1.

25.

Koo

. A Guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–163. doi:10.1016/j.jcm.2016.02.012.

26.

Pua

Cowan

Wrigley

Bennell

. The lower extremity functional scale could be an alternative to the Western Ontario and Mcmaster universities osteoarthritis index physical function scale. J Clin Epidemiol. 2009;62(10):1103–1111. doi:10.1016/j.jclinepi.2008.11.011.

27.

Stamm

Mathis

Aletaha

Kloppenburg

Machold

Smolen

. Mapping hand functioning in hand osteoarthritis: comparing self-report instruments with a comprehensive hand function test. Arthritis Rheum. 2007;57(7):1230–1237. doi:10.1002/art.22989.

28.

Wittink

Rogers

Sukiennik

Carr

. Physical functioning: self-report and performance measures are related but distinct. Spine (Phila Pa 1976). 2003;28(20):2407–2413. doi:10.1097/01.BRS.0000085304.01483.17.

29.

Smythe

Helewa

Goldsmith

. “Independent assessor” and “pooled index” as techniques for measuring treatment effects in rheumatoid arthritis. J Rheumatol. 1977;4(2):144–152.

30.

Connolly

Jones

Curtis

, et al. Clinical predictive value of manual muscle strength testing during critical illness: an observational cohort study. Crit Care. 2013;17(5):R229. doi:10.1186/cc13052.

31.

Hough

Lieu

Caldwell

. Manual muscle strength testing of critically ill patients: feasibility and interobserver agreement. Crit Care. 2011;15(1):R43. doi:10.1186/cc10005.

32.

Grossbach

Stranberg

Chlan

. Promoting effective communication for patients receiving mechanical ventilation. Crit Care Nurs. 2011;31(3):46–60. doi:10.4037/ccn2010728.

33.

Skinner

Berney

Warrillow

Denehy

. Development of a physical function outcome measure (PFIT) and a pilot exercise training protocol for use in intensive care. Crit Care Resusc. 2009;11(2):110–115.

34.

Vest

Murphy

Araujo

KLB

Pisani

. Disability in activities of daily living, depression, and quality of life among older medical ICU survivors: a prospective cohort study. Health Qual Life Outcomes. 2011;9:9.