Patient-reported outcomes measurement information system depression psychometrically underperforms compared to legacy measures and is poorly associated with postoperative functional outcomes in shoulder arthroplasty patients

Abstract

Background

The purpose of this study was to investigate the associations between each mental health patient-reported outcome measure with postoperative functional outcomes following shoulder arthroplasty, and to compare psychometric properties of patient-reported outcomes measurement information system depression to the legacy (VR-12 Mental) patient-reported outcome measure.

Methods

Patients who underwent primary shoulder arthroplasty from July 2018 to February 2019 were retrospectively reviewed. Patient-reported outcomes measurement information system depression and VR-12 Mental were administered preoperatively; American Shoulder and Elbow Surgeons and Single Assessment Numeric Evaluation were administered at 6-month and 1-year postoperatively. Rasch partial credit modeling analysis was used to compare psychometric properties of legacy versus patient-reported outcomes measurement information system instruments in assessing mental health.

Results

Ninety-three patients who underwent total shoulder arthroplasty (n = 52), reverse total shoulder arthroplasty (n = 39), or hemiarthroplasty (n = 2) were included. Preoperative VR-12 Mental scores were moderately associated with American Shoulder and Elbow Surgeons at 6-months (coefficient: 0.52, P = 0.026) and 1-year (coefficient: 0.65, P = 0.002), while preoperative patient-reported outcomes measurement information system depression scores were not. Patient-reported outcomes measurement information system depression demonstrated significant floor effects (16%); VR-12 Mental demonstrated minimal floor and ceiling effects (1.1% for both). VR-12 Mental demonstrated broader coverage of mental outlook on Rasch modeling than patient-reported outcomes measurement information system depression and had adequate model fit after one round of reiterative item elimination.

Discussion

Patient-reported outcomes measurement information system depression was poorly associated with postoperative American Shoulder and Elbow Surgeons scores, demonstrated significant floor effects, and had limited coverage of mental health on Rasch modeling with reiterative elimination.

Level of Evidence

Keywords

shoulder arthroplasty mental health patient-reported outcomes measurement information system patient-reported outcomes measures

Get full access to this article

View all access options for this article.

References

Gil

Goodman

Mulcahey

. Psychological factors affecting outcomes after elective shoulder surgery. J Am Acad Orthop Surg 2018; 26: e98–e104.

Roh

Lee

Noh

, et al. Effect of depressive symptoms on perceived disability in patients with chronic shoulder pain. Arch Orthop Trauma Surg 2012; 132: 1251–1257.

Wylie

Suter

Potter

, et al. Mental health has a stronger association with patient-reported shoulder pain and function than tear size in patients with full-thickness rotator cuff tears. J Bone Joint Surg 2016; 98: 251–256.

Guattery

Dardas

Kelly

, et al. Floor effect of PROMIS depression CAT associated with hasty completion in orthopaedic surgery patients. Clin Orthop Relat Res 2018; 476: 696–703.

Bot

AGJ

Menendez

Neuhaus

, et al. The influence of psychiatric comorbidity on perioperative outcomes after shoulder arthroplasty. J Shoulder Elbow Surg 2014; 23: 519–527.

Alattas

Smith

Bhatti

, et al. Greater pre-operative anxiety, pain and poorer function predict a worse outcome of a total knee arthroplasty. Knee Surg Sports Traumatol Arthrosc 2017; 25: 3403–3410.

Golkari

Teunis

Ring

, et al. Changes in depression, health anxiety, and pain catastrophizing between enrollment and 1 month after a radius fracture. Psychosomatics 2015; 56: 652–657.

Pilkonis

Choi

Reise

, et al. Item banks for measuring emotional distress from the patient-reported outcomes measurement information system (PROMIS^®): depression, anxiety, and anger. Assessment 2011; 18: 263–283.

Schalet

Pilkonis

, et al. Clinical validity of PROMIS depression, anxiety, and anger across diverse clinical samples. J Clin Epidemiol 2016; 73: 119–127.

10.

Oak

Strnad

Bena

, et al. Responsiveness comparison of the EQ-5D, PROMIS global health, and VR-12 questionnaires in knee arthroscopy. Orthop J Sports Med 2016; 4: 2325967116674714.

11.

Pilkonis

Dodds

, et al. Validation of the depression item bank from the patient-reported outcomes measurement information system (PROMIS®) in a three-month observational study. J Psychiatr Res 2014; 56: 112–119.

12.

Anthony

Glass

Hancock

, et al. Performance of PROMIS instruments in patients with shoulder instability. Am J Sports Med 2016; 45: 449–453.

13.

Smith

Suh

. Rasch fit statistics as a test of the invariance of item parameter estimates. J Appl Meas 2003; 4: 153–163.

14.

Forget

Jerosch-Herold

Shepstone

, et al. Psychometric evaluation of the disabilities of the arm, shoulder and hand (DASH) with Dupuytren’s contracture: validity evidence using Rasch modeling. BMC Musculoskelet Disord 2014; 15: 361.

15.

Beckmann

Hung

Bounsanga

, et al. Psychometric evaluation of the PROMIS physical function computerized adaptive test in comparison to the American shoulder and elbow surgeons score and simple shoulder test in patients with rotator cuff disease. J Shoulder Elbow Surg 2015; 24: 1961–1967.

16.

Chang

Wong

, et al. PROMIS Physical function underperforms psychometrically relative to American shoulder and elbow surgeons score in patients undergoing anatomic total shoulder arthroplasty. J Shoulder Elbow Surg 2019; 28: 1809–1815.

17.

Vaishnav

McAnany

Iyer

, et al. Psychometric evaluation of patient-reported outcomes measurement information system physical function computer adaptive testing in minimally invasive lumbar spine surgery: an analysis of responsiveness, coverage, discriminant validity, and concurrent validity. J Am Acad Orthop Surg 2020; 28: 717–729.

18.

Conaghan

Emerton

Tennant

. Internal construct validity of the Oxford knee scale: evidence from rasch measurement. Arthritis Rheum 2007; 57: 1363–1367.

19.

Smith

Schumacker

Bush

. Using item mean squares to evaluate fit to the Rasch model. J Outcome Meas 1998; 2: 66–78.

20.

Beaton

Wright

Katz

and Group UEC. Development of the QuickDASH. J Bone Jt Surg 2005; 87: 1038–1046.

21.

Fisher

Dierckman

Watts

, et al. Looks good but feels bad: factors that contribute to poor results after total knee arthroplasty. J Arthroplasty 2007; 22: 39–42.

22.

Vissers

de Groot

Reijman

, et al. Functional capacity and actual daily activity do not contribute to patient satisfaction after total knee arthroplasty. BMC Musculoskelet Disord 2010; 11: 121.

23.

Seebach

Kirkhart

Lating

, et al. Examining the role of positive and negative affect in recovery from spine surgery. Pain 2012; 153: 518–525.

24.

Zachwieja

Butler

Grau

, et al. The association of mental health disease with perioperative outcomes following femoral neck fractures. J Clin Orthop Trauma 2019; 10: S77–S83.

25.

Menendez

Neuhaus

Bot

AGJ

, et al.

Do psychiatric comorbidities influence inpatient death, adverse events, and discharge after lower extremity fractures?

Clin Orthop Relat Res 2013; 471: 3336–3348.

26.

Daubs

Patel

Willick

, et al. Clinical impression versus standardized questionnaire: the spinal surgeon’s ability to assess psychological distress. J Bone Joint Surg Am 2010; 92: 2878–2883.

27.

Roh

Noh

, et al.

To what degree do shoulder outcome instruments reflect Patients’ psychologic distress?

Clin Orthop Relat Res 2012; 470: 3470–3477.

28.

Kohan

Hill

Schwabe

, et al. The influence of mental health on patient-reported outcomes measurement information system (PROMIS) and traditional outcome instruments in patients with symptomatic glenohumeral arthritis. J Shoulder Elbow Surg 2019; 28: e40–e48.

29.

Matar

Shah

Grawe

. PROMIS Scores have Inconsistent Correlations with Legacy Patient-Reported Outcome Measures in Shoulder Pathology: A Systematic Review. Arthrosc J Arthrosc Relat Surg 2020. Published online 2020; 37(4): 1301–1309.

30.

Horn

Reinke

Couce

, et al. Reporting and utilization of patient-reported outcomes measurement information system^® (PROMIS^®) measures in orthopedic research and practice: a systematic review. J Orthop Surg Res 2020; 15: 553.

31.

Smith

Rush

Fallowfield

, et al. Rasch fit statistics and sample size considerations for polytomous data. BMC Med Res Methodol 2008; 8: 33.