Abstract
Background:
Measures such as the Patient Acceptable Symptom State and minimum clinically important difference have been used to contextualize patient-reported outcomes (PROs). Assessment of patients’ perception of being “completely better” (CB) after hip arthroscopy has not been studied.
Purposes:
To (1) determine the prevalence and characteristics of patients who report being CB at 2 years after hip arthroscopy; (2) determine whether PROs measuring function, pain, and mental health are associated with CB status; and (3) determine threshold values for PROs predictive of achieving CB status.
Study Design:
Case-control study; Level of evidence, 3.
Methods:
Patients undergoing hip arthroscopy at a single institution from October 2015 to January 2020 were administered electronic surveys assessing sociodemographic variables and PROs at baseline and 2 years postoperatively. The CB anchor question was “Is the condition for which you underwent surgery completely better now?” Threshold values for PROs associated with achieving CB status at 2 years postoperatively were identified with 90% specificity. Variables with an area under the curve of >0.80 on a receiver operating characteristic curve were selected for multivariate analysis.
Results:
Overall, 29 of 62 patients (47%) achieved CB status. There were no differences in age, sex, body mass index, race, prior hip surgery, preoperative opioid use, smoking status, or preoperative expectations between the CB and no-CB groups. The CB group had better 2-year postoperative and pre- to postoperative change values on all PROs (P < .05 for all) except for the Patient-Reported Outcomes Measurement Information System (PROMIS)–Depression and the Numeric Pain Scale (NPS) for whole-body pain. Two-year postoperative PRO thresholds for achieving CB status were determined as PROMIS–Physical Function (PF) ≥51.3 or increase in PROMIS–PF ≥12 points, PROMIS–Pain Interference ≤46.6 or decrease in PROMIS–Pain Interference ≥12.2 points, NPS for operative hip pain of ≤1.0, Musculoskeletal Outcomes Data Evaluation and Management System–expectations met ≥95.0, and Surgical Satisfaction Questionnaire (SSQ-8) ≥87.5. Multivariate analysis demonstrated that higher SSQ-8 score and greater improvement on the PROMIS–PF were independent predictors of achieving CB status.
Conclusion:
Almost half of the study patients perceived being CB at 2 years after hip arthroscopy. Multiple postoperative PROs scores were associated with achieving CB status.
Keywords
The prevalence of hip arthroscopy has grown in recent years as a result of increased understanding of hip pathologies and improvements in operative techniques and training. Femoroacetabular impingement (FAI) syndrome has become the primary indication for hip arthroscopy, as it causes hip pain and functional deficits and can potentially lead to osteoarthritis.8,10,21 Hip arthroscopy is also indicated as both a diagnostic and therapeutic tool for a variety of pathologies including labral tears, loose bodies, and microinstability, among many other conditions.17,31 Hip arthroscopy has shown improved outcomes compared with nonoperative measures and provides a lesser risk of complications compared with open procedures without compromising postoperative results.11,19,28,29,38
As hip arthroscopy indications and surgical techniques evolve, it is important to remain focused on measuring the benefits to patients. Patient-reported outcomes (PROs) are a powerful way to interpret surgical outcomes, focusing on specific factors such as quality of life, pain, and function. PROs in isolation do not aid in clinical decision-making and must be interpreted to be used in clinical practice. Therefore, contextualizing PROs can help to differentiate meaningful clinical outcomes. Minimal clinically important difference (MCID), Patient Acceptable Symptom State (PASS), and substantial clinical benefit (SCB) are anchor-based methods of determining thresholds for meaningful improvements,13,37 but the ultimate patient-centered outcome measure may be the patient's perception of resolution of the symptoms or condition for which he or she is being treated. Recently, a patient-perceived “completely better” (CB) status has been used to contextualize PROs to differentiate clinically meaningful outcomes after anterior cruciate ligament surgery. 34 Assessment of patients’ perception of being CB after hip arthroscopy has not been studied and may be of particular value for this rapidly growing field.
The purpose of this study was to (1) determine the prevalence and characteristics of patients who report being CB at 2 years after hip arthroscopy; (2) determine whether PROs measuring function, pain, and mental health are associated with achieving CB status; and (3) determine threshold values for PROs predictive of achieving CB status. We hypothesized that PRO thresholds could be established to predict CB status with approximately 90% specificity.
Methods
This was a level 3 case-control study of patients who underwent hip arthroscopy at a single institution between October 2015 and January 2020. Patients were identified in preoperative or clinic sites and enrolled into an institutional review board–approved, prospective, web-based registry. 15 All surgeries were performed by 2 board-certified sports medicine fellowship–trained orthopaedic surgeons (including S.J.M.), both of whom routinely performed hip arthroscopy. Similar postoperative rehabilitation protocols were used by both surgeons. Current Procedural Terminology (CPT) codes were used to identify patients who underwent hip arthroscopy. Patients with a primary CPT code of 29914, 29915, 29916, or 29862 were included. Excluded were (1) patients <12 years of age, (2) non-English speakers, (3) incarcerated patients, and (4) patients lacking a working email address. Survey data were collected within 1 week of surgery and 2 years postoperatively using Research Electronic Data Capture (REDCap). 14
Of the 92 eligible patients who filled out baseline questionnaires, 62 patients (67%) were included in the analysis. At the postoperative evaluation, these patients were asked the CB anchor question “Is the condition for which you underwent surgery completely better now?” Of these patients, 29 (47%) responded yes (CB group) and 33 (53%) responded no (no-CB group) (Figure 1).

CONSORT (Consolidated Standards of Reporting Trials) flowchart illustrating the patient inclusion process. CB, completely better; CPT, Current Procedural Terminology.
Data Collection
Participant sociodemographic information was self-reported preoperatively through an electronic survey system. Operative and medical history information were gathered through a review of the patients’ electronic medical records. PROs were administered preoperatively and at 2 years postoperatively and included the Patient-Reported Outcomes Measurement Information System (PROMIS) 6 in 6 domains (Physical Function [PF], Pain Interference [PI], Social Satisfaction [SS], Fatigue, Anxiety, and Depression); the Numeric Pain Scale (NPS)9,18 for both the entire body and the operative hip; the Marx activity rating scale; 24 the Tegner activity scale; 3 and the Musculoskeletal Outcomes Data Evaluation and Management System (MODEMS) expectations domain. 33 Patient satisfaction was assessed at 2 years postoperatively with the Surgical Satisfaction Questionnaire (SSQ-8). 12 These measures comprise the standard set of outcomes assessed in the institutional registry and were selected to provide a comprehensive assessment of PROs and satisfaction with surgical treatment across a diverse set of patients. 15
PROMIS utilizes computer-adaptive testing, a validated method to decrease survey burden and administration time by adjusting questions asked based on the previous question's answer. 4 All PROMIS domains are scored on a 100-point scale, in which 50 represents the mean for the population. Higher numeric scores indicate better outcomes on the PF and SS domains and worse outcomes on the Fatigue, PI, Anxiety, and Depression domains. The Marx scale assesses the greatest level of patient physical activity over the past year, and the Tegner scale determines activity level before and after an injury.3,24 The raw Marx score was converted to a 100-point scale, with 100 indicating the highest activity level. The MODEMS and SSQ-8 were utilized to assess expectations before and after surgery and satisfaction after surgery, respectively.12,33
Statistical Analysis
Responses to the CB anchor question (yes or no) were analyzed with respect to patient characteristics to identify potential confounders. Associations with PROs were assessed with bivariate analysis. PRO score thresholds for responding yes to the CB anchor question were calculated via a receiver operating characteristic (ROC) curve, with values chosen as thresholds at approximately 90% specificity. ROC curves were tested for reliability through an area under the curve (AUC) analysis, with AUCs of 0.7 and 0.8 deemed acceptable and excellent, respectively. 22
Continuous data were reported as mean and standard deviation while categorical data were reported as frequency and percentage. A goodness-of-fit test was run assessing for normality among both preoperative and postoperative PROs, and a majority did not fit normal distributions, justifying nonparametric analyses. Continuous and categorical data were analyzed via the Wilcoxon rank-sum test or Pearson chi-square test, respectively. The Fisher exact test was utilized for categorical variables with cell counts of <5. Associations between 2 continuous variables were analyzed through the Spearman correlation coefficient. Backward stepwise elimination regression for maximal validation R2 was applied to identify independent predictors of CB status. Variables were selected a posteriori for inclusion into the multivariate based on an AUC of >0.80. Statistical significance was determined when P < .05, with all tests being 2-sided. All statistical analyses were performed using JMP Pro (Version 13; SAS Institute).
Results
The median time to follow-up was 25.2 months (IQR, 24-28 months). When stratifying patient characteristics by CB status, significantly more patients with single marital status were seen in the CB group than the no-CB group (P = .04). There were no other significant differences observed between groups, including age, sex, body mass index (BMI), race, prior ipsilateral hip surgery, preoperative opioid use, or smoking status (Table 1). Additionally, there was no difference in the proportion of patients who achieved CB status based on primary CPT code (P = .26).
Comparison of Patient Characteristics and Medical Background by CB Status a
Data are presented as mean ± SD or n (%). Boldface P value indicates statistically significant difference between the CB and no-CB groups (P < .05). ASA, American Society of Anesthesiologists; BMI, body mass index; CB, completely better.
Patient-Reported Outcomes
Patients in both the CB and no-CB groups saw pre- to postoperative improvement on all PROs with the exception of NPS–whole body and PROMIS-Depression (Table 2). Additionally, patients in the no-CB group saw no pre- to postoperative improvement on the Marx and Tegner scores. There were no differences in preoperative PROs or MODEMS–preoperative expectations between the CB and no-CB groups (Table 2).
Comparison of Patient-Reported Outcome Scores by CB Status and Time Point a
Data are presented as mean ± SD. Dashes indicate areas not applicable. Boldface P values indicate statistically significant difference between groups as indicated (P < .05). CB, completely better; PROMIS, Patient-Reported Outcomes Measurement Information System; MODEMS, Musculoskeletal Outcomes Data Evaluation and Management System; NPS, Numeric Pain Scale; PF, Physical Function; PI, Pain Interference; Postop, postoperative; Preop, preoperative; SS, Social Satisfaction; SSQ-8, Surgical Satisfaction Questionnaire.
Two-year postoperative PRO scores and pre- to postoperative change (Δ) in PRO scores were significantly better in the CB group for all PROs with the exception of the PROMIS-Depression and NPS–whole body (Table 2).
The 2-year postoperative and pre- to postoperative change score thresholds for predicting CB status with approximately 90% specificity were calculated for multiple PROs (Table 3). The postoperative and change score thresholds for PROMIS-PF and PROMIS-PI, as well as the postoperative NPS–operative hip score, MODEMS–expectations met, and SSQ-8, had excellent predictive value (AUCs: PROMIS-PF postoperative = 0.87, PROMIS-PF Δ = 0.86; PROMIS-PI postoperative = 0.85, PROMIS-PI Δ = 0.85; NPS–operative hip postoperative = 0.88; MODEMS–expectations met = 0.87; SSQ-8 = 0.86).
Patient-Reported Outcome Thresholds Predictive of Achieving CB Status at 2 Years Postoperatively a
Boldface values indicate an AUC of >0.80. AUC, area under the curve; CB, completely better; PF, Physical Function; PI, Pain Interference; Postop, postoperative; Preop, preoperative; PROMIS, Patient-Reported Outcomes Measurement Information System; MODEMS, Musculoskeletal Outcomes Data Evaluation and Management System; NPS, Numeric Pain Scale; SS, Social Satisfaction; SSQ-8, Surgical Satisfaction Questionnaire.
All threshold values were chosen with approximately 90% specificity.
Outcome score thresholds with excellent predictive value (ie, thresholds with AUC >0.80 in Table 3) were used in a multivariate analysis for predicting CB status. On logistic regression analysis, higher SSQ-8 scores and greater improvement from baseline in PROMIS PF scores were independent predictors of achieving CB status at 2 years postoperatively (Table 4).
Logistic Regression Model for Achieving CB Status at 2 Years Postoperatively a
Boldface P values indicate statistical significance (P < .05). CB, completely better; PROMIS-PF, Patient-Reported Outcomes Measurement Information System–Physical Function; SSQ-8, Surgical Satisfaction Questionnaire.
Log odds of “yes” compared with “no” for CB status.
Discussion
To the best of our knowledge, this is the first study to evaluate patient-perceived CB status after hip arthroscopy. In this study, 47% of patients responded yes to the CB anchor question at 2 years after hip arthroscopy. There were no differences in patient characteristics, including age, sex, BMI, race, prior ipsilateral hip surgery, preoperative opioid use, or smoking status, between the CB and no-CB groups. Multiple PROs were shown to be significantly better in the CB group than the no-CB group, and threshold values for these PROs predictive of achieving CB status were identified. Multivariate analysis revealed that higher SSQ-8 score and greater pre-to postoperative improvement on the PROMIS–PF were independent predictors of CB status.
Measuring PROs has become the new standard for determining surgical quality and treatment efficacy, and as a result, multiple measures have been developed to allow for clinical interpretation of PROs.5,36 In other hip arthroscopy studies with MCID methodology, worse preoperative scores were associated with a higher likelihood of achieving MCID, but this may not equate to a satisfactory result for the patient.28,30 PASS has been shown to have a positive correlation with preoperative scores and patient factors.16,30,35 However, it is plausible that a patient who already has a higher level of function or less severe symptoms preoperatively will also feel better than other patients postoperatively, without achieving the desired improvement in function, decrease in symptoms, or outcome. There may be a difference between the acceptable symptom level and the symptoms or lack thereof when achieving CB status. For this reason, measuring CB status may be the ultimate patient-centered outcome for a younger, more active population. In this study, no preoperative PROs were predictive of achieving CB status. This may be due to variations in patients’ perception of feeling CB. One patient with lower preoperative PROs may see greater improvement postoperatively, which one considers to be CB, while at the same time, another patient with higher PROs may start off closer to complete resolution of the symptoms that one achieves postoperatively. Additionally, preoperative expectations did not predict CB status.
This study demonstrated that multiple postoperative PROs were correlated with CB status. At 2 years postoperatively, the PROMIS PF, PI, Fatigue, SS, and Anxiety domains were associated with achieving CB status. PROMIS-Depression was not associated with achieving CB status. NPS–operative hip, SSQ-8, and MODEMS were also associated with achieving CB status at 2 years. This is reassuring, as it is expected that better quantifiable scores would correlate with a positive patient outcome as measured by a subjective anchor question. This is also a useful research tool, as this study identified threshold values for 2-year postoperative and pre- to postoperative changes in PRO scores that are predictive of CB status. The PROMIS-PF and PROMIS-PI, NPS, MODEMS, and SSQ-8 at 2 years postoperative all had excellent predictive capability (AUCs >0.80) with a sensitivity of about 90%. In addition, an increase in the PROMIS-PF of ≥12 points and decrease in PROMIS-PI of ≥12.2 points also had excellent predictive capability. This allows for interpretation of other studies measuring these domains in the context of outcomes that may be comparable with CB status.
Recent studies have reported PRO values associated with SCB,23,27 which included a patient response of “a good deal better” or “a great deal better,” as opposed to CB. Bodendorfer et al 2 defined SCB thresholds at 1 year after hip arthroscopy for FAI syndrome, and their thresholds for PROMIS-PI (51.9) and PROMIS-PF (49.9) were similar to the values reported in this study (≤46.6 and ≥51.3, respectively). In this study, 47% of patients reported feeling CB. This is slightly lower than the percentage of patients achieving SCB threshold for PROMIS-PI (51.6%) and PROMIS-PF (54.0%) in the study by Bodendorfer et al, which aligns with the theory that CB status is the highest mark of achievement in outcomes. This study did not utilize a legacy hip-specific measure, such as International Hip Outcome Tool, modified Harris Hip Score, or Hip Outcome Score. However, there is psychometric evidence to support that PROMIS measures are accurate and responsive in assessing outcomes after hip arthroscopy, and correlate well with legacy hip-specific measures.7,20,23,26 Additionally, this study showed that a traditional NPS in the operative hip of ≤1.0 is associated with CB status, which is similar to the visual analog scale for pain threshold for SCB (1.5) as demonstrated by Beck et al. 1 Although CB status is a novel measurement tool, a recent study by Schneider et al 34 showed that 70% of patients reported being CB at 2 years after anterior cruciate ligament reconstruction, which serves as a good point of reference for a widely successful surgery. Our finding that SSQ-8 at 2 years postoperative and change in PROMIS-PF over 2 years were independently predictive of CB status suggests that surgical satisfaction and improvement in PF may be the most important metrics to patients when undergoing hip arthroscopy.
Last, patient and clinical characteristics were very similar between the CB and no-CB groups, with self-reported marital status being the only observed significant difference. The CB group had a higher proportion of patients who reported being single compared with the no-CB group. This could be due to age differences between these subgroups, as single patients were on average 10 years younger than married patients. However, there was no overall association observed between age and CB status when examined directly. There were otherwise no differences in demographics of sex, BMI, race, prior ipsilateral hip surgery, preoperative opioid use, smoking status, or annual income between the CB and no-CB groups, indicating that patients may feel CB at 2 years after hip arthroscopy regardless of these factors. Contrary to many orthopaedic studies demonstrating differences, hip arthroscopy patients may have a similar opportunity to achieve feeling CB, regardless of demographics or socioeconomic background.25,32,35
Limitations
This study has several limitations. First, CB status is a global subjective measure, and there may be additional patient factors, such as specific type of sport participation or prior procedure, that influence a particular response that were not included in this study. Second, CB status is a novel assessment that limits direct comparison with prior literature. However, MCID, PASS, and SCB have been investigated and can provide some context for interpretation. Third, the data were limited to a small and relatively homogeneous sample from 2 surgeons operating at a single urban center, which may limit the generalizability to other populations. Some factors (ie, race, legal claim, alcohol intake) might be found to be significant with a larger study population. Surgical techniques are rapidly evolving with new technology, and this may affect results over the time period of the study and in the future. Additionally, the inclusion of both adolescents and adults for a variety of arthroscopic indications into a single cohort may further limit the generalizability. Fourth, 30 patients (33%) did not respond, and therefore, the true rate of achieving CB in our population could be as high as 64% (59 of 92 patients in the best case that all patients who did not respond actually were CB), or as low as 32% (29 of 92 patients in the worst case that all patients who did not respond were not CB). Further work is needed to reproduce these results in a larger sample and to compare the results with other legacy hip-specific outcome measures. Despite these limitations, this study provides a novel analysis of multiple PROs in a cohort of patients who underwent hip arthroscopy.
Conclusion
This is the first study to assess a subjective “completely better” status using PROs at 2 years after hip arthroscopy. The study findings indicated that 47% of patients perceived being CB after hip arthroscopy. Multiple postoperative PRO scores, but not preoperative PROs, were associated with CB status. Furthermore, PRO threshold criteria associated with achieving CB status were identified and demonstrated excellent predictive capability and high sensitivity.
Footnotes
Acknowledgements
The authors acknowledge J. Kathleen Tracy, PhD; Andrew G. Dubina, MD; Julio J. Jauregui, MD; Vidushan Nadarajah, MD; Patrick M.J. Sajak, MD: Tina Zhang, MD; Craig H. Bennett, MD; Cameran I. Burt; Shaun H. Medina; Keyan Shasti; Dominic J. Ventimiglia; Alexander J. Wahl; and Michael P. Smuda for their assistance with the data collection.
Final revision submitted January 16, 2024; accepted February 13, 2024.
One or more of the authors has declared the following potential conflict of interest or source of funding: This work was supported in part by a grant from the James Lawrence Kernan Hospital Endowment Fund (BL 1941007WS) and from a US Department of Veterans Affairs Biomedical Laboratory Research and Development Service Career Development Award (IK2 BX004879). N.L.L. has received education payments from Supreme Orthopedic Systems. J.D.P. has received education payments from Supreme Orthopedic Systems. R.F.H. has received education payments from Supreme Orthopedic Systems. S.J.M. has received education payments from Arthrex and Smith & Nephew. AOSSM checks author disclosures against the Open Payments Database (OPD). AOSSM has not conducted an independent investigation on the OPD and disclaims any liability or responsibility relating thereto.
Ethical approval for this study was obtained from University of Maryland Baltimore (ref No. HCR-HP-00062261-9).
