Sage Journals: Discover world-class research

Abstract

Introduction

Hospital activity is often measured using diagnosis-related groups, or case mix groups, but this information does not represent important aspects of patients’ health outcomes. This study reports on case mix-based changes in health status of elective (planned) surgery patients in Vancouver, Canada.

Data and methods

We used a prospectively recruited cohort of consecutive patients scheduled for planned inpatient or outpatient surgery in six acute care hospitals in Vancouver. All participants completed the EQ-5D(5L) preoperatively and 6 months postoperatively, collected from October 2015 to September 2020 and linked with hospital discharge data. The main outcome was whether patients’ self-reported health status improved among different inpatient and outpatient case mix groups.

Results

The study included 1665 participants with completed EQ-5D(5L) preoperatively and postoperatively, representing a 44.8% participation rate across eight inpatient and outpatient surgical case mix categories. All case mix categories were associated with a statistically significant gain in health status (p < .01 or lower) as measured by the utility value and visual analogue scale score. Foot and ankle surgery patients had the lowest preoperative health status (mean utility value: 0.6103), while bariatric surgery patients reported the largest improvements in health status (mean gain in utility value: 0.1515).

Conclusions

This study provides evidence that it was feasible to compare patient-reported outcomes across case mix categories of surgical patients in a consistent manner across a system of hospitals in one province in Canada. Reporting changes in health status of operative case mix categories identifies characteristics of patients more likely to experience significant gains in health.

Keywords

case mix patient-reported outcomes planned surgery

Introduction

Many countries pay hospitals on the basis of activity, that is, the number and type of patients they treat.^1,2 There is increasing recognition that this approach creates incentives for hospitals to maximise volume of care over corresponding measures of quality or effectiveness. Moving from volume- and case mix-based measures towards patient-centred outcome measures requires appropriate understanding of how patient’s health changes following a given intervention.

One such approach is through patient-reported outcome measures. Patient-reported outcomes (PROs) are collected through validated survey instruments (PROMs) where patients self-report their symptom severity, health status or health-related quality of life,^3,4 thus enabling standardised measurement of patient outcomes. Originally developed to measure symptom change in clinical trials,^5,6 PROs are increasingly used to measure intervention impact and effectiveness.^7–9 Countries such as England have implemented routine collection of PROs to measure health gain in patients undergoing selected surgical procedures.¹⁰ and understand variation in hospital performance,¹¹ There is increasing interest in the wider application of PROs for quality improvement¹² and possible reimbursement purposes (‘value-based payment’).^13–15

This study seeks to contribute to our understanding of the use and usefulness of PROs for measuring changes in patient’s health status across a range of elective (planned) surgery case mix categories in six hospitals in Vancouver, Canada. Exploratory in nature, it forms one of several necessary steps to inform the future development of system-wide approaches to collecting, reporting and comparing surgical outcomes in Canada.

Methods

We conducted a secondary analysis of a sample of consecutive patients scheduled for select elective inpatient or outpatient surgery in six acute hospitals in the geographically defined Vancouver Coastal Health (VCH) authority, home to over 1.25 million residents. Patients were eligible to be included if they were scheduled for an elective surgery that was included in this study, at least 18 years of age, able to communicate in English, community-dwelling and patients of surgeons who had agreed to have their patients participate. Patients were excluded if their surgery was to be performed two-weeks or less from time of scheduling to remove urgent cases.

All participants were contacted within two weeks of being registered for their surgery and preoperatively completed a survey that included the PRO. Participants were contacted by phone up to two times to complete the same survey six months postoperatively and when early recovery from their surgery was expected to have occurred.

The preoperative survey was collected from September 2015 and the postoperative survey was collected until September 2020. For orthopaedic surgery patients, the survey was initiated in September 2016.

Case mix categorisation

Canada uses separate case mix algorithms for inpatient and outpatient treatment. The Case Mix Groups+ (CMG+) was applied to inpatient hospital discharges while outpatient discharges were case mix adjusted using the Comprehensive Ambulatory Classification System (CACS). CMG+ and CACS are analogous to diagnoses-related groups (DRGs), where patients are uniquely assigned to a category for hospital payment based on their surgery. The CMG+ and CACS algorithms are maintained by the Canadian Institute for Health Information and independent of this study.^16,17

CMG+ case mix categories considered in this study included: Hysterectomy with Non-Malignant Diagnosis (Gynaecology), Reduction Gastroplasty Without Bypass (General Surgery), Endoscopic Large Intestine/Rectum Resection without Colostomy (Colorectal Surgery) and Major Foot Intervention except Soft Tissue without Infection (Orthopaedics). The inclusion of a cancer-related elective surgery sought to evaluate whether changes in health observed among colon cancer patients was similar to the changes reported by patients of non-cancer surgeries. CACS case mix categories included: Hernia Repair Open Approach (General Surgery), Plastic and Other Breast Intervention (Plastic Surgery), Sinus Intervention (Otolaryngology) and Cholecystectomy (General Surgery).

PRO instrument

Participants completed the EQ-5D(5L) to measure their current health status.¹⁸ The EQ-5D(5L) has five items and one vertical visual analogue scale (VAS). Each item relates to a health domain: mobility, self-care, usual activities, pain/discomfort and anxiety/depression and is rated using one of five levels corresponding with the severity of problems the participant is experiencing in the domain. On the VAS, participants mark the scale indicating their overall health status. The scale ranges from 0 (i.e. ‘Worst imaginable health state’) to 100 (i.e. ‘Best imaginable health state’).

This study used two primary outcome measures: the EQ-5D(5L)’s utility values and VAS scores. Each participant’s pattern of item responses was first used to describe their health state preoperatively and postoperatively.^18,19 Then, participant’s health state was matched with the EQ-5D(5L)’s utility values.²⁰ The utility values were derived from a sample of Canadians and independent of this study.²¹ Utility values range from less than 0 (representing a health state considered worse than death) to 1 (representing a health state considered perfect health). The second outcome measure was participants’ VAS scores, describing their overall health status.

We collected PROs from participants in one of 122 CMG+ and CACS case mix categories. For brevity, we present the results from four inpatient and four outpatient case mix categories, which we selected based on the representation across surgical specialities, volume of PROs returned by participants and clinician feedback.

Analyses

Patient participation was calculated by comparing eligible patients with the number of participants. Some participants did not complete and return their postoperative survey and the percentage of participants that did not complete their postoperative survey was calculated and reported. Participants’ PRO data were linked with their inpatient or outpatient hospital discharge summary to obtain their case mix category. From the hospital discharge data, participants’ age at surgery, sex and Charlson Comorbidity Index were calculated. The Charlson Comorbidity Index is an ordinal value that represents the gradient of patients’ morbidity burden.²²

All analyses were presented by case mix categories, reporting results by CMG+ or CACS category. Mean and standard deviations of preoperative and postoperative values of the EQ-5D(5L) utility value and VAS score were calculated. Paired t-tests were used to measure the statistical significance of the mean change in preoperative and postoperative values for each CMG+ or CACS category.

For each CMG+ or CACS category, the distributions of participants’ preoperative and postoperative EQ-5D(5L) utility values and VAS scores were calculated. All statistical analyses used Statistical Analysis Software (SAS, version 9.4).

Ethics approval

The University of British Columbia’s Research Ethics Board approved this study (H11-02179).

Results

Among eligible patients, the overall preoperative participation rate was 44.8% and the postoperative follow-up was 72.0% of participants. Participation varied among inpatient CMG+ and outpatient CACS case mix categories, ranging from 40.7% among otolaryngology patients (Sinus Intervention; n = 563) to 47.3% among orthopaedic patients (Major Foot Intervention except Soft Tissue without Infection; n = 244).

Table 1 describes the characteristics of participants within the case mix categories. Outpatient surgeries were more common than inpatient surgeries, and there were more female participants than males, consistent with the case mix groups selected, such as hysterectomy for benign conditions and delayed breast reconstruction. Other than among participants having surgery for colorectal cancer (case mix group Endoscopic Large Intestine/Rectum Resection without Colostomy), the comorbidity burden was very low and elective surgeries in these hospitals were predominantly conducted on participants with no other illnesses reported on their hospital discharge summary.

Table 1.

Demographic and clinical characteristics of patients in inpatient and outpatient case mix categories.

Case mix group	Count	Mean (SD) age	Percent female	Mean (SD) Charlson
Inpatient CMG+
Hysterectomy with Non-malignant diagnosis	261	55.5 (11.7)	100.0	0.05 (0.27)
Reduction gastroplasty without bypass	190	48.7 (10.2)	85.3	0.34 (0.59)
Endoscopic large intestine/Rectum resection without colostomy	212	65.4 (12.1)	50.0	1.96 (2.38)
Major foot intervention except soft tissue without infection	87	60.7 (10.2)	62.1	0.18 (0.42)
Outpatient CACS
Hernia repair, open approach	309	65.1 (11.9)	10.1	0.05 (0.22)
Plastic and other breast intervention	267	53.5 (12.2)	98.9	0.18 (1.02)
Sinus intervention	197	55.8 (13.0)	45.2	0.05 (0.28)
Cholecystectomy	142	57.3 (12.1)	77.5	0.06 (0.27)

Figure 1 illustrates the distribution of preoperative EQ-5D(5L) utility scores for all case mix categories. The figure highlights that preoperative utility values tended to be lower among participants scheduled for inpatient surgery compared with outpatient surgery. The CMG for Major Foot Intervention except Soft Tissue without Infection represented participants that reported the lowest preoperative health status. Detailed statistics for each case mix category are provided in the Online Supplement.

Figure 1.

Boxplot of preoperative EQ-5D utility values, presented for inpatient and outpatient case mix categories.

Table 2 presents EQ-5D utility values and VAS at preoperative and postoperative time points. There was a statistically significant improvement in both mean EQ-5D utility and VAS values in each of the eight case mix categories. The largest gain in mean EQ-5D utility and VAS values was among participants in the Reduction Gastroplasty Without Bypass case mix category.

Table 2.

EQ-5D utility values and VAS, shown for preoperative and postoperative time points.

Case mix group	Count	EQ-5D utility value			EQ-5D VAS
Case mix group	Count	Mean (SD) preoperative	Mean (SD) postoperative	T-test p-value	Mean (SD) preoperative	Mean (SD) postoperative	T-test p-value
Inpatient CMG+
Hysterectomy with Non-malignant diagnosis	261	0.8120 (0.15)	0.9092 (0.12)	<0.01	76.0 (16.3)	82.7 (12.6)	<0.01
Reduction gastroplasty without bypass	190	0.7367 (0.17)	0.8882 (0.13)	<0.01	60.6 (15.9)	81.1 (11.6)	<0.01
Endoscopic large intestine/Rectum resection without colostomy	212	0.8610 (0.14)	0.9079 (0.13)	<0.01	77.8 (16.9)	81.8 (14.0)	<0.01
Major foot intervention except soft tissue without infection	87	0.6103 (0.17)	0.7176 (0.17)	<0.01	63.5 (17.8)	70.3 (16.9)	<0.01
Outpatient CACS
Hernia repair, open approach	309	0.8180 (0.15)	0.8981 (0.14)	<0.01	79.4 (14.3)	83.6 (14.0)	<0.01
Plastic and other breast intervention	267	0.8438 (0.15)	0.8705 (0.17)	0.01	79.0 (14.8)	81.8 (15.5)	<0.01
Sinus intervention	197	0.8389 (0.14)	0.9020 (0.16)	<0.01	73.6 (17.7)	80.9 (14.9)	<0.01
Cholecystectomy	142	0.8529 (0.12)	0.9321 (0.12)	<0.01	76.7 (12.9)	83.5 (11.8)	<0.01

Participants with the lowest preoperative utility values tended to experience the largest gain in health although they were unlikely to reach the highest utility values experienced by participants with the highest preoperative utility values (Figure 2). Participants with the highest preoperative utility values experienced the smallest gains.

Figure 2.

Boxplots of participants’ postoperative EQ-5D(5L) utility values, presented for four inpatient CMG+ case mix categories. Participants were stratified into four quartiles based on their preoperative utility values.

Similarly, among outpatient case mix categories, participants with the lowest preoperative utility values tended to experience the largest gain in utility values (Figure 3). Participants with the lowest preoperative utility values also tended to have experienced larger variability in their postoperative utility values compared with participants with higher preoperative utility values.

Figure 3.

Boxplots of participants’ postoperative EQ-5D(5L) utility values, presented for four outpatient CMG+ case mix categories. Participants were stratified into four quartiles based on their preoperative utility values.

Discussion

This was an exploratory study that was based on a standardised measure of health status and included a range of case mix categories. The literature has not been clear whether gains in health would have been expected to be similar within or between surgical case mix categories. Although presentation of the results was complex owing to the multidimensionality of participants’ utility and VAS values, each inpatient and outpatient case mix category was associated with a statistically significant gain in health status (p < .01 or lower) as measured by the utility value and VAS.

While we did not expect to observe similar gains in health between case mix categories a priori, the results highlighted some unambiguous findings. First, participants with the lowest health status tended to experience the largest gains, with bariatric surgery tending to have gained more than other case mix categories. Second, the healthiest patients in each case mix category reported very small gains in health status. These findings are consistent with other research identifying factors associated with variation in PROs^11,23 and research showing a relationship between PROs and length of stay.²⁴

This study included one cancer-related case mix category for comparative purposes. Because of limitations in the data, it was unclear whether this surgery occurred because the patient’s cancer was identified during screening rather than through presentation of symptoms. This raises two potential issues regarding the application of the EQ-5D for measuring the impact of surgery among cancer patients. First, the EQ-5D may not be sufficiently sensitive to measure changes in health status among cancer surgery patients who have experienced few or no symptoms, such as colon or prostate cancer. In these cases, other PROMs may be better suited for measuring mental health-related effects, such as symptoms of depression (PHQ-9) or anxiety (GAD-7). Second, since the treatment of colon cancer spans a number of treatment modalities, measuring change in health may need to incorporate a broader episode of cancer treatment, not just the surgical encounter.

This study highlights cautions pertaining to measuring and comparing case mix-based surgical outputs with PROs in Canada. First, completing PROs was not compulsory and fewer than one-half of patients completed their PROs. Higher levels of participation are recommended to minimise the risk to the validity of the data^23,25 and maximise credibility of the findings. Second, although the EQ-5D(5L) is widely used, the instrument may not be sufficiently sensitive to detect meaningful changes in patients’ symptoms or function outcomes for all surgeries, suggesting that the instrument could be paired with an appropriate condition-specific instrument. Future work should focus on increasing participation and including condition-specific PROMs; also, further research is needed to assess the role of contextual variables on operative outcomes including wider determinants of health.

This study had additional limitations. After discharge, participants’ postoperative care, privately paid drugs, medical devices or therapies, were unobservable. Therefore, some portion of patient-level differences in their health status between and within CMG+ or CACS categories may be attributable to unmeasured interventions (or lack thereof) provided in the community.

Conclusion

This study demonstrated that it was feasible to collect and report PROs for inpatient and outpatient surgeries for a range of case mix categories across a system of hospitals applying a standard protocol. While the study found that gains in health status occurred in all case mix categories, the magnitude of gains varied by case mix category and preoperative health status. The largest gains were experienced by those with the lowest preoperative health status.

Supplemental Material

Supplemental Material Case mix-based changes in health status: A prospective study of elective surgery patients in Vancouver, Canada

Supplemental Material for Case mix-based changes in health status: A prospective study of elective surgery patients in Vancouver, Canada by Jason M Sutherland, R Trafford Crump, Ahmer A Karimuddin, Guiping Liu, Kevin Wing, Arif Janjua and Kathryn Isaac in Journal of Health Services Research & Policy

Footnotes

Author’s note

A subset of these results has been presented at the Activity Based Funding Conference, Melbourne, Australia, May 2019.

Declaration of conflicting interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) received no financial support for the research, authorship, and/or publication of this article.

Ethical approval

The study was approved by The University of British Columbia’s Behavioural Health Research Ethics Board (H11-02179).

ORCID iD

Jason M Sutherland

References

Busse

Geissler

Quentin

, et al. Diagnosis-related groups in Europe moving towards transparency, efficiency and quality in hospitals. In: Busse

Geissler

Quentin

, et al. (eds) 1st ed. Maidenhead: Open University Press, 2011, pp. 1–568.

Busse

Schreyögg

Smith

. Hospital case payment systems in Europe. Health Care Manag Sci 2006; 9: 211–213.

McDowell

. Measuring health: a guide to rating scales and questionnaires. New York: Oxford University Press, 2006.

Costal Tirado

McDermott

Thomas

, et al. Using patient-reported outcome measures for quality improvement in clinical genetics: an exploratory study. J Genet Couns 2017; 26: 1017–1028.

Patrick

Burke

Powers

, et al. Patient-reported outcomes to support medical product labeling claims: FDA perspective. Value Heal 2007; 10: S125–S126.

US Department of Health and Human Services FDA Center for Drug Evaluation and Research US Department of Health and Human Services FDA Center for Biologics Evaluation and Research US Department of Health and Human Services FDA Center for Devices and Radiological Health . Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes 2006; 4: 79.

Black

Patient reported outcome measures could help transform healthcare. BMJ 2013; 346: f167–f167.

Black

Burke

Forrest

, et al. Patient-reported outcomes: pathways to better health, better services, and better societies. Qual Life Res 2016; 25: 1103–1112.

Øvretveit

Zubkoff

Nelson

, et al. Using patient-reported outcome measurement to improve patient care. Int J Qual Heal Care 2017; 29: 874–879.

10.

NHS Digital . Patient-reported outcome measures (PROMS). Patient-Reported Outcome Measures (PROMS) https://digital.nhs.uk/data-and-information/data-tools-and-services/data-services/patient-reported-outcome-measures-proms (2022, accessed 25 April 2023).

11.

Gutacker

Bojke

Daidone

, et al. Hospital variation in patient-reported outcomes at the level of EQ-5D dimensions: evidence from England. Med Decis Mak 2013; 33: 804–818.

12.

Calvert

Kyte

Price

, et al. Maximising the impact of patient reported outcome assessment for patients and society. BMJ 2019; 364: 1–8.

13.

Teisberg

Wallace

O’Hara

. Defining and implementing value-based health care: a strategic framework. Acad Med 2020; 95: 682.

14.

Van Veghel

Schulz

Soliman-Hamad

, et al. The need for new financial models in the implementation of value-based healthcare. Int J Healthc Manag 2019; 14(2): 345–348.

15.

Hellsten

Dhalla

. What “value” should we pay for? a path towards value-based payment in canadian healthcare systems. Healthc Pap 2019; 18: 29–40.

16.

Canadian Institute for Health Information 2022 . CMG+, https://www.cihi.ca/en/cmg (2022, accessed 8 July 2022).

17.

Canadian Institute for Health Information (CIHI) . Comprehensive ambulatory classification system (CACS), https://www.cihi.ca/en/comprehensive-ambulatory-classification-system-cacs (2022, accessed 7 July 2022).

18.

EuroQoL Group . EuroQol-a new facility for the measurement of health-related quality of life. Health Policy 1990; 16: 199–208.

19.

Whitehead

Ali

. Health outcomes in economic evaluation: the QALY and utilities. Br Med Bull 2010; 96: 5–21.

20.

Dolan

. Modeling valuations for EuroQol health states. Med Care 1997; 35: 1095–1108.

21.

Bansback

Tsuchiya

Brazier

, et al. Canadian valuation of EQ-5D health states: preliminary value set and considerations for future valuation studies. PLoS One 2012; 7: e31115.

22.

Quan

Couris

, et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol 2011; 173: 676–682.

23.

Nutall

Parkin

Devlin

. Inter-provider comparison of patient-reported outcomes: Developing an adjustment to account for differences in case mix. Health Econ 2015; 24: 41–54.

24.

Sutherland

Liu

Crump

, et al. Relationship between preoperative patient-reported outcomes and hospital length of stay: a prospective cohort study of general surgery patients in Vancouver, Canada. J Health Serv Res Policy 2019; 24: 29–36.

25.

Devlin

Appleby

. Getting the most out of PROMs: putting health outcomes at the heart of NHS decision-making. London, UK: Office of Health Economics, 2010.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.07 MB

Case mix-based changes in health status: A prospective study of elective surgery patients in Vancouver,Canada

Abstract

Introduction

Data and methods

Results

Conclusions

Keywords

Introduction

Methods

Case mix categorisation

PRO instrument

Analyses

Ethics approval

Results

Discussion

Conclusion

Supplemental Material

Supplemental Material Case mix-based changes in health status: A prospective study of elective surgery patients in Vancouver, Canada

Footnotes

Author’s note

Declaration of conflicting interests

Funding

Ethical approval

ORCID iD

References

Supplementary Material