Abstract
Background
Venous thromboembolism (VTE) events after hernia surgery influence prognosis and life quality and may be preventable. This study aimed to develop a useful model for predicting in-hospital VTE in Chinese patients after hernia surgery.
Methods
Patients after hernia surgery were retrospectively recruited from 58 institutions (n = 14 322). Totally, 36 potential predictors were involved in the regression analysis. Weighted points were assigned to the predictors of in-hospital VTE identified in the multivariate logistic regression analysis and a prediction model was established. Decision curve analysis was performed to evaluate the net clinical benefit between the established and Caprini models.
Results
A total of 11 707 patients were included and five variables were explored as predictors related to in-hospital VTE: varicose veins of lower extremity, history of VTE, family history of thrombosis, interruption of antithrombotic agents, and reducible hernia. The prediction model (the CHAT score) revealed a good performance metrics (c-statistic, 0.81 [95% CI, 0.80 to 0.81]; Nagelkerke R2, 0.27 [95% CI, 0.26 to 0.30]; Brier score, 0.16 [95% CI, 0.13 to 0.23]). The rate of in-hospital VTE after hernia surgery at low-risk (−4 points), intermediate-risk (0-1 points), high-risk (4 points) and very high-risk (≥5 points) were 0.05%, 0.39%, 0.73% and 8.62%, respectively. The CHAT score identified a considerable variability (from 0.05% to 8.62%) for in-hospital VTE among the overall population after hernia surgery. Decision curve analysis found a superior net benefit of the established model than the Caprini score.
Conclusions
The CHAT score is likely to be a practical 5-item supporting tool to identify patients at high risk of in-hospital VTE after hernia surgery that might assist in decision making and VTE prevention. Further validated study will strengthen this finding.
Introduction
Inguinal hernia repair is one of the most commonly performed surgeries, with approximately 20 million hernioplasties worldwide each year.1,2 Recent advances in hernia repair technology have contributed to improve the outcomes of patients with hernia.3,4 However, in these postoperative patients, venous thromboembolism (VTE) events during the hospitalization are the potentially serious complication, adversely influencing the prognosis and life quality. The rate of VTE complications is reported to be 0.18% to 0.45% within the 30 to 90 days after hernia surgery, with most episodes occurring in-hospital.5,6 Notably, such events may be preventable beforehand by identifying the potentially VTE-related risk factors. The most extensively used assessment tool in predicting postoperative VTE is the Caprini risk score. Nevertheless, a multitude of factors as well as a box for additional risk factors make it complicated for surgeons to use in their clinical practice. 7 Furthermore, as the Caprini score is a universal scale for VTE risk prediction in general surgery, it is necessary to develop a prediction model specialized for VTE risk following hernia surgery. In this study, we aimed to derive a clinically useful prediction model for predicting in-hospital VTE after hernia surgery based on a multicenter study in China and make a comparison of the model performance with the Caprini models.
Methods
This study was conducted in accordance with the Helsinki Declaration and was approved by the Ethics Committee of Beijing Chaoyang Hospital, Capital Medical University (2018-kd-315). Written informed consent for hernia surgery was obtained from all patients before the procedure. The need for informed consent was waived because this study was a retrospective design and the patient's data were anonymized.
Study Design and Patient Population
This study followed the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) reporting guidelines. 8 To develop a reliable prediction model for in-hospital VTE after hernia surgery, we conducted this retrospective study with the following three steps: (I) identification of clinically significant predictors of in-hospital VTE after hernia surgery based on a multicenter, retrospective cohort (CHAT-1 trial, registration number: ChiCTR1900020853); (II) development of a prediction model for predicting in-hospital VTE, and (III) comparison of the model performance between established and Caprini models.
The study population was recruited from 58 major institutions in 6 different regions of China (east China, north China, northwest China, southwest China, northeast China, and central and south China) between January first, 2017 and December 31st, 2017. All participating institutions had more than 500 beds and were able to perform hernia surgery. The study included patients who met the following criteria: (I) adult patients undergoing emergency or selective hernia surgery; (II) involved potential risk predictors associated with in-hospital VTE, consisting of demographics, diseases history, comorbidities, procedure, and drug therapy; (III) reported in-hospital VTE event or not during the hospitalization. The patients were excluded if (I) they were outpatients and underwent an ambulatory operation, (II) included missing data or illogical data, (III) they suffered a recent VTE and received an anticoagulant before admission.
Candidates for Predictors of in-Hospital VTE After Hernia Surgery
On the basis of the Caprini score, 7 Padua score 9 and clinical relevance, we identified the following variables potentially associated with in-hospital VTE after hernia surgery: demographics (sex, age, smoking, body mass index), diseases history (sepsis, stroke or transient ischemic attack, serious lung disease, congestive heart failure, varicose veins of lower extremity, cancer, heart valve implantation, percutaneous coronary intervention, inflammatory bowel disease, thrombosis, family history of thrombosis, congenital or acquired thrombophilia), comorbidities (hypertension, atrial fibrillation, coronary heart disease, diabetes, systemic lupus erythematosus, nephrotic syndrome, chronic bronchitis), hernia type (reducible hernia, irreducible hernia, incarcerated hernia, strangulated hernia), procedure information (operation type, anesthesia type, operative time, intraoperative blood loss, postoperative compression, postoperative bleeding, postoperative hematoma). We also selected drug-related characteristics that may influence the occurrence of VTE, including the interruption of antithrombotic agents and oral contraceptives or hormone replacement. In those with the intake of antithrombotic agents (warfarin, dabigatran, rivaroxaban, apixaban, aspirin, clopidogrel, ticagrelor, prasugrel), the decision on continuing or interrupting the agents before the operation were mainly based on the selection of the doctors in charge.
Data Collection and Outcome Definition
In each participating institution, variables above were collected from the medical records and surgical anesthesia reports. The primary outcome of this study was to develop a prediction model for in-hospital VTE after hernia surgery in China. VTE events included DVT and PE: (I) DVT is diagnosed by combining the clinical symptoms of swelling and pain of the lower limbs, tenderness behind the lower leg and/or medial thigh and auxiliary examination of color ultrasound of the veins of both lower limbs, and lower extremity venography is the gold standard for the diagnosis of DVT 10 ; (II) PE should be initially diagnosed in combination with related clinical manifestations such as dyspnea and shortness of breath and laboratory tests such as plasma D-dimer. CT pulmonary arteriography (CTPA) is the preferred examination method for the diagnosis of PE. 11 Interruption of antithrombotic agents was defined as stopping antithrombotic agents including temporary replacement by heparin or not.
Statistical Analysis
Categorical variables are expressed as numbers and percentages and were compared using the Chi-square test. Continuous variables are reported as mean ± standard deviation and were compared using the Wilcoxon rank-sum test. Univariate and multivariate logistic regression analyses were used to determine the associations of candidate variables with in-hospital VTE after hernia surgery. Multicollinearity among the variables was screened according to the variance inflation factor (VIF) (VIF > 5 was considered strong collinearity). 12 Two criteria were considered necessary for a variable to be included in the final prediction model: (I) a univariate p value indicative of VTE ≤ 0.05 and (II) a plausible association with VTE based on the Caprini and Padua scores. We assigned weighted points proportional to β coefficients multiplied by 2 to the nearest integer for the predictors determined in the multivariate analysis. Using this scoring system, we derived four risk categories: low risk, intermediate risk, high risk and very high risk. A similar risk classification was also derived according to the Caprini scoring system. The trend in the risk for in-hospital VTE among risk categories was evaluated by the Cochran-Armitage trend test. The overall performance of model was assessed by the Brier score and Nagelkerke R2, and its discrimination was examined by the c-statistic. Decision curve analysis was performed to evaluate the net clinical benefit of the models for predicting in-hospital VTE after hernia surgery, with zero indicating no benefit and values >0 indicating increased benefit. 13 Net benefit was defined as the difference between true-positive and false-positive rates across a range of possible individual high-risk thresholds. For any given threshold, the model with the higher net benefit is preferred. 13 All statistical analyses were performed by an independent statistician (Y. Y.) who used R software version 4.0.3., and P < .05 was considered statistically significant. All authors had access to the study data and had reviewed and approved the final version of manuscript.
Results
Patient Enrollment Process and Patient Characteristics
As shown in Supplementary Table 1, 14 322 patients who were enrolled in the CHAT-1 study between January first, 2017 and December 31st, 2017 were selected in this study. After excluding 166 patients aged <18 years and 2449 patients consisting of missing data or illogical data, 11 707 patients were eligible for further analysis. The demographics and characteristics of patients are presented in Table 1. Almost 90% of patients were male and 20% of patients were aged ≥75 years. About one-third of patients had one or multiple comorbidities, including hypertension (24.9%), diabetes (7.2%), coronary heart disease (7.0%). More than 90% of patients were reducible hernia and 4.6% were recurrent hernia. Open surgery accounted for 47.1% of patients. A total of 602 patients (5.1%) interrupted the antithrombotic agents before surgery. The in-hospital VTE rate after hernia surgery in this study was 0.14% (16 events).
Demographics and Characteristics of Patients in this Study.
Abbreviations: SD, standard deviation; TIA, transient ischemic attack; VTE, venous thromboembolism. The bold indicates statistically significant between presence of VTE or not (P < .05).
Predictors of in-Hospital VTE After Hernia Surgery
As shown in Supplementary Table 2, 36 potential predictors were initially included in the univariate regression analysis and 11 of them were identified as statistically associated with the risk of in-hospital VTE after hernia surgery: serious lung disease, varicose veins of lower extremity, history of PCI, history of VTE, family history of thrombosis, congenital or acquired thrombophilia, coronary heart disease, reducible hernia, recurrent hernia, interruption of antithrombotic agents, oral contraceptives or hormone replacement (P < .05 for each variable). Except for 9 categorical variables and 2 continuous variables, other 14 variables (P > .05 for each variable) related to VTE based on the Caprini and Padua scores were also included in the multivariate regression analysis. Therefore, we finally involved 25 candidate predictors for prediction model development and identified 5 variables as predictors of in-hospital VTE after hernia surgery (Table 2).
Multivariate Logistic Regression Analysis of 25 Predictors for VTE after Inguinal Hernia Surgery and the Scoring System.
Abbreviations: CI, confidence interval; OR, odds ratio; PCI, percutaneous coronary intervention; VIF, variance inflation factor (VIF < 5 indicates low multicollinearity); VTE, venous thromboembolism.The bold indicates the 5 variables as predictors of in-hospital VTE after hernia surgery.
Weighted points were assigned proportional to β coefficients multiplied by 2 to the nearest integer in the significant predictors.
Include lumbar or epidural anesthesia.
Prediction Model Development
The VIF ranged from 1.05 to 3.77 (<5), indicating that the multicollinearity among the variables was not a concern. Weighted points of 5 predictors were assigned proportionally to β regression coefficient values by multiplying 2 to obtain the nearest integer: 5 points for varicose veins of lower extremity; 4 points for history of VTE; 8 points for family history of thrombosis; 4 points for interruption of antithrombotic agents, and −4 points for reducible hernia (Table 2).
The established prediction model (the CHAT score: Chinese Hernia Adult Thromboembolism) is presented in Table 3. This model had good overall performance, with a Nagelkerke R2 of 0.27 and a Brier score of 0.16, and showed good discrimination, with a c-statistic of 0.81 (95% CI, 0.80 to 0.81; Table 4). According to the risk classification, the CHAT score was categorized as low-risk (−4 points), intermediate-risk (0 to 1 point), high-risk (4 points) or very high-risk (≥5 points) for in-hospital VTE after hernia surgery. As a result, the rates of VTE for each risk category were 0.05%, 0.39%, 0.73% and 8.62% (Table 5), and a significantly increasing trend of risk from low-risk to very high-risk groups was observed (P < .01 for Cochran-Armitage trend test). The score identified a considerable variability (from 0.05% to 8.62%) in VTE risk among the overall population after hernia surgery.
Distribution of Prediction Model for in-Hospital VTE after Hernia Surgery.
Abbreviations: CI, confidence interval; No., number; VTE, venous thromboembolism.
Performance of the Prediction Model and Caprini Score
Abbreviation: CI, confidence interval.
Risk Classification for in-Hospital VTE after Hernia Surgery in CHAT and Caprini Scores
Abbreviations: CI, confidence interval; No., number; VTE, venous thromboembolism.
*P value of Cochran-Armitage test for trend <.001 in both CHAT and Caprini scores.
Example for the use of CHAT Score
As shown in Tables 2 and 3, a male patient who was a reducible hernia, had a history of VTE, and interrupted antithrombotic agents before operation. Total score = 4 points (for history of thrombosis) + 4 points (for interruption of antithrombotic agents) − 4 points (for reducible hernia) = 4 points. This patient therefore fits the high-risk category, with the in-hospital VTE risk of 0.73%.
Comparison of the Model Performance Between the CHAT and Caprini Scores
As shown in Table 4, the Caprini score also had a good model performance, with a Nagelkerke R2 of 0.15 and a c-statistic of 0.79, which was relatively lower than the CHAT score (Nagelkerke R2: 0.27; c-statistic: 0.81). A decision curve analysis was conducted to ascertain the applicability of the CHAT score to clinical practice. This analysis indicated a threshold to define in-hospital VTE risk>0.05% using the CHAT score (Figure 1). In summary, compared with the Caprini score, the CHAT score showed superior net benefit and improved predictive performance for in-hospital VTE after hernia surgery.
Decision curve analysis of the CHAT score and Caprini score for in-hospital VTE after hernia surgery. The result showed a threshold to define in-hospital VTE risk >0.05% using the CHAT score. The horizontal red line represents the assumption that no patient will suffer the event, and the solid blue line represents the assumption that all patients will suffer the event.
Characteristics and Management After in-Hospital VTE
Sixteen patients (16/11,707, 0.14%) experienced in-hospital DVT after inguinal hernia surgery. The patient age ranged from 49 to 90 years and most (14/16, 87.50%) were male. Five patients fell in the very high-risk category (≥5 points using the CHAT score). Notably, only 5 patients (31.30%) had received mechanical or pharmacological prophylaxis of VTE during the hospitalization. After diagnosed with DVT, all patients received guideline-recommended anticoagulation, with details described in Supplementary Table 3.
Discussion
Major Findings
In this study, we developed a prediction model for in-hospital VTE after hernia surgery, based on the data of 11 707 patients in a retrospective multicenter study. The major findings were as follows: (I) 36 candidate predictors were explored and 5 of them were finally identified as predictors associated with in-hospital VTE: varicose veins of lower extremity, history of VTE, family history of thrombosis, interruption of antithrombotic agents, and reducible hernia; (II) the established prediction model, namely the CHAT score, achieved good model performance (c-statistic, 0.81; Nagelkerke R2, 0.27; Brier score, 0.16); (III) compared with the Caprini score, the CHAT score showed superior net benefit and improved predictive performance in predicting risk for in-hospital VTE after hernia surgery.
Pivotal Predictors of in-Hospital VTE After Hernia Surgery
VTE episodes are still a clinically significant complication resulting in prolonged hospitalization and reduced life quality. In this study, varicose veins of lower extremity (β coefficient, 2.45), history of VTE (β coefficient, 2.07), and family history of thrombosis (β coefficient, 3.86) were detected as extremely pivotal predictors for predicting in-hospital VTE after hernia surgery, which are also vital risk factors in the Caprini score. 14 In addition, we identified that reducible hernia procedure decreased the risk of in-hospital VTE. More complicated types such as irreducible hernia, incarcerated hernia, and strangulated hernia were assumed to have an abdominal wall plication during abdominoplasty or transverse rectus abdominus myocutaneous flap breast reconstruction, which could significantly increase the intra-abdominal pressure and result in venous stasis in the lower extremities and dilation of the common femoral vein.15,16 These are known to create vein wall microtears and activate the local clotting cascade and initiate thrombus formation. 17 Furthermore, the interruption of antithrombotic agents was considered a predictor of in-hospital VTE, with the β coefficient of 1.91. Patients with in-hospital VTE were much more common to interrupt the antithrombotic agents (43.80%) than those without (5.09%), which may be informative in the management of patients with hernia surgery.
Comparison with the Current Models
Considering the relatively low incidence of VTE after hernia surgery, the development of a prediction score with high predictability is of great importance. Scarce studies focused on the prediction model for VTE after hernia surgery. Pannucci et al. 18 reported a weighted VTE risk assessment model for hernia surgery based on the database of the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) involving 113 873 patients. This study explored 14 variables using multivariate analysis and yielded a moderate model performance (c-statistic, 0.79 ± 0.01). Although this was a standard modeling study specific to the population undergoing hernia procedure, it still had several limitations: (I) variables selected were based on the ACS-NSQIP database instead of the classic VTE prediction models such as the Caprini score, Padua score, inevitably leaving out certain pivotal predictors such as history of VTE and family history of thrombosis; (II) the vast sample size could explore minor differences of the association between the variables and VTE risk, with a significant p value; however this association reflected not necessarily the clinical importance; (III) the said issues of study finally derived a relatively complicated prediction model that incorporated 14 predictors and only achieved a moderate model performance. In comparison, the CHAT-1 study 19 investigating the current prevalence of early VTE in Chinese hernia patients could provide a suitable sample size and a tailored variables pool. In this study, we selected the potential predictors on the basis of the recognized scores, hernia type, and drug-related characteristics. Finally, we developed a practical 5-item model (the CHAT score) for in-hospital VTE after hernia surgery, with good performance discrimination (c-statistic, 0.81; 95% CI, 0.80 to 0.81). It should be noted that the c-statistic reached its satisfactory value, since the lower limit of 95%CI was 0.80. Compared with a gold standard for VTE risk assessment (the Caprini score), the CHAT score had superior net benefit (threshold value: 0.05%) and improved predictive performance (c-statistic: 0.81 vs 0.79). Accordingly, we believe that the CHAT score could be applied as a simpler and more effective tool to clinical decision-making for identifying patients at risk of in-hospital VTE after hernia surgery.
Management Considerations
Only 23.40% of patients underwent VTE risk assessment using the Caprini score in our previous study. 19 Therefore, a simple prediction model specifically aiming at the population after hernia surgery might be desirable to triage patients. First, surgeons should conduct a comprehensive assessment of patient conditions for the risk factors before procedure. Patients with a history of varicose veins of lower extremity, history of VTE, or family history of thrombosis might be at a very high-risk for in-hospital VTE (the CHAT score ≥5 points). These patients often take antithrombotic agents routinely, and the interruption could definitely increase the risk of VTE, whereas continual antithrombotic therapy could increase the risk of bleeding. Therefore, heparin bridging might be an option to balance the risk of thrombosis and bleeding. As for complicated hernia types, specific techniques such as laparoscopic or robotic hernia repair could minimize surgical trauma and shorten the time of abdominal wall tight closure, 4 leading to reduced VTE risk. Second, patients at very high risk for in-hospital VTE should receive guideline-recommended pharmacological prophylaxis for 10 to 14 days after hernia surgery. Third, with pharmacological prophylaxis such as low-molecular-weight heparin, potential thrombosis and bleeding events should be closely monitored via D-dimer detection and ultrasonic evaluation. Taken together, the matter of prime importance is to identify patients at the highest risk, then the preventive measures to improve prognosis and accelerate hospital discharge could be conducted.
Strengths and Limitations
Several strengths of this study warrant mention. First, according to the TRIPOD guidelines, 8 the design of the present study is robust. The method also satisfied recent developments for improved prediction model assessment, including decision curve analysis. 13 Second, the data for creating a prediction model were derived from a big multicenter cohort. Third, a simple 5-item prediction model is easy to understand and convenient for clinical practice. Certainly, this study has several inherent limitations. First, this study is retrospective design and the prediction model was developed in China. Therefore, it is unclear that whether this model can be extrapolated to other geographical areas, such as U.S.A or Europe. Second, certain intraoperative variables such as surgery techniques were not considered in this model. Third, this study only assessed the VTE incidence during hospitalization and inevitably underestimated the overall VTE burden in patients during the perioperative period. Lastly, given the low incidence of VTE after hernia surgery, we did not conduct an external validation in this study. For further study, our ongoing study involving 1008 patients with hernia (the CHAT-3 trial, registration number: ChiCTR2000033769) will confirm this prediction model.
Conclusions
In summary, we derived a practical 5-item prediction model (the CHAT score) to identify patients at the highest risk of in-hospital VTE following hernia surgery. This model can be applied in routine practice to optimize the management of patients after hernia surgery based on individual VTE risk. However, further external validation is required.
Supplemental Material
sj-docx-1-cath-10.1177_10760296211051704 - Supplemental material for Prediction Model of in-Hospital Venous Thromboembolism in Chinese Adult Patients after Hernia Surgery: The CHAT Score
Supplemental material, sj-docx-1-cath-10.1177_10760296211051704 for Prediction Model of in-Hospital Venous Thromboembolism in Chinese Adult Patients after Hernia Surgery: The CHAT Score by Zhi-Chun Gu, Chi Zhang, Ya Yang, Ming-Gang Wang, Hang-Yu Li and Guang-Yong Zhang in Clinical and Applied Thrombosis/Hemostasis
Footnotes
Acknowledgements
We thank the prof. Yan Che for the statistical help in this study.
Author Contributions
Zhang is guarantor of the entire manuscript. Gu, Wang, and Li contributed to the study conception and design, critical revision of the manuscript for important intellectual content. Zhang and Yang contributed to the data acquisition, analysis, and interpretation. All the authors have read and approved the final version of this manuscript.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by Research project on sustained improvement of evidence-based management of health care quality (No. YLZLXZ-2020-006), Renji Boost Project of National Natural Science Foundation of China (RJTJ-JX-001), Research Funds of Shanghai Health and Family Planning commission (20184Y0022), Cultivation fund of clinical research of Renji Hospital (PY2018-III-06), Clinical Pharmacy Innovation Research Institute of Shanghai Jiao Tong University School of Medicine (CXYJY2019ZD001), and Shanghai “Rising Stars of Medical Talent” Youth Development Program—Youth Medical Talents—Clinical Pharmacist Program (SHWJRS [2019]_072).
Ethical Approval
This study was conducted in accordance with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards, and was approved by the Ethics Committee of Beijing Chaoyang Hospital, Capital Medical University (2018-kd-315).
Data Availability
The data that support the findings of this study are available on reasonable request from the corresponding authors.
Informed Consent on Studies with Human Subjects
Written informed consent for hernia surgery was obtained from all patients before the procedure. The need for informed consent was waived because this study was a retrospective design and the patient's data were anonymized.
Supplemental Material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
