Abstract
Background:
With the popularization of Enhanced Recovery After Surgery (ERAS), identifying patients with complications before discharging becomes important. This study aimed to explore the efficacy of C-reactive protein (CRP) in predicting infectious complications after gastrectomy.
Methods:
Patients with gastric cancer who underwent gastrectomy at Beijing Cancer Hospital from March 2017 to April 2018 were enrolled in the training set. Complications were prospectively registered. Receiver operating characteristic analysis was performed to assess the diagnostic accuracy of CRP via evaluating the area under the curve (AUC). Patients who had CRP tested on postoperative day (POD) 5 and accepted gastrectomy from April to December 2018 were included in the validation set to validate the cut-off value of CRP obtained from the training set.
Results:
A total of 350 patients were included (263 patients in the training set and 87 patients in the validation set). Out of these, 24 patients were diagnosed with infectious complications and 17 patients had anastomotic leakage in the training set. The CRP level on POD5 had superior diagnostic accuracy for infectious complications with an AUC of 0.81. The cut-off value of CRP on POD5 at 166.65 mg/L yielded 93% specificity and 97.2% negative predict value (NPV); For anastomotic leakage, the AUC of CRP on POD5 was 0.81. Using the cut-off value of CRP at 166.65 mg/L on POD5 achieved 92% specificity and 98.6% NPV. The optimal cut-off value (CRP 166.65 mg/L on POD5) was validated in the validation set. It achieved 97.5% specificity and 94.0% NPV for infectious complications, and 97.6% specificity and 96.4% NPV for anastomotic leakage.
Conclusion:
CRP is a reliable predictive marker for the diagnosis of inflammatory complications following gastric surgery. However, this study was based on preliminary data. The validity of this data needs confirmation by a larger number of cases.
Introduction
Gastric cancer is the second most common malignant tumor in China with high morbidity and mortality. 1 Gastrectomy with lymph node dissection remains the main therapeutic method for most patients with gastric cancer. 2 Despite the rapid development of surgical techniques, postoperative complications are still common. Among them, postoperative infectious complications (ICs), especially anastomotic leakage (AL), are known to prolong hospital stay, increase perioperative mortality, and have worse long-term oncological outcomes.3,4 Moreover, with the increasing popularity of fast track care, also known as enhanced recovery after surgery (ERAS), patients are often discharged on day 5–7 after gastrectomy. It is essential to identify patients with ICs or AL before discharging. In other words, precise screening of complications in the early postoperative phase is of fundamental importance in the ERAS program.5–7
C-reactive protein (CRP), an important systemic inflammatory biomarker, is extensively used in clinical settings for infection diagnosis.8,9 Many previous studies have discussed the correlation between serum CRP level and ICs in esophageal, pancreatic, and colorectal surgery.10–15 The diagnostic accuracy of CRP for AL has also been explored in patients who accepted the ERAS after bariatric surgery.16–18 However, despite their retrospective nature, the sample sizes are often too small to draw a conclusion. In addition, there are only a few studies that have touched on predicting the efficacy of CRP for ICs or AL after gastrectomy for gastric neoplasm, let alone furthering the validation of CRP. To this end, the aim of our study was to investigate the role of CRP as an early predictor of complications after gastrectomy in our prospectively maintained database and conduct internal validation to explore its possible role in the ERAS program.
Materials and methods
Study design
This study includes two parts, that is, the training set and the validation set. The first part was embedded in the APPEAL-GC study (Analysis of Parameters Predictive for Evident Anastomotic Leakage-Gastric Cancer) and shared the same data source. In this part, patients who underwent elective gastrectomy for gastric tumor in the Gastrointestinal Cancer Center, Ward I, Peking University Cancer Hospital and Institute from 1 April 2017 to 1 April 2018 were consecutively recruited. The data collection methods were in accordance with the APPEAL-II trial,19,20 a multi-centered European trial, but in gastric cancer population. The detailed methods of the APPEAL-GC study are reported elsewhere. For patients in the training set, we also prospectively collected their intra-abdominal drainage fluids for further analysis.
Patients who accepted gastrectomy in our ward and had serum CRP tested on postoperative day (POD) 5 from 24th April to 24th December 2018 were included for validation. This part was used to validate the cut-off value of CRP obtained from the training set.
The study was approved by the medical ethics committee of Peking University Cancer Hospital. All patients in this study have signed the written informed consent. There were no patients under the age of 16 in our study.
Clinical data registration
In the training set, the patients’ demographic data and clinical pathological characteristics were obtained from a prospectively maintained database. The registration of postoperative complications was prospectively conducted in the case report form, which followed the protocol of the APPEAL trial, and the severity of complications was scored using the Clavien–Dindo grading system. 21 The white blood cell (WBC) count and CRP levels on POD1, POD3, and POD5 were retrospectively extracted from the electronic medical record system. In detail, the following data were included for analysis:
• Basic information: gender, age, body mass index (BMI), ASA (American Society of Anesthesiologists) score, diabetes, hypertension, preoperative treatment.
• Surgical information: operative approach.
• Pathological information: tumor location, Clinical TNM stage (cTNM) stage.
• Complication information: AL, abdominal abscess, pleural effusion, surgical site infection, infection without a definite cause, empyema, pneumonia.
• Laboratory tests information: WBC and CRP on POD1, 3, 5.
In the validation, the included patients’ data were retracted from the prospectively maintained database. The complication data were reviewed by surgeons and consultants weekly.
Definition of complications
In this study, the ICs included AL, abdominal abscess, pleural effusion, surgical site infection, infection without a definite cause, empyema, and pneumonia. The diagnostic criteria are in accordance with the APPEAL trial. The major cause of ICs, that is, AL, was further specified and its diagnostic criteria was as follows: radiological changes were seen after surgery (with or without clinical intervention); color, turbidity, fecal matter, or other indicative changes occurred in the drainage fluid; the peri-anastomotic abscess and agnogenic intra-abdominal infection was also considered as a manifestation of AL. 22
Statistical analysis
All statistical analyses were performed using SPSS 22.0. Quantitative variables following the Gaussian distribution were reported as mean and standard deviation, whereas non-Gaussian distribution variables were defined by median and range. Qualitative variables were reported as the number of cases and percentages. Differences in quantitative variables following a Gaussian distribution were tested using Student’s t-test; the Kruskal–Wallis or Mann–Whitney tests were used for variables following the non-Gaussian distribution. A comparison of qualitative variables was performed with the chi-square test. Receiver operating characteristic analysis (ROC) was performed to assess the diagnostic accuracy of CRP via evaluating the area under the curve (AUC). AUC was interpreted as follows: a test with an AUC of >0.5 indicated some ability of the test to discriminate between those with and without the outcome of interest, but tests with an AUC of ⩾0.8 were considered to show high-diagnostic accuracy, with those closest to 1 considered to be the most predictive. Cut-off values for CRP were selected based on those values that gave the best combination of high sensitivity and high specificity. Univariate and multivariate logistic regression analyses were performed to identify clinical risk factors for the development of ICs or AL. Selected variables for the multivariate analysis, and any variable whose univariate test p value was < 0.05, were considered as candidates for inclusion. In all cases, bilateral p < 0.05 was considered statistically significant.
Results
A total of 350 patients were enrolled in this study (263 patients in the training set and 87 patients in the validation set). The 263 patients in the training set comprised 209 males and 54 females with a median age of 62 (54–67) years, ranging from 27 to 83. The median BMI was 24.22–26 The important comorbidities for patients in the training set included diabetes (24/263) and hypertension (75/263). The 87 patients in the validation set comprised 61 males and 26 females with a median age of 62 (54–66) years, ranging from 27 to 82. The median BMI was 24.22–26 There were 9 patients with diabetes and 25 patients with hypertension in the validation set. Patients’ characteristics, ASA score, comorbidities, and surgical data are shown in Tables 1 and 2. For the training set, the postoperative complications were diagnosed in 81 patients within 30 PODs, and the complication rate was 30.79%. ICs were observed in 24 patients, including 17 patients who suffered from AL; the AL rate was 6.46%. Furthermore, 5 patients of those 24 patients were diagnosed with more than one ICs (Supplemental Table S1). Apart from one patient, all patients survived until 30 days post-operatively.
Patients’ characteristics, surgical information, and pathological information in training set (n = 263).
Bold values here represent the p values 0.05, which were considered statistically significant.
Mann–Whitney tests.
ASA, American Society of Anesthesiologists; BMI, Body mass index; cTNM, Clinical TNM Stage.
Patients’ characteristics, surgical information, and pathological information in validation set (n = 87).
Bold values here represent the p values 0.05, which were considered statistically significant.
Mann–Whitney tests.
ASA, American Society of Anesthesiologists; BMI, Body mass index; cTNM, Clinical TNM Stage.
In the training set, for patients with ICs, WBC count (determined on POD5) was significantly increased in contrast to patients without ICs (p = 0.018). The serum CRP levels were also higher in patients with ICs on both POD3 (p = 0.016) and POD5 (p = 0.017; Supplemental Table S2a, Figure 1). However, there were no significant differences in CRP levels between patients with and without AL on POD1, POD3, or POD5. By comparison, WBC count on POD5 was remarkably higher in patients with AL (p = 0.045) (Supplemental Table S2b, Figure 2).

Postoperative chronological changes in WBC (a) and CRP level (b) between patients with or without infectious complications.

Postoperative chronological changes in WBC (a) and CRP level (b) between patients with or without anastomotic leakage.
ROC analysis was applied for the detection of ICs (Table 3, Figure 3). In the training set, on POD1, AUC of the WBC count was 0.497 (p = 0.964). On POD3 and POD5, the AUCs of the WBC count were 0.594 (p = 0.244) and 0.678 (p = 0.186), respectively. However, both of their optimal cut-off values were below the upper limit of the normal range (10 × 109/L). The corresponding AUCs of CRP on POD1 and POD3 were 0.530 (p = 0.646) and 0.693 (p = 0.017). On POD5, the AUC of CRP was 0.811 (p = 0.021), the optimal cut-off value was 166.65 mg/L, which achieved 60% sensitivity, 93% specificity, 97.2% negative predictive value (NPV), and 37.5% positive predictive value (PPV). Based on the results from the training set, the optimal cut-off value (CRP 166.65 mg/L on POD5) was further validated in the validation set. It could achieve 29% sensitivity, 98% specificity, 94.0% NPV, and 50.0% PPV. The AUC was 0.857 (p = 0.002; Supplemental Table S3). In detail, among the validation set of 87 patients, there were 83 patients whose CRP value on POD5 was below the cut-off value. Of those, five patients developed ICs.
Receiver operating characteristic analysis for the diagnosis of infectious complication.
Bold values here represent the p values 0.05, which were considered statistically significant.
AUC, area under the curve; CI, confidence interval; CRP, C-reactive protein; NPV, negative predict value; POD, postoperative day; PPV, positive predict value; WBC, white blood cell.

ROC curves for the diagnostic accuracy of WBC and CRP on (a) POD1, (b) POD3, and (c) POD5 in predicting infectious complications.
ROC analysis for the diagnosis of AL was also implemented in the training set (Table 4, Supplemental Figure S1). Using ROC analysis for AL, the AUC of the WBC count on POD1 was 0.475 (p = 0.566). The AUCs of the WBC count on POD3 and POD5 were 0.457 (p = 0.667) and 0.676 (p = 0.305), respectively. As for ICs, their optimal cut-off values failed to meet a level upon the upper limit of the normal range. In contrast, the AUC of CRP level on POD1 and POD3 were 0.565 (p = 0.385) and 0.559 (p = 0.549), respectively. On POD5, the AUC of CRP level was 0.806 (p = 0.073); a cut-off value at 166.650 mg/L achieved 67% sensitivity, 92.0% specificity, 98.6% NPV, and 25.0% PPV. This cut-off value was also applied to the validation set, which achieved 40% sensitivity, 98% specificity, 96.4% NPV, and 50.0% PPV. The AUC was 0.866 (p = 0.006; Supplemental Table S3). Specifically, CRP level on POD5 of 83 patients in the validation set was lower than the cut-off value, and AL occurred in three of those patients.
Receiver operating characteristic analysis for the diagnosis of anastomotic leakage.
AUC, area under the curve; CI, confidence interval; CRP, C-reactive protein; NPV, negative predict value; POD, postoperative day; PPV, positive predict value; WBC, white blood cell.
Furthermore, based on data from the 263 patients in the training set, the univariate analysis showed that age, tumor location, resection range, WBC count on POD3 (p = 0.047), and CRP level on POD3 (p = 0.025) and POD5 (p = 0.003) were correlated to developing ICs. Then, these three systemic infectious markers were separately adjusted according to age and tumor location by using multivariate analysis. The outcome proved that a CRP level greater than 69.450 mg/L on POD3 (p = 0.047) and greater than 166.65 mg/L on POD5 (p = 0.003) were both independent risk factors for ICs (Table 5). The distribution of age, tumor location, operative approach, resection range, and CRP level on POD1 (p = 0.046) and POD5 (p = 0.015) were significantly different between patients with and without AL on univariate analysis; however, only CRP level on POD5 greater than 166.650 mg/L (p = 0.025) was identified as an independent risk factor for AL after multivariate analysis (Table 6).
Univariate and multivariate analysis of WBC and CRP level for infectious complication.
Bold values here represent the p values 0.05, which were considered statistically significant.
CI, confidence interval; CRP, C-reactive protein; OR, odds ratio; POD, postoperative day; WBC, white blood cell.
Univariate and multivariate analysis of WBC and CRP level for anastomotic leakage.
Bold values here represent the p values <0.05, which were considered statistically significant.CI, confidence interval; CRP, C-reactive protein; OR, odds ratio; POD, postoperative day; WBC, white blood cell.
Discussion
In our study, we analyzed the diagnostic value of the systematic inflammatory parameters in a prospectively maintained database. We found that CRP on POD5 is a very good candidate for ICs screening, which was also confirmed in our further internal validation. Our data suggest that a CRP level lower than 166.650 mg/L can be used as a screening marker in the ERAS program for a discharge decision making.
In recent years, there are a series of studies attempting to establish a cut-off value for the systematic inflammatory parameters for postoperative complications, such as AL or intra-abdominal abscesses. One common finding of those studies is that the predictive value of WBC count is limited, which was also confirmed in our study. On top of that, in general, these studies can be categorized into two types: one is to predict the complications with an abnormal CRP level in the early PODs, and the other is to find those patients who are free of complications before discharge with a relatively “acceptable” CRP level.
To summarize those studies, it seems that predicting complications with CRP tests is unsatisfactory in the early PODs. Kim et al. reported a cut-off value of 83 mg/L on POD1 after gastrectomy to predict ICs, while the sensitivity was only 40% and the AUC was 0.56. 23 Similar data were also reported in other types of gastrointestinal surgery,10,15 which indicate a poor diagnostic ability of CRP in the early PODs after gastrointestinal surgery. This is in accordance with the clinical experience that abnormal CRP level is very common in the early days after surgery. Giaccaglia et al. suggested to avoid the measurement of the systematic inflammatory markers such as CPR, procalcitonin (PCT), or WBC on POD1, considering a possible physiological fluctuation by transient bacterial contamination during the operation or preparation of intestinal anastomosis. 22 Different from the data on POD1, the diagnostic efficiency of CRP on POD3 seems better in this study. Our results revealed that the optimal cut-off value of CRP on POD3 had the best sensitivity for both ICs (86%) and AL (78%). However, the poor PPVs (13.5% for ICs, 7.9% for AL) limited its application in clinical.
In contrast to predicting the high-risk patients of complications, some studies investigated the potential of CRP in excluding those low-risk patients in the recovery progress, which is extremely useful in terms of the ERAS program. A meta-analysis that included 7 studies with a total of 2483 patients has concluded that CRP was a useful negative predictive parameter for AL after colorectal surgery. 24 It was also reported that on the third day after minimally invasive esophagectomy, the cut-off value of CRP at 181 mg/L achieved 74% specificity and 94% NPV. The authors concluded that such results indicated that CRP on POD3 could be used for early oral diet advancement within an ERAS program.11,25 Our study shows that the cut-off value of CRP at 69.450 mg/L on POD3 yielded over 97% NPV for both ICs and AL, but its specificity was under 50%. By contrast, on POD5, the cut-off value of CRP at 166.650 mg/L achieved the best balance of specificity and NPV for both ICs and AL (both >90%), which was further confirmed in the validation set. Furthermore, the AUCs of CRP on POD5 for ICs and AL were also highest (both >0.8). The reason for the remarkably enhanced diagnostic capacity of CRP may be that, on the fifth day after surgery, the mixing effects such as surgical trauma, blood loss, or absorption of necrotic tissues that are known to increase CRP levels were usually well controlled. 17 Based on over 90% specificity and an equally high NPV, CRP can be used as an indicator for safe discharge in the ERAS program. For example, if the CRP level does not exceed 166.650 mg/L [which is much higher than the normal level (<8 mg/L)], patients can be allowed to discharge on POD5.
In fact, the clinical utility of CRP on POD5 is evident. Garcia-Granero et al. published a study with 250 patients after colorectal operation and likewise found that CRP on POD5 was an eligible marker for early discharge, as its specificity was 83% and NPV was 98%. 26 Benoit et al. suggested that a CRP before POD5 of <100 mg/L was reassuring and may permit the patient to leave hospital in safe conditions.26,27 In addition, the PREDICS (Procalcitonin Reveals Early Dehiscence in Colorectal Surgery) study also showed that CRP predicts safe patient discharge after colorectal surgery. 28 However, in the field of gastric surgery, to the best of our knowledge, there were few studies exploring the role of CRP in safe discharge during early postoperative phase, at least in terms of gastric cancer surgery. Our study proved that CRP on POD5 was a reliable biomarker for screening out patients without ICs or AL. This was the most valuable finding of this study and important within the ERAS programs in order to ensure a safe and early discharge.
However, there were several limitations to the present study. First, although postoperative complications were prospectively registered, the laboratory data were retrospectively collected, which resulted in an incomplete CRP and WBC count data. Second, although the internal validation was performed, our study was carried out in a single center, and the data was preliminary. The results need to be further validated in multi-center research with a higher sample volume. This is certainly one of our on-going research topics. Finally, only two inflammatory markers were chosen for analysis; postoperative parameters such as PCT and serum album were not included. As a result, the PPVs of CRP were generally low, particularly for predicting AL. Using animal models and basic medical research, inflammatory cytokines, collagen-related enzymes, and interleukins were demonstrated to participate in the mechanism of AL development. Integrating serum CRP with those parameters to construct a predictive model might achieve a better clinical applicability.
Conclusion
Serum CRP was a useful negative screening marker for ICs after gastric surgery among patients within the ERAS program. Because of a high negative predictive efficacy, patients after gastrectomy on POD5 would be allowed to discharge if their CRP levels were under the cut-off value.
Supplemental Material
Supplementary_material – Supplemental material for Clinical predictive efficacy of C-reactive protein for diagnosing infectious complications after gastric surgery
Supplemental material, Supplementary_material for Clinical predictive efficacy of C-reactive protein for diagnosing infectious complications after gastric surgery by Jinyao Shi, Zhouqiao Wu, Qi Wang, Yan Zhang, Fei Shan, Shiyang Hou, Xiangji Ying, Longtao Huangfu, Ziyu Li and Jiafu Ji in Therapeutic Advances in Gastroenterology
Supplemental Material
TAG936542_Supplemental_Figure_CLN – Supplemental material for Clinical predictive efficacy of C-reactive protein for diagnosing infectious complications after gastric surgery
Supplemental material, TAG936542_Supplemental_Figure_CLN for Clinical predictive efficacy of C-reactive protein for diagnosing infectious complications after gastric surgery by Jinyao Shi, Zhouqiao Wu, Qi Wang, Yan Zhang, Fei Shan, Shiyang Hou, Xiangji Ying, Longtao Huangfu, Ziyu Li and Jiafu Ji in Therapeutic Advances in Gastroenterology
Footnotes
Author contributions
Jinyao Shi and Zhouqiao Wu contributed to data analysis and manuscript writing. Qi Wang, Yan Zhang, Fei Shan, Shiyang Hou, and Xiangji Ying contributed to database maintenance and help analyse data. Jiafu Ji and Ziyu Li designed this study, reviewed and revised the paper and submitted the final manuscript. All authors approved the final manuscript and its submission.
Conflict of interest statement
The authors declare that there is no conflict of interest.
Data availability statement
All datasets generated for this study are included in the manuscript/supplementary files.
Ethics statement
The current study is approved by the Peking University Cancer Hospital Ethics Committee (2016YJZ32).
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was funded by the National Key Technology Research and Development Program of the Ministry of Science and Technology of China (D171100006517004), Peking University Medicine Fund of Fostering Young Scholars’ Scientific & Technological Innovation (BMU2018PYB013) and Bethune Charitable Foundation (to Z. Wu).
Informed consent
All patients in this study have signed the written informed consent.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
