Abstract
Background:
Metastasis accounts for the majority of deaths in patients with breast cancer. Liver metastasis is reported common for breast cancer patients. The purpose of this study was to construct a nomogram to predict the likelihood of subsequent liver metastasis in patients with nonmetastatic breast cancer, thus high-risk patient populations can be prevented and monitored.
Methods:
A total of 1840 patients with stage I-III breast cancer were retrospectively included and analyzed. A nomogram was constructed to predict liver metastasis based on multivariate logistic regression analysis. SEER database was used for external validation. C-index, calibration curve and decision curve analysis were used to evaluate the predictive performance of the model.
Results:
The nomogram included 3 variables related to liver metastasis: HER2 status (odds ratio (OR) 1.86, 95%CI 1.02 to 3.41;
Conclusion:
We have developed and validated a robust tool enabled to predict subsequent liver metastasis in patients with nonmetastatic breast cancer. Distinguishing a population of patients at high risk of liver metastasis will facilitate preventive treatment or monitoring of liver metastasis.
Introduction
Breast cancer is one of the leading causes of cancer-related deaths among women worldwide. 1 Although only 6%-10% of breast cancer patients are diagnosed with metastatic disease, approximately 30% of women diagnosed with the nonmetastatic disease will relapse after treatment. 2,3 Breast cancer mainly metastasizes to bone, lung, liver and brain through circulation; among them, the liver is the third most common distant metastatic site of breast cancer. 4 Liver metastasis is reported to be responsible for approximately 20% to 35% of metastatic breast cancer patients’ death. 5 -7 Studies have shown that breast cancer patients with liver metastasis exhibit poor prognosis and short median survival. The median survival time of those patients without any treatment was about 4-8 months 8 compared to 13-31 months 2,3,9,10 after systemic treatment. For the treatment, systematic therapy is still the backbone to treat breast cancer with liver metastasis patients although surgery, radiofrequency ablation, or radiotherapy can be used for liver metastasis. 11,12
Currently, the occurrence of liver metastasis from breast cancer cannot be accurately predicted. The construction of nomograms based on known prognostic factors is increasing and widely used to predict specific outcomes. 13,14 We hypothesized a nomogram could be constructed by combining selected clinical and pathological variables using a multivariate model to predict the likelihood of postoperative liver metastasis in early breast cancer patients. This nomogram can be used to identify subgroups of high-risk patients, develop targeted screening and new preventive treatment strategies for early-stage breast cancer patients, and even improve life quality and survival outcomes. 15,16 Therefore, we constructed and validated such a nomogram using retrospectively study data from 2 breast cancer patient populations.
Methods
The electronic database of the department of breast cancer at Sun Yat-sen University Cancer was searched and retrospectively reviewed from January 2008 to December 2010. Information from 1840 consecutive patients with nonmetastatic breast cancer was collected to serve as the basis for this study. The inclusion criteria for this study were: (1) female; (2) stage I-III breast cancer; (3) underwent mastectomy or breast-conserving surgery; (4) confirmed by the pathological diagnosis as invasive carcinoma. Exclusion criteria were: (1) male; (2) distant metastasis at initial diagnosis; (3) incomplete information such as TNM staging or pathological diagnosis; (4) other primary malignancies, including pre-diagnosis or follow-up of breast cancer. The staging of the tumor was based on the eighth edition of the TNM malignant tumor classification. The primary tumor and metastasis were confirmed by pathology. The classification of tumor size is: the maximum diameter of T1 tumor ≤ 20 mm; the maximum diameter of T2 tumor is > 20 mm, but ≤ 50 mm; The maximum diameter of T3 tumor is > 50 mm; T4 is directly invading the chest wall or skin regardless of tumor size. The diagnostic criteria for breast cancer liver metastasis were as follows: (1) BCLM was confirmed by histopathological examination;(2) When the patient is unable to undergo the pathological examination of liver metastases, we mainly diagnose BCLM based on clinical manifestations and imaging examinations. For patients without pathological examination, breast oncologists and imaging physicians jointly confirm the diagnosis of BCLM based on ultrasound, CT, and MRI.
Consecutive patients from January 2008 to December 2009 were included in the training cohort, while consecutive patients from January 2010 to December 2010 were included in the internal validation cohort from the same institutional database using the same criteria as the derived cohort.
The database includes the patient’s treatment and pathological variables (age, menopausal status, tumor size, lymph node metastasis, histological grade, ER, PR, HER2 and lymphatic vessel invasion, etc.). The criteria for HER2 positivity is IHC 3+ (defined as > 30% of invasive tumor cells with uniform strong membrane staining) or FISH amplification (defined as the ratio of HER2 to CEP17 > 2.2 or the average copy number of the HER2 gene has a signal/core ratio greater than 6 when no internal reference probe is used in this detection system).
The retrospectively maintained database of early breast cancer patients, as well as this study, was approved by the Institutional Review Board of the Sun Yat-sen University Cancer Center.
Statistical Analysis
Statistical analysis was performed using SPSS® version 21.0 (IBM, Armonk, New York, USA) and statistical software package R version 3.5.1 (http://www.r-project). The clinical characteristics of the patients are mainly summarized as the variables of the classification. Comparison between groups was performed using a chi-square test to analyze categorical variables. Receiver Operating Characteristics (ROC) curve was built using SPSS® software. We firstly used univariate and multivariate analysis to determine factors that predict postoperative liver metastasis. Then, we identified the factors predicting postoperative liver metastasis by using a binary logistic regression model. Subsequently, we constructed a nomogram for predicting postoperative liver metastasis from the results of multivariate analysis using the rms package in R. Internal verification of the nomogram was performed with bootstraps with 1000 resampling. Later, we evaluated the predicted performance of the established nomogram by C-index measurement and the calibration curve is plotted to assess the calibration of the model, tested by Hosmer-Lemeshow test [20]. Decision curve analysis in the internal validation was set to determine the clinical value of the nomogram by quantifying the net benefit when considering different threshold probabilities [21, 22]. Besides, we constructed a clinical impact curve to assess the clinical impact of risk prediction models with decision curve analysis [23]. Finally, the breast cancer cohort of the SEER database was used for external validation.
Results
A total of 817 patients underwent breast-conserving surgery (including axillary lymph node dissection or sentinel lymph node biopsy); 1023 patients underwent modified radical mastectomy. The distribution of molecular subtypes in the training set is 68.8% in HR+/HER2-, 14.3% in HR+/HER2+, 7.0% in HR-/HER2+, and 10.0% in TN subtypes. The distribution of molecular subtypes in the verification concentration is: 63.5% in HR + /HER2-, 11.1% in HR + / HER2 +, 7.5% in HR− / HER2 +, and 12.0% in TN subtype. Our data analysis showed that in the training group of 1,149 patients with early breast cancer, 51 patients (4.44%) had clinical evidence of liver metastasis after a median follow-up of 71 months. There are 4 patients with extensive systemic metastases, 2 patients with lung metastases, 2 patients with bone metastases, and 1 patient with brain metastases. The demographic and clinical characteristics of the patients in both cohorts are summarized in Table 1. In the internal validation cohort, 28 patients (4.05%) developed liver metastasis after a median follow-up of 59 months. There was no significant difference in liver metastasis between the 2 cohorts (
Clinical and Pathological Features of Patients in the Training and Validation Cohort Based on Liver Metastatic Status.
Development of Nomogram
Logistic regression model identified 3 variables associated with liver metastasis: tumor size (odds ratio (OR) 3.62, 95% CI, 1.91 to 6.87;
Risk Factors for Liver Metastasis as Determined by Logistic Regression.
OR: Odds Ratio.
A nomogram containing these 3 factors was constructed (Figure 1). Good agreement between prediction and observation was displayed by the calibration curve of the training group (Figure S1A, supporting information). The Hosmer-Leme display test yielded a P value of 0.853, indicating that the model fit well. The C-index of the predicted nomogram is 0.699.

Nomogram to predict postoperative liver metastasis in patients with nonmetastatic breast cancer. There are 6 rows in the nomogram. Significant variables are displayed in lines 2 through 4, and the points of each variable are read from the scale of line 1. Add the points of the 3 variables to the total and mark them on the scale of line 5. The risk of liver metastasis is read from the scale of line 6 by drawing a vertical line from the total point marked in line 5 and the points are translated to the probability of liver metastasis.
Validation of Nomogram
The calibration curve shows good agreement between predicted and observed liver metastasis in the internal validation set (Figure S1, supporting information) due to the non-significant P value (0.972) produced by the Hosmer-Lemeshow test. The C-index of the predicted nomogram is 0.814. The ROC curve was constructed for the derived and validated groups (Figure 2). For the training and verification groups, the area under the curve (AUC) is 0.699 and 0.815, respectively, and the corresponding cutoff values are 0.052 and 0.031.

The Receiver operating characteristic (ROC) curves for training (A), internal validation (B) cohorts; Areas under the ROC curve are 0.699 (A) and 0.815 (B). Cut-off values (marked with a symbol) are 0.052 (A) and 0.031 (B).
Furthermore, we used the breast cancer cohort of the SEER database to further validate this nomogram. The results of the SEER database further confirmed the results of the training cohort, and also supported that HER2 status (odd ratio (OR) 1.88, 95%CI (1.74-2.04); P < 0.001), tumor size (OR 6.72, 95%CI (6.12-7.38); P < 0.001) and lymph node metastasis(OR 3.11, 95%CI (2.87-3.37); P < 0.001) were risk factors for breast cancer liver metastasis. The C-index of the SEER cohort nomogram is 0.791. The calibration curve showed good agreement between predicted and observed liver metastasis in the SEER cohort.
Clinical Use
The decision curve analysis of the nomogram is shown in Figure 3A. This analysis showed that when the threshold probability was in the range of 0-0.7, the use of a nomogram to predict liver metastasis increased more net benefit than the treat-all or treat-none strategy. Within this range, the net benefit based on the nomogram overlaped at several points.

Decision curve analysis (A) and clinical impact curve analysis (B) of the validation cohort. (A): The y-axis represents net benefit. The x-axis shows the threshold probability. “All” means that all patients have assumed liver metastasis, and “none” means that the patient has no liver metastasis. Using a nomogram to predict, if the score is in the range of 0 to 0.7, liver metastasis increases more net benefit than the treat-all or treat-none strategy. (B): The red curve (Number high risk) indicates the number of patients who are classified as positive (high risk) by the simple model at each threshold probability; the blue curve (Number high risk with events) is the number of true positives at each threshold probability.
The clinical impact curve analysis of the nomogram was shown in Figure 3B. The red curve (Number high risk) indicated the number of people who were classified as positive (high risk) by the simple model at each threshold probability; the blue curve (Number high risk with events) was the number of true positive at each threshold probability.
Discussion
We have developed and validated a nomogram that predicts the development of postoperative liver metastasis in early breast cancer patients. The nomogram included 3 items, tumor size, lymph node metastasis, and HER2 status, and showed good agreement between the predicted and actual probabilities in the derived and validated cohorts.
Liver metastasis is a growing problem in the treatment of breast cancer. 17 Liver metastasis severely affects patients’ life quality and prognosis. Therefore, predicting higher risk liver metastasis breast cancer patients will enrich the population who should be treated more specifically and thereby improve clinical outcomes in these patients. 18
Based on this nomogram, assuming a breast cancer patient with T3-4, lymph node metastasis and HER2-positive tumors, her total score was 205, as shown in Figure 1. Using a nomogram, the patient is expected to have a 20% possibility to develop liver metastasis. Therefore, patients with the above characteristics are expected to benefit from liver metastasis screening.
In contrast, an assuming patient with a T1-2 tumor, no lymph node metastasis, and the HER2 negative status had a total score of 0, as shown in Figure 1. Using a nomogram, the predicted chance for this patient to get liver metastasis is relatively low (less than 5%).
There is currently no specific preventive treatment to reduce the incidence of liver metastasis in breast cancer. But due to the local liver treatment (surgery, intrahepatic local chemotherapy, etc.), strengthen surveillance may bring benefits for high-risk metastatic breast cancer patients. We are not the only ones trying to establish a nomogram on breast cancer liver metastasis. Lin and his colleagues constructed a nomogram using variables such as sex, histology type, N stage, grade, age, ER, PR, HER2 status. 19 The problem with their nomogram is that the patients they enrolled are de novo liver metastasis, which means that the diagnosis of liver metastasis and the diagnosis of breast cancer are simultaneous and thus it doesn’t have enough predictive value. The patients included in this study were those who had liver recurrences after early breast cancer treatment. Thus, our nomogram has a more superior predictive value than theirs. Additionally, when T1 and T2 are divided into 2 groups, the ROC curve and the calibration curve of this new nomogram are almost the same as the previous results (Figure S2, supporting information).
It is worth noting that this study also has some limitations. First of all, this nomogram was constructed using retrospective data, so prospective studies should be performed for further validation. Secondly, we did not evaluate the impact of adjuvant CT, endocrine, and targeted therapy due to the unavailability of data. Thirdly, we also did not evaluate the effect of the eighth edition of TNM staging on liver metastasis due to the unavailability of data. Finally, the AUC in the ROC analysis of the training cohort is relatively low.
Conclusion
In summary, we developed a nomogram, which is a powerful tool for predicting subsequent liver metastasis in nonmetastatic breast cancer patients. Our model will help us in identifying patients at high risks of liver metastasis, thereby we could design preventive trials for them correspondingly. Further researches are needed to determine whether it can be applied to other subgroups of patients.
Supplemental Material
Supplemental Material, sj-jpg-1-ccx-10.1177_1073274821997418 - Predictive Nomogram of Subsequent Liver Metastasis After Mastectomy or Breast-Conserving Surgery in Patients With Nonmetastatic Breast Cancer
Supplemental Material, sj-jpg-1-ccx-10.1177_1073274821997418 for Predictive Nomogram of Subsequent Liver Metastasis After Mastectomy or Breast-Conserving Surgery in Patients With Nonmetastatic Breast Cancer by Anli Yang, Weikai Xiao, Shaoquan Zheng, Yanan Kong, Yutian Zou, Mingyue Li, Feng Ye and Xiaoming Xie in Cancer Control
Supplemental Material
Supplemental Material, sj-pdf-1-ccx-10.1177_1073274821997418 - Predictive Nomogram of Subsequent Liver Metastasis After Mastectomy or Breast-Conserving Surgery in Patients With Nonmetastatic Breast Cancer
Supplemental Material, sj-pdf-1-ccx-10.1177_1073274821997418 for Predictive Nomogram of Subsequent Liver Metastasis After Mastectomy or Breast-Conserving Surgery in Patients With Nonmetastatic Breast Cancer by Anli Yang, Weikai Xiao, Shaoquan Zheng, Yanan Kong, Yutian Zou, Mingyue Li, Feng Ye and Xiaoming Xie in Cancer Control
Supplemental Material
Supplemental Material, sj-tif-1-ccx-10.1177_1073274821997418 - Predictive Nomogram of Subsequent Liver Metastasis After Mastectomy or Breast-Conserving Surgery in Patients With Nonmetastatic Breast Cancer
Supplemental Material, sj-tif-1-ccx-10.1177_1073274821997418 for Predictive Nomogram of Subsequent Liver Metastasis After Mastectomy or Breast-Conserving Surgery in Patients With Nonmetastatic Breast Cancer by Anli Yang, Weikai Xiao, Shaoquan Zheng, Yanan Kong, Yutian Zou, Mingyue Li, Feng Ye and Xiaoming Xie in Cancer Control
Footnotes
Acknowledgments
We thank the staff in the Medical Records Management Section of the Sun Yat-sen University Cancer Center for supporting the research.
Author Contribution
Anli Yang, Weikai Xiao, and Shaoquan Zheng contributed equally to this study.
Availability of Data and Materials
Data supporting the results of this study can be obtained from the corresponding author under reasonable request.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Ethics Statement
This study was deemed exempt from institutional review board approval by Sun Yat-sen University Cancer Center and the informed consent was waived. This study was conducted in accordance with the ethical standards of the World Medical Association Declaration of Helsinki.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Supplemental Material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
