Abstract
Objective
We systematically reviewed the literature relating to the diagnostic accuracy of circulating tumor cells (CTCs) for the clinical determination of lung cancer.
Methods
This meta-analysis aimed to evaluate the diagnostic accuracy of CTCs for the clinical determination of lung cancer. The PubMed, Embase, Cochrane Library, and Web of Science databases were searched for relevant studies up to 31 May 2020. The numbers of patients with true positive, false positive, false negative, and true negative results were extracted from each individual study. Pooled sensitivity, specificity, and area under the curve values were calculated with 95% confidence intervals (CI).
Results
Twenty-one studies with 3997 subjects met the inclusion criteria. The overall diagnostic accuracy was assessed. The pooled sensitivity and specificity were 0.72 (95%CI: 0.65–0.79) and 0.96 (95%CI: 0.91–0.98), respectively, and the pooled positive and negative likelihood ratios were 16.86 (95%CI: 7.65–37.12) and 0.29 (95%CI: 0.23–0.37), respectively. The combined diagnostic odds ratio was 58.12 (95%CI: 24.82–136.09).
Conclusion
This meta-analysis indicated that CTCs had good diagnostic value for detecting lung cancer.
Introduction
Lung cancer remains one of the most common malignancies worldwide. An estimated 228,820 people in the United States were diagnosed with lung cancer in 2020, accounting for 135,700 deaths in the same year. 1 Despite growing experience in the diagnosis and treatment of lung cancer, the outcome may still be unsatisfactory because most patients are diagnosed with advanced-stage disease, primarily as a result of the lack of effective methods for its early diagnosis.2,3
Low-dose spiral computed tomography (LDCT) is currently considered a promising method for lung cancer screening.4,5 In 2011, the National Lung Screening Trial in the USA demonstrated that LDCT was four times more sensitive than X-ray imaging for detecting lung cancers.6,7 However, early-stage tumor lesions are usually small, leading to an increased false-positivity rate of LDCT. Histopathology is the ultimate gold standard for lung cancer diagnosis; however, it can be subjective and is limited by the experience of the pathologists. Tumor markers, such as carcinoembryonic antigen (CEA), fragments of cytokeratin‐19 (CYFRA21‐1), neuron‐specific enolase (NSE), and squamous cell carcinoma antigen (SCC) can also be used for the diagnosis of lung cancer 8 ; however, the non-specificity of the test results mean that using a single tumor marker for lung cancer diagnosis is generally unreliable.8,9
Cancer cells metastasize through the bloodstream, either as single migratory circulating tumor cells (CTCs), multicellular tumor aggregates such as circulating tumor microemboli, or as multicellular groupings (CTC clusters). Examination of CTCs can improve our understanding of the mechanism of metastasis, and allow monitoring of tumor prognosis.10,11 CTCs have also demonstrated value as a potential novel diagnostic and prognostic tumor marker for various cancers, including lung cancer.12,13 Current capture and separation methods for CTCs can be divided broadly into biophysical and biochemical methods, based on their physical properties, such as cell size, density, and shape, and on the expression of tumor cell surface proteins, such as epithelial cell adhesion molecule (EpCAM), respectively.14,15 However, the diagnostic parameters used have varied among previous studies. The current meta-analysis thus aimed to systematically evaluate the diagnostic value of CTCs in lung cancer.
Methods
The present meta-analysis was conducted according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses guidelines (PRISMA). The study was not registered with PROSPERO, but future studies will be registered accordingly.
Literature search
We conducted a systematic literature search of the PubMed, Web of Science, Cochrane Library, and Embase databases using the main search terms “circulating tumor cell”, “CTC”, “circulating cancer cells”, “lung neoplasms”, “lung cancer”, “lung carcinoma”, “NSCLC”, “SCLC”, “sensitivity and specificity”, and “accuracy”. All articles published up to 31 May 2020 were searched independently by two authors (QT Zhao and H Zhang). The reference lists of relevant studies were hand-searched to identify additional potential articles of interest. The requirement for ethical approval was waived because this was a meta-analysis of previously published studies.
Inclusion and exclusion criteria
The inclusion criteria were as follows: diagnosis test study design; patients diagnosed with lung cancer by pathology; index test CTCs in blood circulation; and 2 × 2 contingency table with sufficient data. Studies were excluded if they met one of the following criteria: case reports, editorials, reviews, letter, editorial articles, single-arm trials, and abstracts; duplicate studies; and overlapping or insufficient data for statistical analysis. All the studies were screened for inclusion by two independent investigators (Z Yuan and HE Wang). Discrepancies between the investigators were resolved by discussion and consensus. If a consensus could not be reached, disagreements were resolved by a third investigator (QT Zhao). Study selection is summarized in Figure 1.

Flow chart of search and selection of eligible studies.
Quality assessment
The qualities of the included studies were assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) diagnostic criteria. QUADAS-2 comprises four domains: patient selection, index test, reference standard, and flow and timing. The quality assessment was conducted independently by two investigators.
Data extraction
Information extracted from each article included first author, country of origin, publication year, sample size, mean age, sex, and cut-off value of CTCs in each study. Absolute numbers of true and false positives and true and false negatives were also extracted.
Statistical analysis
The meta-analysis was performed using Stata software (version 10.0; Stata Corporation, College Station, TX, USA) and Review Manager (RevMan, version 5.3. Copenhagen, Denmark; The Cochrane Collaboration, 2014). The pooled sensitivity, pooled specificity, positive-likelihood ratio (PLR), negative-likelihood ratio (NLR), diagnostic odds ratio (DOR), corresponding 95% confidence interval (CI), and the confidence and prediction contours in summary receiver operating characteristic (SROC) curves were generated using a bivariate mixed-effects binary regression modeling framework. Cochran’s Q and χ2 were used to determine heterogeneity caused by other factors, and a value of I2 > 50% was defined as heterogeneity. A P value <0.05 was considered statistically significant. Subgroup analysis was used to analyze the source of the heterogeneity. Heterogeneity analysis of sensitivity and specificity was presented separately. Sensitivity analysis was conducted to determine if the assumptions had a major impact on the results of the review. We also used Fagan’s nomogram to analyze the clinical value. Publication bias was assessed by Deeks’ funnel plot asymmetry.
Results
Search results
The flow chart of the literature search is shown in Figure 1. The included studies were published from 2000 to 2014. Twenty-one studies13,16–35 with 3997 subjects, including 2714 lung cancer patients, were recruited in this meta-analysis. The remaining 1283 individuals belonged to the control groups, comprising healthy volunteers in 15 studies13,16–19,21,23–25,27,28,30–33 and patients with benign lung disease in 11 studies.16,18,19,22,27,29,30,32–35 Zhou et al. 35 and Chen et al. 18 included two cohorts and reported the sensitivities and specificities separately, referred to as Zhou QJ1 and Zhou QJ2, and Chen X1 and Chen X2, respectively (Table 1). The characteristics of the included studies are displayed in Table 1. Among the 21 trials published from 2009 to 2020, 17 studies enrolled patients from East Asian countries/areas (one from Japan and the remaining 16 from People’s Republic of China), two studies were performed in the USA, one in Italy and one in France. Immunohistochemistry and immunofluorescence staining were used in 13 studies13,19,21,22,24–29,31,33,34 and polymerase chain reaction (PCR) identification methods were used in eight studies.16–18,23,30,32,35,36 The count data for primary studies, including true positive (TP), false positive (FP), false negative (FN), and true negative (TN) results were extracted and presented in Table 1.
Main characteristics of studies included in the meta-analysis.
BLD, benign lung disease; NR, not reported; NSCLC, non-small cell lung cancer; LC lung cancer; IHC, immunohistochemistry; FISH, fluorescence in situ hybridization; PCR, polymerase chain reaction.
Diagnostic accuracy analysis
The pooled diagnostic performance of CTCs for detecting lung cancer showed a sensitivity of 0.72 (95%CI: 0.65–0.79) (Figure 2a) and specificity of 0.96 (95%CI: 0.91–0.98) (Figure 2b). The SROC for CTCs had an area under the curve (AUC) of 0.91 (95%CI: 0.88–0.93) (Figure 3). The combined DOR was 58.12 (95%CI: 24.82–136.09), and the combined PLR and NLR were 16.86 (95%CI: 7.65–37.12) and 0.29 (95%CI: 0.23–0.37), respectively.

(a) Forest plots showing the sensitivity of CTCs in the diagnosis of lung cancer. (b) Forest plots showing the specificity of CTCs in the diagnosis of lung cancer.

Summary receiver operating characteristic curve of CTCs in the diagnosis of lung cancer.
Fagan’s nomogram analysis showed that the post-test probability was increased to 81%, with a pooled PLR of 17 and a fixed pre-test probability of 20%. Conversely, the post-test probability was decreased to 7% with a combined NLR of 0.29 (Figure 4).

Fagan’s nomogram plot analysis to evaluate the clinical utility of CTCs for the detection of lung cancer. CTC, circulating tumor cell; LR, likelihood ratio.
Heterogeneity and subgroup analyses
The forest plot of the pooled main diagnostic measures (Figure 2a and 2b) showed significant heterogeneity for the diagnosis of lung cancer (I2 for sensitivity 94.37%, P < 0.05; I2 for specificity 81.21%, P < 0.05). Spearman’s correlation coefficient was 0.22, demonstrating that the heterogeneity was not caused by the threshold effect.
We investigated the source of the heterogeneity by subgroup analysis stratified according to features including sample size (≥100 versus <100), race (Caucasian versus Asian), detection method (PCR versus fluorescence in situ hybridization (FISH)), and tumor stage (early, late, and I–IV) (Table 2).
Subgroup analyses.
CI, confidence interval; DOR, diagnostic odds ratio; FISH, fluorescence in situ hybridization; NLR, negative likelihood ratio; NSCLC, non-small cell lung cancer; PCR, polymerase chain reaction; PLR, positive likelihood ratio.
Sensitivity analysis
Sensitivity analysis identified two outliers (Figure 5). Exclusion of these studies decreased the I2 for heterogeneity in relation to sensitivity (from 94.37% to 92.26%) and specificity (from 81.21% to 81.32%). The overall results showed only minimal changes. Combined with goodness of fit and bivariate normality analyses, we confirmed the robustness of this meta-analysis.

Sensitivity analysis: graphical depiction of residual-based goodness of fit (a), bivariate normality (b), and influence and outlier detection analyses (c and d, respectively).
Quality assessment and publication bias
The qualities of the included studies were assessed using QUADAS-2 criteria (Figure 6). Publication bias was assessed by Deeks’ funnel plot asymmetry test. 36 The funnel plots showed no asymmetry (Figure 7) and the slope value was non-significant, indicating no publication bias.

Presentation of QUADAS-2 results.

Deeks’ funnel plot for detecting publication bias. ESS, effective sample size.
Discussion
CTCs are tumor cells with specific biomarkers circulating in the peripheral blood system. CTCs can be detected in blood samples from most patients with various solid tumors, but rarely in samples from healthy individuals.37,38 The use of CTCs as a diagnostic and prognostic tool in lung cancer patients is gradually increasing in routine clinical practice, in light of its noninvasive nature and easy repeatability. However, the detection of CTCs is technically challenging, with as few as one CTC per 106–107 peripheral blood mononuclear cells in patients with solid tumors.37,39 Various new CTC assay methodologies have been developed in recent years, including immunocytochemistry, reverse transcription (RT)-PCR, and the CellSearch System, each of which has certain advantages and disadvantages.11,15,37 RT-PCR enables the immunomagnetic enrichment of tumor cells from the peripheral blood of cancer patients and the subsequent RT-PCR expression analysis of the CEA, cytokeratin (CK)20, CK19, and guanylate cyclase-C genes, allowing the detection of tumor cells. 15 The CellSearch system can isolate CTCs using anti-EpCAM ferromagnetic microbeads, but lacks 100% sensitivity. 11
Previous meta-analyses have assessed the diagnostic value of CTCs for lung cancer. In 2019, Lyu et al. 37 studied the diagnostic values of CTCs and circulating tumor DNA (ctDNA) for detecting epidermal growth factor receptor (EGFR), K-Ras (KRAS), and anaplastic lymphoma kinase (ALK) gene mutations in lung cancer. The results showed that ctDNA and CTC2 had equivalent diagnostic abilities for detecting EGFR and its subtypes, and excellent performances for detecting KRAS and ALK mutations in lung cancer. A recent meta-analysis by Ye et al. 40 found that CTCs had a high diagnostic value for lung cancer; however, the analysis only included eight studies with relatively few cases, and the results of the trials in a pooled analysis were therefore not robust. Furthermore, the authors did not perform subgroup analyses because of the limited number of eligible studies. Another meta-analysis of four full studies and one abstract analyzed the diagnostic accuracy of ligand-targeted polymerase chain reaction (LT-PCR) for the detection of folate-positive CTCs in lung cancer. 41 The pooled sensitivity and specificity of LT-PCR for detecting folate-positive CTCs were 0.77 (95%CI: 0.75–0.79) and 0.87 (95%CI: 0.85–0.89), respectively, with a SROC AUC of 0.84. The results of the current meta-analysis, which included 2714 subjects with lung cancer from 21 diagnostic accuracy studies, demonstrated a high clinical utility of CTCs for the diagnosis of lung cancer, with a pooled sensitivity of 0.72 (95%CI: 0.65–0.79) specificity of 0.96 (95%CI: 0.91–0.98), and corresponding PLR of 16.86 (95%CI: 7.65–37.12) and NLR of 0.29 (95%CI: 0.23–0.37). These results indicated that the overall accuracy of CTCs for lung cancer detection was relatively good. The pooled DOR was 58.12 (95%CI: 24.82–136.09) and the AUC was 0.91 (95%CI: 0.88–0.93). The high DOR suggested a strong discrimination ability for lung cancer. The SROC AUC was 91%, suggesting a high diagnostic value. CTCs had a better diagnostic performance than traditional serum-based biomarkers with sensitivities for CEA, CYFRA 21-1, SCC, and NSE of 47.5%, 47.5%, 49%, and 39.7%, respectively, for diagnosing lung cancer. 8 CTCs were thus more sensitive and specific than conventional serum biomarkers. Subgroup analyses indicated high diagnostic accuracy in each subgroup, suggesting that CTCs might be a potential biomarker for discriminating between lung cancer patients and controls.
Heterogeneity was a potential problem when interpreting the results. We therefore further evaluated the source of the heterogeneity by conducting subgroup and sensitivity analyses in terms of parameters including detection methods, race, and tumor stage. High heterogeneity was observed for the overall accuracy of CTCs for the diagnosis of lung cancer. Because the included studies used different cut-off values, we used Spearman’s correlation coefficient to analyze the threshold effect, and showed that the heterogeneity did not exhibit a threshold effect, suggesting that the heterogeneity may result from other factors, including age distribution and the CTC detection system. For example, the measured CTC values showed good reproducibility among different detection systems, including CellSearch® (Silicon Biosystem, Menarini, Italy), Cyttel™ (Cyttel Biosciences, Jiangsu, China), CytoploRare® (GenoSaber Biotech, Shanghai, China), CellCollector® (GILUPI GmbH, Potsdam, Germany), TelomeScan® (Oncolys BioPharma Inc., Tokyo, Japan), ISET (INSERM U 370, Paris, France), and MCA (Tokyo University, Tokyo, Japan).
This study also had some limitations. First, some bias may have been introduced by only including studies published in English, and by the poor quality of several studies. Second, we mainly studied Asian and Caucasian populations, and other ethnic groups were absent from the included studies. Third, we failed to identify the main source of the high heterogeneity because of the limited data provided. Fourth, this meta-analysis was based on published studies, and failure to acquire unpublished data is generally associated with an overestimation of the true effect, resulting in publication bias. Fifth, the cut-off values differed among studies, which may also have led to imbalance. Finally, 18 of the 21 included studies were performed in China, and a more comprehensive analysis would require more studies from other countries.
Conclusions
This meta-analysis suggested that CTCs could act as promising biomarkers, with high sensitivity, specificity, and AUC for the diagnosis of lung cancer. Further high-quality prospective studies are needed to clarify the accuracy of CTCs as diagnostic indicators for lung cancer.
Footnotes
Declaration of conflicting interest
The authors declare that there is no conflict of interest.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was supported by the Hebei Provincial Key Medical Research Project (No. 20180160).
Data sharing statement
No additional data are available.
