Abstract
Objective
Glomerular filtration rate (GFR) is an important indicator of renal function. This meta-analysis aimed to evaluate the diagnostic value of serum cystatin C (CysC) and serum creatinine (SCr) for estimating GFR in patients with chronic kidney disease.
Methods
Google Scholar, PubMed®, Cochrane Library and China National Knowledge Infrastructure databases were searched, to identify randomized controlled trials that determined the diagnostic value of CysC and SCr, for estimating GFR in patients with chronic kidney disease.
Results
The inclusion criteria were met by 17 studies (total number of patients with chronic kidney disease, 2521). Meta-analysis showed that when the diagnostic cut-off value of GFR was 80–90 ml/min/1.73 m2, the heterogeneity was modest for CysC (
Conclusions
This meta-analysis demonstrated significant correlations between CysC, SCr and GFR. CysC was more sensitive, but less specific, than SCr for the estimation of GFR.
Introduction
Glomerular filtration rate (GFR) is an important indicator that is used to evaluate kidney function. The gold-standard method for the determination of GFR is inulin clearance. 1 However, inulin clearance is generally only used for scientific research because the method is cumbersome. In the clinic, the most commonly used method for GFR assessment is the determination of the serum creatinine (SCr) clearance rate, but this method is affected by a variety of factors, 2 including the production of kidney tubule-derived creatinine. 3 Research has demonstrated that serum cystatin C (CysC) is a relatively ideal endogenous marker of GFR.4–6 Research has shown that CysC is a more sensitive serum marker of GFR than SCr, 7 but there are differing views.8,9 Although several meta-analyses have evaluated the use of CysC to estimate GFR,10,11 research undertaken in China were not included and no analyses of heterogeneity among the studies were undertaken. The present meta-analysis investigated the diagnostic value of CysC and SCr in the estimation of GFR, in patients with chronic kidney disease.
Materials and methods
Search strategy
A systematic search of publications listed in electronic databases (Google Scholar, PubMed®, Cochrane Library and China National Knowledge Infrastructure) between February 1990 and October 2012 was conducted, using the following keywords: cystatin C, creatinine, GFR, diagnosis test, sensitivity and specificity. Language restrictions were not applied, but the search was limited to human studies. The list of articles was reviewed by two authors (M. Z. and X-Y. C.), who read the full text of all studies that had been identified; they decided on their suitability for inclusion in the review, based on whether they met the prespecified inclusion criteria. Any disagreement between the two authors was resolved using a consensus procedure and, if necessary, with the input of a third author (G-Y. C.).
Study selection
Studies were eligible for inclusion if they met the following criteria: (i) they investigated the use of CysC and SCr in the estimation of GFR in patients with chronic kidney disease; (ii) they provided computed data including sensitivity and specificity. Cross-over trials were not included in this meta-analysis. The search attempted to identify cluster-randomized trials; they were included and analysed in accordance with section 16.3 of the Cochrane Handbook for Systematic Reviews of Interventions. 12 All trials that did not use intention-to-treat analysis were recorded, and every attempt was made to analyse the current data by this principle.
Data extraction and management
Two reviewers (M. Z. and X-Y. C.) extracted the data independently to a self-developed data extraction form. Studies reported in non-English language journals were translated before assessment. Where more than one publication of one trial existed, only the publication with the most complete data was included. If publications did not contain the full information necessary for a meta-analysis, the missing information was obtained directly from the study authors. Any disagreement between the two reviewers was resolved using a consensus procedure, and if necessary, with the input of a third reviewer (G-Y. C.).
One author (M. Z.) entered the data into RevMan software version 5.1 (Cochrane Collaboration, Oxford, UK) and Meta-DiSc (version 1.4; Unit of Clinical Biostatistics, Ramón y Cajal Hospital, Madrid, Spain);13,14 and a second author (G-Y. C.) independently checked the data entry. For each study, the following data were extracted: summary receiver operating characteristic (SROC) curves, summary sensitivity (SEN), summary specificity (SPE), area under the receiver operating characteristic curves (SAUC), positive likelihood ratio (+LR) and negative likelihood ratio (−LR).
Statistical analyses
RevMan 5.1 and Meta-DiSc 1.4 software were used to pool data from all included studies. For dichotomous data, the results were summarized as odds ratios (OR) with 95% confidence intervals (CI). For continuous outcomes, weighted mean difference (WMD) (when measures were in the same unit) or standardized mean difference (SMD) (when different scales were used to evaluate the same outcome), with 95% CI, were used.
Two authors (D. W. and R-B. W.) independently used the Grading of Recommendations Assessment, Development, and Evaluation criteria to assess the risk of bias for all included studies.
15
Heterogeneity among studies was assessed using the
Results
The initial database search identified 256 studies. Of these, 239 were excluded after reading the titles and abstracts, leaving 17 double-blind, randomized controlled trials that met the inclusion criteria.16–32 All 17 studies evaluated diagnostic tests for the assessment of GFR using CysC and SCr and included a total of 2521 patients with chronic kidney disease (Table 1).16–32 According to the GFR staging for chronic kidney disease, patients with stage 1 were set as the control group and the diagnostic cut-off point of GFR was 80–90 ml/min/1.73 m2. The gold-standard methods of estimating GFR were as follows: exogenous inulin, iohexol or 125I-iothalamate, 99mTc-diethylene triamine pentacaetic acid (99mTc-DTPA) and 51Cr-ethylenediamine tetra-acetic acid (51Cr-EDTA) clearance rate. The serum CysC and SCr were also measured. The detection methods of serum CysC were particle-enhanced turbidimetric immunoassay (PETIA) and particle-enhanced nephelometric immunoassay (PENIA).33,34 The detection methods for SCr were the Jaffe method and an enzymatic method.
35
None of the 17 studies described the randomization methods that they used or how patient allocation was concealed.Data for CysC were available from all 17 studies.16–32 There was a total of 3567 study participants: 2521 patients with chronic kidney disease and 1046 control patients. Meta-analysis of the 17 studies demonstrated a significant difference between patients with chronic kidney disease and controls ( Major characteristics of 17 studies selected for a meta-analysis of the diagnostic value of serum cystatin C (CysC) and serum creatinine (SCr) in the evaluation of glomerular filtration rate, in chronic kidney disease.16–32 Baseline clinical characteristics such as age, sex ratio and body weight of the control and patient groups. RCT, randomized controlled trial; PENIA, particle-enhanced nephelometric immunoassay; PETIA, particle-enhanced turbidimetric immunoassay.
Data for SCr was available from 13 studies.16,18,20–29,32 There was a total of 2890 study participants: 1978 patients with chronic kidney disease and 912 control patients. The meta-analysis of the 13 studies demonstrated a significant difference between patients with chronic kidney disease and controls (
Analyses demonstrated that there was modest heterogeneity among the 17 studies used for the meta-analysis of CysC (

The SROC curves of the use of CysC and SCr to evaluate GFR in patients with chronic kidney disease are shown in Figures 5 and 6, respectively. The SROC curve for CysC in the evaluation of GFR in patients with chronic kidney disease gave the following results: SAUC = 0.9332; standard error (SE) < 0.01; Summary receiver operating characteristic curves for the 17 studies that evaluated the diagnostic value of serum cystatin C in the evaluation of glomerular filtration rate, in patients with chronic kidney disease.16–32 Area under the receiver operating characteristic curve = 0.9332, standard error (SE) <0.01, Summary receiver operating characteristic curves for the 13 studies that evaluated the diagnostic value of serum creatinine in the evaluation of glomerular filtration rate, in patients with chronic kidney.16,18,20–29,32 Area under the receiver operating characteristic curve = 0.8435, standard error (SE) <0.05, 

In the current meta-analysis, 13 studies used the PENIA method for measuring serum CysC,16–18,20–28,32 and the heterogeneity analysis results were as follows:
Eight studies investigated the use of CysC and SCr to measure GFR in patients with different GFR cut-off levels within the decreased range of 60–90 ml/min/1.73 m2.18–21,29–32 The results for CysC and SCr ,when there was a decrease in GFR in the range of 60–90 ml/min/1.73 m2 from the combined studies, were as follows: CysC
Discussion
Serum creatinine is the most commonly used indicator for the evaluation of renal function, so it plays an important clinical role in the assessment of GFR in patients with chronic kidney disease. CysC is secreted by nucleated cells, its concentration is not affected by age, sex, diet, inflammation and other factors, which make it an ideal endogenous marker of GFR changes and renal function.4–6 Many studies have reported the diagnostic value of CysC and SCr for estimating GFR.16–32 In this study, all of the 17 studies that were identified and included in the meta-analysis were comparative studies of the diagnostic value of CysC and SCr for estimating GFR.16–32 In the studies in included in this meta-analysis,16–32 GFR = 80–90 ml/min/1.73 m2 was set at the diagnostic cut-off point, so that patients with a GFR > 80–90 ml/min/1.73 m2 were classified as the control group (stage 1), while patients with a GFR < 80–90 ml/min/1.73 m2 were classified as the experimental group. The meta-analysis results showed that there was a good correlation between CysC, SCr and the gold-standard measures of GFR. The diagnosis of kidney disease using CysC demonstrated modest heterogeneity, but there was no significant heterogeneity in the diagnosis of kidney disease using SCr.
In terms of the source of heterogeneity, there were five gold-standard methods of estimating GFR: exogenous inulin, iohexol or 125I-iothalamate, 99mTc-DTPA and 51Cr-EDTA clearance rate. Inulin is the gold-standard method for the determination of GFR, which was reported in one study. 33 Determining GFR using radionuclide substances is associated with problems of accuracy and reproducibility, as a consequence of the use of different labelling substances and different methods of calculating GFR.
Serum CysC was detected using either PENIA or PETIA methods. Meta-analysis showed that the heterogeneity was related to the two detection methods and the differences were possibly attributable to methodological differences, such as the use of different antibodies, use of two substantially different assay methods, variability in the proneness to matrix effects, and use of different detection methodologies. The systematic difference in concentrations may be attributable to the lack of a commonly approved international standard. PETIA used reagents purchased from DAKO (Glostrup, Denmark), and PENIA used reagents purchased from Dade Behring (Hong Kong, China), so the differences between studies were possibly caused by different instruments, reagents and calibrators. The heterogeneity might also have been caused by differences in the methods used the select the critical CysC cut-off value that was used by individual studies. The SCr was detected using either the Jaffe method or an enzymatic method. Meta-analysis showed that the heterogeneity was related to the two detection methods; heterogeneity existed with the enzymatic method (
The inclusion of GFR staging significantly affected the heterogeneity of the studies, which suggests that GFR staging research should be undertaken in patients with chronic kidney disease, focusing on the diagnostic value when the GFR = 60–90 ml/min/1.73 m2. Eight studies conducted GFR staging.18–21,29–32 When there was a decrease in GFR in the range of 60–90 ml/min/1.73 m2, the heterogeneity of CysC (
The inappropriate selection of control groups might have affected the heterogeneity. In all of the included studies, patients with chronic kidney disease with a GFR > 80–90 ml/min/1.73 m2 were defined as the control group (stage 1). Thereby, the specificity and false-positive rate were inaccurate. In further studies, the control group should consist of subjects that do not have kidney disease and they should be compared with patients with chronic kidney disease, defined as a GFR < 80–90 ml/min/1.73 m2. Whether future studies investigate CysC or SCr, they should focus on the diagnostic value in subjects with a high filtration rate (GFR > 90 ml/min/1.73 m2) and in patients with early stage chronic kidney disease (GFR = 60–90 ml/min/1.73 m2), because there was no significant difference between the diagnostic value of CysC and SCr in patients with moderate-to-severe stage kidney disease (GFR < 60 ml/min/1.73 m2). The CysC level was increased when the GFR was higher (GFR > 90 ml/min/1.73 m2), 38 which might be related to the inappropriate control group settings, and the specific reason needs further investigation.
In conclusion, the diagnostic sensitivity of CysC in patients with chronic kidney disease was higher than that of SCr, but the diagnostic specificity of CysC was lower than that of SCr. There was modest heterogeneity for CysC, however no significant heterogeneity for SCr. This research area still requires further high-quality studies to be undertaken. Based on these current findings and in our opinion, future studies should focus on GFR staging by standardizing the definition of control groups and the cut-off values for CysC and SCr, in order to provide the diagnostic basis for the clinical application of CysC and SCr for estimating GFR.
Footnotes
Declaration conflicting interest
The authors declare that there are no conflicts of interest.
Funding
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
