Abstract
Objective
To examine whether including additional metabolic components to the current five-marker system can improve the discriminative validity for diagnosing metabolic syndrome (MetS).
Methods
This longitudinal cohort study included data from subjects that had completed at least three health examinations during a 5-year period. The study outcome was the onset of MetS. Sociodemographic and biochemical variables were recorded for all subjects so that the adjusted relative risks (ARRs) could be calculated for 11 metabolic components. Risk scores for the development of MetS based on the ARR values were determined. The sums of the risk scores of different component combinations were used to conduct a receiver operating characteristic (ROC) curve analysis of MetS diagnosis.
Results
A total of 3368 individuals with complete data was analysed. The ARRs of the 11 metabolic components were all statistically significant. According to ROC analysis, although good discriminative validity (area under the curve [AUC] range, 0.954–0.976) could be achieved for MetS diagnosis by using either all 11 or combinations of six metabolic components (the five current components plus one extra component), the current five metabolic components used for diagnosis had the best discriminative validity (AUC = 0.977).
Conclusion
The current five metabolic components used for the diagnosis of MetS still represent the best combination with the highest discriminative validity.
Keywords
Introduction
Diagnosis of the metabolic syndrome (MetS) by the current medical community usually adopts the standard of using the five markers suggested by the National Cholesterol Education Program Adult Treatment Panel III (NCEP-ATP III): waist circumference (waist), fasting glucose (FG), blood pressure, triglyceride (TG) and high-density lipoprotein cholesterol (HDL-C). 1 However, due to the rather complex mechanisms involved in the development of MetS, 2 increasing numbers of studies have suggested that other physical or biochemical factors that are closely associated with MetS should also be incorporated into the MetS diagnostic criteria. For example, MetS is closely associated with other chronic diseases such as cardiovascular disease (CVD) and type 2 diabetes mellitus, which in turn are linked to cholesterol and low-density lipoprotein cholesterol (LDL-C) levels, two important metabolic components. 3 In addition, for many patients, MetS takes the form of hepatic steatosis, a condition not only linked to TG levels but also to LDL-C levels. 4 These data demonstrate that cholesterol and LDL-C are also important for MetS diagnosis. 5
Hepatic steatosis can also lead to abnormal liver function, so including two common liver function markers, namely glutamic-oxaloacetic transaminase (GOT) and glutamic-pyruvic transaminase (GPT), as diagnostic markers for MetS would appear to be a rational idea. In particular, raised GPT levels are regarded as a result of insulin resistance 6 and considered to be a better diagnostic marker for MetS than fasting blood glucose. 7
Some researchers suggest that uric acid (UA) and/or hyperuricaemia should be considered as MetS markers8,9 because epidemiology studies showed that hyperuricaemia acts as either a correlate10–12 or an independent risk factor for MetS.13,14 However, other studies have argued that hyperuricaemia is only a manifestation of CVD15,16 and that the use of medications to lower UA levels does not prevent the development of CVD. 17 Therefore, the role of UA in MetS diagnosis remains to be clarified.
Recent studies have shown that in East Asian countries, body mass index (BMI) and waist circumference both have good discriminative ability for MetS,18–20 yet there are insufficient solid data to refer to in order to tell which marker is better for predicting MetS. Therefore, the present study used large-scale community follow-up survey samples to perform a comprehensive analysis of the MetS predictability of a variety of biomarkers, especially focusing on blood lipid markers, liver function markers and uric acid. This present study also compared the discriminative ability of waist circumference and BMI in predicting MetS, in the hope of offering references for future revisions to the MetS diagnostic criteria.
A risk score (RS)-based analysis was successfully applied to identify the factors used to predict type 2 diabetes mellitus, 21 but has never been used in MetS studies. Because the factors associated with MetS are more multivariate and complex than those for other CVD, using an RS-based analysis to identify potential predictors and combining the analysis with receiver operating characteristic (ROC) curve analysis can effectively enable identification of markers with higher discriminative validity and help identify the best combination for diagnosis.
Subjects and methods
Participants
Using multi-stage probability proportional to size sampling strategy, this longitudinal cohort study randomly invited residents who were ≥30 years of age with a registered household in Pingzhen District, Taoyuan City, Taiwan to undertake free health examinations in the Department of Community Medicine, Landseed Hospital, Tao-Yuan, Taiwan annually for 5 consecutive years between 2007 and 2011. These subjects were known as the ‘Landseed Cohort’. For sample consistency and data integrity, only those who completed at least three health examinations in the 5-year period were included in the study. In addition, to understand the causality between metabolic components and MetS, subjects that were diagnosed with MetS at the first health examination were excluded from the study.
This study was approved by the Institutional Review Board of Landseed Hospital (no. LHIRB 15-003-B1). All subjects provided their written informed consent.
Measures
Metabolic syndrome
This study set the onset of MetS as the outcome. MetS was diagnosed according to the NCEP-ATP III criteria. 1 However, in light of the differences between ethnicity, Taiwan’s National Health Agency engaged World Health Organization Expert Consultation in 2004 22 and proposed a revision of the waist standard, under which male and female waist circumferences needed to be ≥90 cm and ≥80 cm, respectively. The revised criteria were in line with those of International Diabetes Federation (IDF) recommended for Chinese ethnicity. 23 Nevertheless, unlike the IDF criteria making waist the central and essential component, a subject was defined as having MetS with the presence of three or more of the following five components in this study: (i) raised TG (≥110 mg/dl); (ii) reduced HDL-C (<40 mg/dl in males and < 50 mg/dl in females); (iii) raised blood pressure (systolic blood pressure [SBP] ≥130 mmHg or diastolic blood pressure [DBP] ≥85 mmHg); (iv) raised FG (≥100 mg/dl); (v) central obesity (waist circumference ≥90 cm in males and ≥80 cm in females).
Potential predictors of MetS
Each ‘Landseed Cohort’ subject underwent general physical examinations during the health examinations and blood and urine samples were collected for biochemical tests. A total of 31 markers were examined in this study. General examinations included height (cm), weight (kg), body fat (%), BMI (kg/m2), waist circumference (cm), hip circumference (cm), SBP (mm/Hg), DBP (mm/Hg) and bone mineral density (BMD). Urine tests included total protein (g/dl) and pH value. Blood tests included white blood cell count (WBC, 106/mm3), red blood cell count (RBC, 106/mm3), platelet count (*1000/µl), haemoglobin (Hb, pg), haematocrit (HCT, %), mean corpuscular haemoglobin (MCH, pg), mean corpuscular-haemoglobin concentration (MCHC, %) and mean corpuscular volume (MCV, fl). Biochemical tests included FG (mg/dl), albumin (g/dl), globulin (g/dl), blood urea nitrogen (BUN, mg/dl), creatinine (mg/dl), UA (mg/dl), cholesterol (mg/dl), TG (mg/dl), HD-C (mg/dl), LDL-C (mg/dl), GOT (IU/l) and GPT (IU/l). Among them, BMI, SBP, DBP, TG, HDL-C and FG were selected according to MetS definition.1,23 The others were included based on previous studies such as BMD, 24 WBC, 25 Hb, 26 HCT, 27 UA,8,9 LDL-C 4 and GPT.6,7 As each subject had at least three health examinations, this study used the marker data from the first examination for this analysis.
Statistical analyses
All statistical analyses were performed using the SAS® statistical package, version 9.4 (SAS Institute, Cary, NC, USA) for Windows®. Sociodemographic characteristics between subject groups with and without MetS were compared using χ2-test. To evaluate the effects of different markers on MetS, Student’s
To identify the best-fit model for predicting MetS using metabolic components, the present study proposed several potential combinations of metabolic components and retrieved the sum RS after summing the RSs of metabolic components in different combinations. The sum RS was then used to predict the future development of MetS. Model validation was performed using ROC curves and the applied area under the curve (AUC) was used as the indicator for model fitness, where a higher AUC indicated a better model.
Results
This longitudinal cohort study randomly selected 15 000 subjects aged ≥30 years from the 198 375 residents who registered their household in Pingzhen District, Taoyuan City, Taiwan and invited them for free health examinations annually for 5 consecutive years between 2007 and 2011. The ‘Landseed Cohort’ totalled 5757 individuals from the 15 000 invited subjects. For sample consistency and data integrity, only those who completed at least three health examinations in the 5-year period (
The 5-year cumulative incidence rate of MetS was 12.14% (409/3368) in the present study. Subjects with MetS were slightly older (χ2 = 22.94;
Distribution of sociodemographic variables of the study sample (
aLow educational level: having ≤ 9 years of education (up to around 15–16 years of age); high educational level: having > 9 years of education.
bOther includes not married, separated, divorced or widowed; 209 subjects did not provide information on marital status.
cNew Taiwan Dollar; 1 NTD = 0.032 USD; 77 subjects did not provide information on personal income.
χ2-test used to compare the two groups based on the presence of metabolic syndrome; NS, no significant between-group difference (
The differences in all physical and biochemical variables between the MetS group and the non-MetS group are shown in Table 2. Of the 31 biomarkers included in the comparison, a total of 10 items had a medium effect size (i.e. Cohen’s d ≥0.5). Among them, as weight and BMI were highly related markers, only BMI, which had a higher effect size, was included in the following analysis, even though both markers had reached or surpassed a medium effect size. Similarly, although hip circumference had a medium effect size, it was strongly related to waist circumference, so only waist circumference was included in the subsequent analysis. To better evaluate the effects of blood lipid and hepatic inflammatory markers, the analysis included cholesterol, LDL-C, GOT and GPT in further analyses, even though the four markers failed to attain a medium effect size. A total of 11 potential metabolic components were selected for further analysis.
Distribution of physical and biochemical markers between subjects with and without metabolic syndrome.
Student’s
ES, effect size: d = 0.2 refers to a small effect size; d = 0.5 refers to a medium effect size; and d = 0.8 refers to a large effect size.
According to the multiple Poisson regression model, all selected 11 metabolic components had significant effects on MetS (Table 3). The risk of developing MetS for subjects with central obesity was 20-times (ARR 19.60; 95% confidence interval [CI] 15.24, 25.22) greater than that for normal controls. Cholesterol had the smallest effect size, for which subjects with a higher cholesterol level were 1.35-times (ARR 1.35; 95% CI 1.13, 1.62) more likely to develop MetS than the normal controls. To balance the weights of each metabolic component, the RSs were calculated based on the ARR values and recorded as 2, 3, 4 or 5 when the ARR fell between 1 and 2, 2 and 4, 4 and 15, or was > 15, respectively. Based on this rule, subjects with higher waist circumference values had their RS recorded as 5; those with higher BMI, TG and BP scored 4; those with abnormal HDL-C, FG, UA, GPT and GOT values had their RS recorded as 3; those with abnormal LDL-C and cholesterol scored 2; and those with normal values had their RS recorded as 1.
Adjusted relative risk (ARR) and risk score (RS) of selected metabolic components for metabolic syndrome according to the multiple Poisson regression model.
The ROC analysis using the selected 11 metabolic components to discriminate MetS showed that the discriminative validity of waist circumference was the highest, especially among women (AUC = 0.87; Table 4). TG, HDL-C, BMI, FG and BP also had good discriminative validity (AUC range, 0.74–0.85), whereas UA, GPT, GOT, cholesterol and LDL-C did not have good discriminative ability for MetS (AUC ≤ 0.71). This suggests that the five markers used as the current diagnostic criteria for MetS have the best discriminative ability of all metabolic components. BMI was not a match for waist circumference even though it showed good discriminative validity. In addition, according to the ROC analysis results in this current study, the optimal cut-off values of the current five markers were very close to the recommended values, and only the optimal cut-off value of HDL-C was lower than recommended.
Receiver operating characteristic curve analysis of selected metabolic components for metabolic syndrome.
aCurrent metabolic component used for diagnosing metabolic syndrome.
To identify the best metabolic component combinations, this study used the current five-marker system as the basis and added one metabolic component at a time to form six combinations of six metabolic components each. After summing the RS of each metabolic component, a ROC analysis for MetS was performed and the results were compared with the current five-marker system. These current results showed that although the six combinations of six components all had good discriminative validity (AUC range, 0.967–0.976), they were still not as effective as the current five-marker system (AUC = 0.977; Table 5). Even by including all 11 metabolic components into the analysis (AUC = 0.954), the results were not as effective as the current five-marker system or the six-marker combinations. Replacing waist circumference with BMI resulted in a drop in discriminative validity compared with the existing five-marker system (AUC = 0.950).
Receiver operating characteristic curve analysis of metabolic syndrome by using the sum of risk scores of combinations of selected metabolic components.
aIncluding waist circumference, triglyceride, high-density lipoprotein cholesterol, fasting glucose and blood pressure.
BMI, body mass index; GOT, glutamic-oxaloacetic transaminase; GPT, glutamic-pyruvic transaminase; LDL-C, low-density lipoprotein cholesterol; UA, uric acid.
Discussion
Unlike some cross-sectional studies based on undiagnosed MetS data that could only provide temporal relationships,28,29 this current study adopted a longitudinal approach to examine the discriminative ability of 11 physical and biochemical metabolic markers selected from a variety of potential components for the development of MetS, based on their associated RSs using a ROC curve analysis in a 5-year follow-up community cohort study. Although several studies in the Han Chinese population have used a similar design as the present study,25,26,30 they mainly focused on middle-to-upper class people living in urban areas whose findings may not be representative of the general population. These previous studies also examined the relationship between MetS and single or few biomarkers, without taking current diagnostic components into account.25,26,30 Not adjusting for the five diagnostic components results in a failure to further understand the contribution of individual markers in discriminating MetS in addition to the diagnostic criteria. Moreover, the relationships between study markers and MetS were more likely to be confounded by the diagnostic components.
Using the five markers used for current MetS diagnosis as the basis, the present study added one of six other metabolic markers (BMI, UA, GPT, GOT, cholesterol and LDL-C) to the diagnosis and found no increase in discriminative ability compared with the original five-marker system. Moreover, by replacing waist circumference with BMI, the current results showed that the predictability of waist circumference was greater. These current results suggest that despite the association between many physical and biochemical markers and MetS, the current five-marker diagnostic system still represents the best combination for predicting the disease, and that adding other elements to the current diagnosis was unnecessary. This was particularly true for markers like UA, liver function markers (GPT and GOT) and other blood lipid markers (cholesterol and LDL-C).
It is worth noting that the optimal cut-off values obtained in this current study via the ROC curve analysis of the five markers used for current MetS diagnosis were consistent with the ATP III or IDF criteria.1,23 The consistent optimal cut-off values and high AUC demonstrated the suitability and good discriminative ability of waist circumference, TG, BP, HDL-C and FG for MetS diagnosis. Only the optimal cut-off value of HDL-C (female ≥29 mg/dl; male ≥24 mg/dl) was lower than the current clinical standard (female ≥50 mg/dl; male ≥40 mg/dl). What accounts for the lower optimal cut-off value for HDL-C in this current study compared with the current clinical standard might be the older age of the Landseed Cohort (mean of 63.03 years for males; mean of 59.21 years for females). Mean HDL-C levels decrease with increasing age31,32 and the role played by HDL-C in cardiovascular protection is, to a great extent, regulated by TG and LDL-C.32–35 As a result, in this current study, HDL-C levels needed to reduce to a relatively low level to show a negative effect on MetS in this older aged sample. However, this hypothesis requires further validation through future studies as no similar finding has been reported in previously published research.
In addition, the present study replaced waist circumference with BMI as the MetS diagnostic criteria and found that whether compared against each other or evaluated by combining the other four markers, the ROC curve analysis results all showed that waist circumference had a higher discriminative ability for MetS than BMI. This result was consistent with some of the previous studies conducted using ROC curve analysis, which have demonstrated that the predictability of waist circumference is superior to BMI concerning CVD-related outcomes. For example, the Third National Health and Nutrition Examination Survey in the United States indicated that waist circumference surpassed BMI in predicting risk aspects of CVDs.36,37 A previous study demonstrated that compared with BMI, central obesity (waist circumference) was a better discriminative marker for predicting hypertension, type 2 diabetes, and dyslipidaemia. 38
A limitation of this study was the relatively old age of the sample, thus the study cohort differed from the demographic structure of the general population. As a result, the effects of different markers on MetS might be impacted. As this study used follow-up survey data from a single community, the generalizability of its results would require further validation by future studies.
In conclusion, considering the above limitation, this study confirmed that the current five-marker system has the best discriminative validity for MetS diagnosis, and although other physical and biochemical markers were likely capable of predicting MetS, their discriminative ability as diagnostic criteria is limited.
Footnotes
Acknowledgements
The authors are indebted to all the participants for their dedicated collaboration.
Declaration of conflicting interest
The authors declare that there are no conflicts of interest.
Funding
This work was supported by the collaborative projects between Chung Shan Medical University and Landseed Hospital (CSMU-LSH-103-01).
