Abstract
Background
Carotid artery ultrasound is a possible screening test for future coronary heart disease (CHD) events to select individuals for preventive treatment.
Objectives
To assess the screening performance of carotid artery intima-media thickness (IMT) and carotid plaque in the identification of individuals with CHD.
Methods
meta-analysis of case-control and cohort studies, reporting carotid IMT or plaque in individuals with and without CHD. Screening performance (detection rates [DRs] for specified false-positive rates [FPRs]) was assessed from the relative Gaussian distributions of IMT among individuals with and without CHD and from the proportion of affected and unaffected individuals with plaque.
Results
Eighteen studies, involving 2920 individuals with CHD (mean age range 46–73 years) and 41,941 without (aged 44–73 years) were included in the meta-analysis. For plaque the DR was 62% for an FPR of 30%; likelihood ratio (2.1 [95% CI 1.6–2.4]). For IMT, the DR was 65% for the same 30% FPR (IMT cut-off ≥0.82 mm); likelihood ratio 2.2 (1.9–2.5). The results were similar in case-control and cohort studies.
Conclusion
Neither carotid plaque nor IMT has a CHD screening performance that is sufficiently discriminatory between affected and unaffected individuals to be a worthwhile screening test.
Introduction
Observational studies have tended to present the risk of CHD as an odds ratio for a higher versus a lower IMT result, 3 which demonstrates whether or not there is an association between IMT and disease, but does not permit a quantitative assessment of carotid ultrasound as a screening test. There is therefore uncertainty over the value of carotid ultrasound in screening and whether the measurement of IMT or plaque or a combination of the two is the more discriminatory variable in screening.
This prompted us to carry out a meta-analysis of case-control and cohort studies that provided information on both carotid IMT and plaque in individuals with and without CHD, to estimate the screening performance of these measurements in predicting CHD.
Methods
Data sources were identified using a search of Medline and EMBASE databases and a manual search of the citation lists of the relevant publications and reviews. Keywords for the Medline search were carotid ultrasound or carotid intima-media or carotid plaque and CHD or coronary artery disease or ischaemic heart disease or myocardial infarction. All studies published in English up until March 2008 were considered eligible provided they reported either the carotid ultrasound IMT and the presence or absence of carotid plaque in affected individuals with either a confirmed CHD event (death or myocardial infarction) or symptoms of ischaemic chest pain (angina) supported by a confirmed coronary artery stensois of ≧ 50% on a coronary angiogram. Control subjects were unaffected individuals from the general population without a history of vascular disease or subjects undergoing coronary angiography with normal coronary arteries in whom either carotid ultrasound IMT and plaque measurements were reported. Studies (i) with fewer than 20 affected or unaffected individuals and (ii) with controls who were patients with ischaemic chest pain and mild coronary artery disease (generally <50% coronary stenosis on coronary angiography) were excluded. The initial search generated 463 potentially relevant studies which reduced to 74 on review of the abstracts and 18 on review of the full publication5–23 (in one cohort study the results on IMT were published separately from those on plaque).
Statistical Analysis
The published studies included in the meta-analysis generally reported the arithmetic mean IMT values and standard deviation. For each study, the IMT and standard deviation values were log 10 transformed because of the positive skew of the IMT distributions, using published formulae for the mean and standard deviation of the log-Gaussian distribution 24 (see Statistical Appendix). Probability plots of log-transformed data, from two studies that reported individuals data points, showed a reasonably good fit to a Gaussian distribution.9,13
A summary mean (and standard deviation) IMT was calculated for affected and unaffected individuals, weighted by 1/standard error 2 in affected and unaffected individuals, respectively, using a random effects model. Screening performance was estimated from the relative Gaussian distributions of IMT in affected and unaffected individuals for all studies combined. IMT is a quantitative variable, so detection rates (DRs) were estimated at specified false-positive rates (FPRs) and the corresponding IMT cut-offs were determined. Plaque is a qualitative variable (either present or absent), so a summary DR (the proportion of unaffected individuals with plaque) and a summary FPR (the proportion of unaffected individuals with plaque) were calculated for all studies, weighted by 1/standard error 2 using a random effects model. Heterogeneity was assessed by Cochranes Q-test for log mean IMT and plaque in cases and controls and meta-regression was used to account for possible sources of heterogeneity. STATA (Version 10) was used for all analyses.
Results
Table 1 summarizes the characteristics of the 18 studies used in the meta-analysis that provided information on carotid IMT or plaque or both in a total of 2920 CHD-affected individuals and 41,941 unaffected individuals, listed in order of increasing age of participants (65% were men). Table 2 shows the reported IMT results in each study and the proportion of participants with plaque in affected and unaffected individuals. Web Table 2 (www.wolfson.qmul.ac.uk/epm/publications/webtables) gives the corresponding log IMT values for each study and the summary weighted estimates for all studies combined.
Studies included in the meta-analysis according to age of participants
Studies also measured IMT in carotid bifurcation and internal carotid artery
Studies by Chambless and Hunt were separate reports from the same ARIC cohort
Intima-media thickness and plaque in studies of coronary heart disease (affected) and unaffected individuals
IMT, intima-media thickness; SD, standard deviation
Median in place of mean
Kablack-Ziembicka 10 and Morito 20 specified a plaque cut-off but did not report prevalence in affected and unaffected individuals
Standard deviation of cases and controls (figures not given separately)
Where SD missing the SD was calculated directly from the proportion of subjects in categories of IMT (see Methods)
Figure 1 shows forest plots of carotid IMT (and 95% CI) in affected (upper plot) and unaffected individuals (lower plot) for each study, ranked according to age of participant and for all studies combined. Median IMT values are shown (the antilog of the individual and pooled weighted mean log IMT values. The median IMT in affected (mean age, 62 years) was 0.92 mm (95% CI 0.83–1.01) and that in unaffected (mean age, 58 years) was 0.76 mm (0.68–0.84). Median IMT in affected individuals was similar in the 12 case-control studies (0.93 mm [0.83–1.05]) and in the six cohort studies (0.89 mm [0.73–1.08]). In unaffected individuals they were also similar, 0.74 mm (0.68–0.81) and 0.8 mm (0.66–0.97), respectively.
Forest plots of carotid IMT (and 95% CI) in affected (upper plot) and unaffected individuals (lower plot) for each study, ranked according to age of participant and for all studies combined
Figure 2 shows forest plots of the proportion of CHD-affected individuals with plaque (the DR) and unaffected individuals with plaque (FPR) in each study together with the weighted summary estimates for all studies combined. The overall summary screening performance yielded a DR of 62% (95% CI 50–75) for an FPR of 30% (18–39%). There were only two cohort studies that reported plaque, limiting the extent to which differences between case-control and cohort studies could be examined. The proportion in affected individuals in case-control studies was 63% (47–77%) and in cohort studies was 60% (54–66%) and in unaffected individuals, 24% (8–46%) and 38% (30–48%), respectively.
Forest plots of the proportion of CHD affected individuals with plaque (detection rate) and unaffected individuals with plaque (false-positive rate) in each study ranked according to age of participant, together with the weighted summary estimates for all studies combined. CHD, Coronary heart disease
There was heterogeneity in the proportion of affected and unaffected individuals with plaque (P < 0.001) and in the median IMT in affected and unaffected individuals between studies (P < 0.001), justifying the use of a random effects model in the analysis. Sensitivity analyses were conducted to examine the influence of individual studies on the pooled estimates. Each study was removed in turn and the analysis repeated on all but the removed study. The overall results were not materially affected by any one study. Meta-regression was used to examine age and other sources of variation between studies such as differences in the methods used to measure IMT (the mean of multiple IMT measurements was used in 11 studies and the maximum IMT in 7) and the definition of plaque (<2 mm in 8 studies and >2 mm in 2), differences in study design (case control in 12 studies and cohort in 6), CHD outcome used (death or myocardial infarction in 7 studies and angina supported by an angiographic stenosis of >50% in 11) and the proportion of men and women in each study. With the exception of age, there were no statistically significant effects observed in meta-regression analyses of IMT or plaque on any of these variables.
IMT increased with age by 1.4% per year (95% CI 0.7–2.1, P < 0.001). In unaffected individuals the increase was greater than in affected (1.7% versus 1.1%); however, this difference was not statistically significant (P = 0.372). The presence of plaque increased by about 1.5 percentage points per year (0.3–2.8, P = 0.018). Again, the increase was greater in unaffected individuals (2 versus 1 percentage point), but the difference was not statistically significant (P = 0.359). There was no effect of age on the variance for either measure.
Figure 3 shows relative frequency distributions of IMT in affected and unaffected individuals (mean age 59 years). The DRs are shown for a range of FPRs, together with the IMT cut-offs (mm) that specify these FPRs; DRs of 19%, 30% and 47% for FPRs of 5%, 10% and 20%, respectively.
Relative frequency distributions of IMT in affected and unaffected individuals (mean age 59), together with the detection rates and IMT cut-offs specified by a 5%, 10% and 20% false-positive rate. IMT, intima-media thickness
Table 3 gives the screening performance (DR, FPR and the corresponding likelihood ratios) using plaque and IMT for all studies combined. The IMT-based DR is estimated for the summary FPR observed with plaque (30%) to allow a direct comparison between IMT and plaque. The screening performance for the two ultrasound variables was similar.
Comparison of screening performance between intima-media thickness and plaque from meta-analysis of 1 8 studies
IMT, intima-media thickness; DR, detection rate
Discussion
The results of this meta-analysis show that carotid IMT and carotid plaque each have similar screening performance in identifying patients with CHD. At an FPR of 30% (the summary value using plaque) the DR for plaque was 62% and for IMT it was 65% (IMT cut-off ≥0.82 mm). Both ultrasound variables therefore yield a likelihood ratio of about 2; indicating about a two-fold increase in risk in those with a screen-positive result, compared with an untested population.
This is the first meta-analysis to provide a quantitative assessment on the value of carotid ultrasound as a screening test for CHD. Previous observational studies and meta-analysis of such studies have focused attention on the association between plaque or IMT and CHD. 4 These generally presented results as a relative risk of CHD for a very high IMT (say the top fifth of the distribution) compared with a very low IMT (the bottom fifth of the distribution). This comparison is useful for demonstrating whether an association is present but not for assessing its value as a screening test, because the groups being compared are mutually exclusive and most people in the middle of the distribution, where most cases tend to occur, are not considered in the analysis. 25 When IMT is examined using overlapping distributions, as in our analysis, the probability of a positive test result is estimated relative to the whole sample population rather than only those in the tails of the distribution. This permits an assessment of the DR for specified FPRs. It also allows comparison of IMT with plaque and with other risk factors which are used as screening tests for cardiovascular disease. For example, at age 55 and an FPR of 5%, the DR for IMT in our meta-analysis was about 19%, compared with previously published estimates of 15% using serum cholesterol, 25 13% for diastolic blood pressure, 26 13% for serum homocysteine 27 and about 10% for C-reactive protein. 28
There was a suggestion from the results of our meta-analysis that screening performance may decline with increasing age. While we lacked the power to confirm this pattern, we cannot exclude the possibility that screening may be better at younger ages. For plaque, for example, the estimated DR at age 45 was 41% for an FPR of 12% (likelihood ratio 3.3) and at age 65 the DR was 72% for an FPR of 43% (likelihood ratio 1.6). While a three-fold concentration in risk in a 45-year old person with a positive carotid ultrasound result may be seen as a worthwhile means of targeting preventive treatment, the background risk in this age group is relatively low (about 1 in 1000). The effect of screening would be to identify a group with a risk of 1 in 300 (3.3/1000) and this would be at the cost of missing over half of all cases of CHD (DR about 41%). Whatever the preventive remedy offered, screening is unlikely to be useful; if the preventive remedy were hazardous (e.g. coronary artery bypass surgery) the difference in risk between positive and negative results would be too small to justify screening and if it were safe (e.g. statins) there would be little reason to withhold treatment from so many people who will develop CHD simply because of negative screening test results. The conclusion contrasts with ultrasound screening for abdominal aortic aneurysms likely to rupture, which is very discriminatory. Here, a screen-positive result (>6 cm aortic diameter on ultrasound) is associated with a likelihood ratio of 143 for aortic rupture (DR 86% for a 0.6% FPR); a level of discrimination that has reasonably been judged sufficient to justify population screening. 29
Study characteristics other than age did not materially influence the results from this analysis. In particular, studies that classified CHD as ‘hard’ disease events (death and non-fatal MI) or ‘soft’ angiographic endpoints (angina and evidence of coronary artery disease on angiography), showed no statistically significant differences in ultrasound measurements. For example, IMT was, respectively, 0.94 mm (0.88–1.00) and 0.90 mm (0.76–1.06) in affected individuals and 0.74 mm (0.66–0.84) and 0.77 mm (0.67–0.89) in unaffected individuals. Similarly, there were no statistically significant differences in the results from studies of case-control or cohort study design or from studies that adopted multiple (mean) or single (maximal) measures of IMT and different size cut-offs to define plaque. Our results are therefore reasonably robust across different study designs and measurement methods. Substantial publication bias is unlikely because a standard statistical assessment of publication bias (the regression asymmetry test) 30 showed no basis for concern in either the studies reporting carotid IMT (P = 0.83 for affected and P = 0.64 for unaffected) or plaque (P = 0.39 and 0.82).
Neither carotid plaque nor IMT has a CHD screening performance that is sufficiently discriminatory between affected and unaffected individuals to be a worthwhile population screening test. Carotid ultrasound screening for CHD is improved by combining information on IMT and plaque (this increases the DR by about 10 percentage points at an FPR of 10%, as shown in an accompanying paper in this edition of the Journal). 13 If this were combined with other screening tests of comparable discrimination (possibly CT calcium score 31 or measures of arterial stiffness 32 ), then there may be a case for screening younger people (about age 45) to select individuals for preventive treatment. Further work is needed to assess this and the screening performance of other such tests, alone and in combination with carotid ultrasound, to determine if this would be worthwhile.
Footnotes
Statistical Appendix
If a continuous variable X has mean μ and standard deviation σ and X follows a log-Gaussian distribution and on the natural logarithm scale has mean m and standard deviation s, i.e. In (X) ~ N(m, s2), then
and
Treating equations (1) and (2) as simultaneous equations and solving for m and s gives
and
To convert a natural logarithm scale to a log10 scale, equations (3) and (4) are divided by ln(10).
The following example, using data from the paper by Vrtovec et al. 5 illustrates the method used for this transformation. The mean IMT was reported as μ = 0.80 mm and standard deviation σ = 0.19 mm in affected individuals. From equation (3), the mean on the log10 scale is given as
and from equation (4) the standard deviation on the log10 scale is given as
