Abstract
Background
The European Society of Cardiology has published updated guidelines regarding pathways for diagnosis and management of obstructive coronary artery disease (CAD). Non-invasive functional assessment, for example, by stress perfusion cardiac magnetic resonance (stress pCMR) is recommended in patients with intermediate pretest probability of disease. Previous pCMR studies were mainly performed in high volume university hospitals with experienced radiologists or cardiologists interpreting the images.
Purpose
The aim of the present study was to evaluate the feasibility of establishing a stress pCMR imaging service in a district hospital.
Material and Methods
One hundred and thirteen patients with intermediate pretest probability of CAD referred for single-photon emission computed tomography (SPECT) at the regional hospital also underwent adenosine stress pCMR locally. The diagnostic analysis was compared to that of an experienced cardiac magnetic resonance (CMR) center serving as a reference.
Results
Inter-rater agreement between local readers and the reference reader was substantial to perfect for late gadolinium enhancement (LGE) (weighted kappa = 0.76 and 0.82), but only fair to moderate for pCMR (k = 0.34 and 0.51). No improvement in agreement between reference reader and local reader during the study was demonstrated.
Conclusion
CMR is feasible in patients with intermediate pretest probability of obstructive CAD in the setting of a district hospital. However, as opposed to infarct detection with LGE, the interpretation of stress pCMR was more challenging. To establish this method, we suggest obtaining experience in close collaboration with a reference CMR center.
Keywords
Introduction
The European Society of Cardiology (ESC) recently updated their guidelines for the diagnosis and management of obstructive coronary artery disease (CAD). 1 For patients with a high pretest probability (PTP) of CAD, direct referral to invasive coronary angiography (ICA), possibly with revascularization in the same session, is recommended. For patients in the lower range of PTP, a non-invasive diagnostic approach is advised. When a low clinical likelihood of CAD is suspected and patient characteristics suggest high image quality, anatomical assessment by computed tomography angiography of the coronary arteries (cCTA) is the preferred diagnostic pathway. In cases of intermediate or higher likelihood of disease and when revascularization is contemplated, a functional imaging test is recommended either by single-photon emission computed tomography (SPECT) or by stress perfusion cardiac magnetic resonance (stress pCMR).
Studies have documented that pCMR correlates better with findings of ICA than SPECT.2,3 Furthermore, in contrast to SPECT, stress pCMR has the advantage of no ionizing radiation, 4 no attenuation artifacts, and better spatial resolution. Previous studies comparing SPECT and stress pCMR were mainly performed in high volume university hospitals with experienced radiologists or cardiologists interpreting the images.
Currently, pCMR for diagnostic work-up in suspected CAD is not in routine use in Norway. This may be due to diagnostic traditions, lack of necessary equipment, MRI capacity, local expertise, or expected need for extra resources when compared to SPECT, which is the more widespread method.
Successful implementation of a cCTA service in a district hospital setting has been demonstrated. 5 In the present study, we evaluated the feasibility of establishing a service of stress pCMR. We compared our in-house interpretation of obtained images to that of an experienced CMR center.
Methods
Design and study population
This single center cohort study was conducted at a Norwegian district hospital serving 300.000 inhabitants. All participants provided written informed consent prior to entering the study. The study was approved by the Regional Committee for Medical and Health Research Ethics in Norway (REK 2010/3219).
Patients were recruited from the outpatient cardiology clinic in our hospital and from four practicing cardiologists in our catchment area in the period of April 2011 to August 2013. The criterion for inclusion into the study was a planned referral for SPECT. Indications for SPECT were either evaluation of suspected symptomatic stable CAD in patients with intermediate pretest probability of obstructive CAD or evaluation of a previously demonstrated borderline coronary artery stenosis. Pretest probability of obstructive CAD was evaluated at the discretion of the referring clinician.
Exclusion criteria were atrial fibrillation, previous coronary artery bypass surgery, severe renal failure (estimated glomerular filtration rate <30 mL/min/1.73 m2), communication problems, claustrophobia, inability to lie in a supine position for an hour, age below 30 or above 75, or contraindications to CMR or adenosine.
After inclusion, the patients underwent CMR. We assessed infarct by late gadolinium enhancement (LGE) and ischemia by adenosine stress pCMR. Subsequently, the patients were examined with SPECT. We did not record changes in symptoms or medication in the period between the two examinations.
Between March 2019 and April 2020, all CMR examinations were retrospectively reassessed by two local radiologists and one cardiologist at the CMR reference center (Division of Cardiovascular Imaging, Goethe University, Frankfurt am Main, Germany). After 10, 20, and 50 cases, respectively, we held telephone conferences between local and reference readers to facilitate learning. We did not retrospectively alter diagnostic evaluations after these sessions. The readers were blinded to patient history and to the other reader’s conclusions. The local radiologists had assessed 318 and 399 non-perfusion CMR respectively before start of this project, and had been consultants for 10 and 11 years. However, they had no prior experience in the performance and interpretation of pCMR. The reference reader had 10 years of CMR experience, reporting more than 400 cases annually.
Pretest probability of CAD according to the ESC 2019 guidelines 1 was calculated retrospectively based on registered symptoms at time of inclusion.
Cardiac magnetic resonance examination
The CMR examinations were performed with a 1.5 Tesla Siemens Avanto scanner (Siemens AG, Erlangen, Germany). For dynamic stress, all patients received an adenosine infusion of 140 μg/kg body weight/minute. After 3 minutes of infusion, a contrast injection with 0.05 mmol/kg dimeglumine gadopentetate (Dotarem – Guerbet, Paris, France) at a flow rate of 5 mL/s was started. Simultaneously, the stress pCMR image acquisition was initiated. The patient was asked to stop breathing when contrast arrived in right ventricle. The image acquisition lasted for 120 heartbeats with three short-axis slices sampled on each heartbeat. Adenosine infusion was stopped after approx. 50 heartbeats. We applied the following imaging parameters: Saturation recovery segmented gradient echo pulse sequence with TR/TE/TI of 167/1.11/120 ms, 108 × 144 matrix, 340–430 mm field of view, 1 NEX, 8 mm slice thickness.
After 10 minutes, rest of the pCMR imaging was performed without adenosine infusion, but with otherwise identical contrast parameters and pulse sequence parameters.
After another 10 minutes, LGE imaging was performed with 3 long-axis slices and short-axis slices that covered the entire left ventricle. Imaging parameters are phase sensitive gradient echo pulse sequence triggered on every second heart beat in diastolic phase with typical TR/TE/TI of 800/3.33/300 ms, 156 × 256 matrix, 330 mm field of view, 1 NEX, 8 mm slice thickness.
For CMR, a 16 segment score sheet, where the apical part had been excluded from a 17 segment sheet, 6 was filled in for all patients. Each segment was assessed for perfusion and late gadolinium enhancement (LGE) pathology. The diagnosis of perfusion defect was based on a visual analysis with comparison between regions to identify relative hypo-perfusion according to current guidelines from the Society of Cardiovascular Magnetic Resonance. 7 A comparison between stress and rest images was performed to identify inducible perfusion defects and artifacts. Perfusion defects in regions with LGE were only interpreted as reversible if the extent of the perfusion defect was clearly beyond the extent of LGE.
For evaluation of ischemia and infarct, a score was assigned to each segment indicating a normal (0), borderline (1), or pathologic (2) finding. The final overall score for LGE was deemed pathologic if at least one of the segments was classified as pathologic with a high degree of confidence. Similarly, the final score for pCMR was deemed pathologic if there was at least one segment with a high confidence of transmural pathology or two adjacent segments with high confidence of subendocardial pathology. 8
Single-photon emission computed tomography examination
Gated SPECT was performed with a dual head cardiac gamma camera (Ventri H3000YT, GE Healthcare, Chicago, Illinois, USA), with low energy high resolution collimators. Stress and rest studies were done in a one-day protocol using 99mTc-tetrofosmin (MYOVIEWR, GE Healthcare). For stress, bicycle exercise testing was performed in 96 patients. In 20 patients not able to perform bicycle exercise, adenosine stress was applied.
A 16 segment score sheet, where the apical part had been excluded from a 17 segment sheet, 6 was applied. A fixed perfusion defect was interpreted as an infarct and a reversible perfusion defect as ischemia.
Statistical analysis
Clinical characteristics were expressed as percentages or medians with inter quartile range as appropriate. Agreement between local and reference CMR center interpretations was calculated by using the weighted Cohen’s kappa (k). Confidence intervals for the kappa statistics were calculated from 2000 bootstrap replications. The level of agreement for a kappa value 0–0.20 was interpreted as slight, 0.21–0.40 fair, 0.41–0.60 moderate, 0.60–0.79 substantial, and 0.81–1.00 almost perfect. 9 To identify possible improvements in agreement between reference reader and local readers during the study period, the patient cohort was stratified into two groups depending on when the images were analyzed, and compared with z-test. All statistics was calculated with Stata/SE v. 16.1 (StataCorp LLC, TX, USA).
Results
Clinical characteristics, history of coronary artery disease, and symptoms of 113 patients examined with cardiac magnetic resonance, median (IQR), or number (proportion) as appropriate.
Cardiac magnetic resonance
Late Gadolinium Enhancement findings. Cross-tab comparison of reference reader versus two local readers. Findings classified as negative, borderline or pathologic (defined as at least one segment with high confidence of pathologic finding). Cohen’s weighted kappa with 95% confidence intervals.
Stress perfusion cardiac magnetic resonance findings. Cross-tab comparison of reference reader versus two local readers. Findings classified as negative, borderline or pathologic (defined as at least one segment with high confidence of transmural pathology or at least two adjacent segments with high confidence of subsegmental pathology). Cohen’s weighted kappa with 95% confidence intervals.
Agreement between reference reader versus two local readers stratified by first 56 patients and last 57 patients. Late Gadolinium Enhancement and stress perfusion cardiac magnetic resonance findings. Cohen’s weighted kappa with 95% confidence intervals. There were no significant differences between the first 56 vs. the last 57 patients (z-test).
Abbreviations: LGE: Late Gadolinium Enhancement, pCMR: perfusion cardiac magnetic resonance.
Single-photon emission computed tomography
SPECT and angiography findings in 113 patients examined with Cardiac Magnetic resonance, median (IQR) or number (proportion). CT angiography or invasive coronary angiography within 1 year.
Angiography
ICA was performed within 12 months in a total of 16/113 CMR patients and 14/107 SPECT patients (Table 5). Only one patient performed cCTA. Among those who performed ICA, 6/14 had a pathologic finding on SPECT, and 12/16 a pathologic finding on CMR according to reference reader. Eight patients out of these sixteen had significant coronary stenosis and underwent revascularization (3/6 had a pathologic finding on SPECT and 6/8 had pathologic finding on CMR).
Discussion
In this study, we examined the feasibility of establishing a perfusion CMR imaging service in a district hospital. The locally obtained diagnostic results were compared to that of readings at an experienced CMR center serving as a reference. Although it was expected that the agreement would be better for conventional CMR (where the local readers had experience) than for stress perfusion pCMR, we considered it relevant to record the level of agreement between a reference center and a district hospital after a limited amount of training. We consider our results to be relevant to other district hospitals that consider starting a stress pCMR service as they might illustrate how guidelines may be implemented in practice.
The inter-rater agreement analysis showed substantial to perfect agreement for diagnosis of infarction with LGE (k = 0.76 and 0.82), but only fair to moderate agreement for diagnosis of ischemia with pCMR (k = 0.34 and 0.51). Furthermore, pCMR agreement was not improved during the study period. In contrast to the high accuracy and reliability of CMR in cardiac function and LGE imaging, pCMR is known to be adversely affected by multiple factors during data acquisition as well as post-processing. 10 Chih et al. 11 previously found a high interobserver reproducibility (coefficient of variation 9%, r = 0.93) of stress pCMR in patients with multi-vessel CAD and low risk for CAD. Muhling et al. found good interobserver agreement using semi-quantitative analysis provided the quality of images was good. 12 However, in the MR-IMPACT study 13 , the reader agreement was only fair, with a kappa of 0.30–0.39 which is in line with our results. The present study expands the current literature regarding the interobserver agreement of pCMR imaging in a district hospital. Although not directly underpinned by our results, we speculate that the results would further improve by continued training. However, more cases than we had available in our study are necessary to ensure adequate training in stress pCMR.
We found a higher number of borderline cases in pCMR compared to LGE, both for the reference reader and for the two local readers. This can be explained by the complexity in the pCMR interpretation. As opposed to LGE, the subtle contrast difference between normal and pathologic myocardium in pCMR is more demanding to perceive and increases the probability of disagreement between readers. Furthermore, extensive perfusion defects in which all diagnostic criteria are met were not common in our study population. Collectively, these factors may have contributed to the lower interobserver agreement for pCMR compared to LGE.
At the time of inclusion in our study, ESC guidelines recommended testing for ischemia in symptomatic patients with an intermediate pretest probability of obstructive CAD. In this study, the clinicians assessed pretest probability at their own discretion, applying risk estimation methods as they saw fit. Post-hoc analysis using the ESC 2019 guidelines table showed a median pretest probability of CAD in our patient group of 19%, confirming inclusion of a clinically relevant population. The prevalence of ischemia was 53/113 (47%) by CMR (according to the reference reader). In contrast, only 10/107 (9%) had ischemia as diagnosed by SPECT. Collectively, these data may indicate that there might be a substantial proportion of false negative SPECT examinations in our study and/or the CMR readings were too sensitive.
In a district hospital setting, the prevalence of obstructive coronary artery disease is expected to be lower than in university hospitals receiving more selected patient groups. Standard imaging to rule out CAD in our region is cCTA or SPECT depending on clinical probability. We suspected a significant referral bias in our material. Direct referral to ICA bypassing other non-invasive imaging tests may have influenced our results. However, the prevalence of ischemia according to the reference reader was comparable with expected pretest probability of CAD. Furthermore, it is unlikely that a selection bias has affected our results when it comes to the comparison between local readers and reference readers.
One of the main strengths of pCMR is the detection of microvascular angina due to coronary microvascular dysfunction (MvD) in the setting of non-obstructive coronary artery disease. Although MvD would account for the patients’ symptomatology in up to 50% of all angina cases and comes with an increased risk of major adverse cardiovascular events, 14 it has been a particularly vexing syndrome for clinicians to evaluate and manage, as there are no widely available non-invasive imaging tests that can identify such patients with reasonable accuracy.
Patients with MvD can safely be assessed using pCMR, both with quantification but also visually, in which case the entity presents as a global circumferential subendocardial defect at stress. As the accuracy of our local experience would only be optimally assessed against positron emission tomography (PET) perfusion quantification or more sophisticated invasive coronary measurements (e.g., index of microcirculatory resistance), it is not possible to establish the exact extent of MvD in our cohort. However, in 15/113 cases analyzed by the reference reader, a perfusion pattern suggestive of microvascular dysfunction was identified. This finding should be carefully taken into consideration in the interpretation of our results, as pCMR is superior to SPECT for the detection of MvD, 15 and this would obviously not be confirmed with angiography, which is expected to be unremarkable in these cases. As such, the potentially increased detection of MvD with pCMR could be one of the major confounding parameters leading to significant discrepancy between the patient’s symptoms, pCMR, SPECT, and angiographic findings.
There are limitations in this study. This was a single center study involving only one reference reader and two local readers. However, the reference reader had completed training at a large-volume cardiovascular magnetic resonance core lab (Division of Cardiovascular Imaging, Goethe University, Frankfurt am Main, Germany). Nevertheless, involving multiple reference readers might have strengthened our results further by reducing the possibility of individual reader bias. Furthermore, all CMR examinations were performed in the period 2011–2013. Modern scanners have improved image quality. Improved image quality would probably have contributed to improved interobserver agreement, especially in pCMR.
In conclusion, we hold it feasible to establish and run a pCMR service at a district hospital. We conclude that the diagnosis of ischemia by stress pCMR was more challenging than LGE imaging. To secure sufficient quality in pCMR imaging and interpretation, we hold it essential that a close collaboration with a reference center is established to attain appropriate experience in image analysis.
Footnotes
Acknowledgments
We thank Siv Espedal, Andreas Bulling, Rune Andersen (cardiac radiographers), Astrid Kringstad and May Glemminge (research nurses), Leiv Sandvig (statistician) and Bjørn Bendz (interventional cardiologist) for their contribution and support of the investigators.
Author contributions
Jostein Gleditsch, Bjørn Arild Halvorsen, Nezar Rauf, Sohail Aslam, Christian Hall designed the study. All authors participated in analysis and interpretation of data. Jostein Gleditsch and Christian Hall drafted the manuscript. All authors participated in revising the manuscript critically for important intellectual content. All authors approved the final version of the manuscript submitted.
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Foundations
The study was undertaken at the department of radiology and department of internal medicine, Østfold Hospital, Kalnes, Norway, and Department of radiology and nuclear medicine, Oslo University Hospital, Rikshospitalet, Oslo, Norway. The study was funded by Østfold Hospital.
Relationship with industry
Jostein Gleditsch, Bjørn Arild Halvorsen, Konstantios Bratis, Astrid Alvim, Andres Jordal, Jan Gunnar Fjeld, Nezar Rauf and Christian Hall has nothing to declare. Eike Nagel has received a grant support and speaker honoraria from Bayer AG and support in kind from NeoSoft Ltd. and Medis Medical Imaging.
