Sage Journals: Discover world-class research

Abstract

French

Purpose:

MRI is commonly used in follow up of high grade glioma. Our purpose is to assess the interrater agreement on the increasingly used visual qualitative assessment of various conventional and advanced MR techniques in the setting of treated high grade glioma in comparison to the well established quantitative measurements.

Methods:

We prospectively enrolled HGG patients who underwent reresection of a new enhancing lesion on post-treatment 3T MR examination including DWI, DCE and DSC sequences. Two neuroradiologists objectively assessed the diffusion and perfusion maps by placing ROI on representative post-processed maps. They subjectively assessed the post-contrast, perfusion and diffusion sequences. Interrater agreement and concordance correlation coefficient were calculated.

Results:

Twenty-eight lesions were included. The interrater agreement on the qualitative assessment was good for k-trans (k = 0.73), moderate for Vp (k = 0.52), fair for AUC and Ve maps (k = 0.37 and 0.21), fair for corrected CBV (k = 0.39) and poor for the enhancement pattern and presence of diffusion restriction (k = 0.02 and 0.07). The concordance between the quantitative measurements was substantial for AUC and Vp (ρc = 0.98 and 0.97), moderate for k-trans and corrected CBV (ρc = 0.94) and poor for Ve and ADC (ρc = 0.86 and 0.24).

Conclusion:

While the quantitative measurements of DSC and DCE perfusion maps show satisfactory inter-rater agreement, the qualitative assessment has lower interobserver agreement and should not be relied upon solely in the interpretation. Similarly, the suboptimal inter-rater agreement on the interpretation of enhancement pattern and diffusion restriction potentially limits their usefulness in differentiating glioma recurrence from treatment related changes.

Keywords

perfusion diffusion enhancement glioma recurrence necrosis

Introduction

Progressive contrast enhancement is not uncommonly seen on follow up MRI for assessment of high grade glioma response to treatment. It may represent tumor recurrence or treatment related changes due to loss of blood brain barrier in both entities. However, true disease progression is found only in 60% of these cases on pathology.^1-3 Treatment related changes include pseudoprogression (PsP), radiation necrosis (RN) and pseudoresponse (PR). While PR after anti-angiogenic therapy manifests as decreased edema and enhancement, PsP and RN present with progressive contrast enhancement, indistinguishable from true disease progression. PsP develops early within 3-6 months after combined chemoradiation, usually subsides spontaneously and is associated with favorable response to treatment and increased survival. RN on the other hand, has a later onset than PsP (most of the cases presenting within the first 3 years after radiation) and causes severe tissue injury often requiring treatment.^4-7

The differentiation between tumor recurrence and treatment related changes remains challenging on conventional MR sequences. Different patterns of enhancement have been used to discern treatment related changes from disease progression, yet still with suboptimal diagnostic accuracy.^2,8,9 Advanced MR techniques including MR perfusion and diffusion have been increasingly used to differentiate between recurrent glioma and treatment related changes exploiting the pathophysiologic differences between the 2 processes.^2,10 The use of diffusion MR relies on the increased cellularity of the recurrent tumours and central coagulative necrosis in treatment related necrosis.^2,10-12 MR perfusion provides different parameters highlighting the presence of neoangiogenesis in recurrent tumors. Differences in cerebral blood volume (CBV) between tumors and treatment related changes can be shown on dynamic susceptibility contrast (DSC) MRI utilizing T2/T2* signal loss during the first pass of contrast bolus through the tissues. Dynamic contrast enhanced (DCE) MR perfusion -relying on T1 signal changes in the lesion after contrast administration- provides additional information on vessel permeability in the lesion.^13,14

Previous publications have evaluated the diagnostic accuracy of each technique using quantitative assessment of various perfusion parameters.^5,15,16 Given that many radiologists, in day to day clinical practice, are used to interpreting the diffusion and perfusion maps visually without objective measurements of the maps, we sought to evaluate the interobserver agreement on this qualitative type of assessment of the different MR techniques in comparison to the more established quantitative measurements in the setting of treated high grade glioma.

Materials and Methods

Patient Population

This prospective study was approved by our institutional research ethics board and a written informed consent was obtained from all the patients. We consecutively enrolled participants from December 2012 to July 2015. We included high grade glioma (HGG) patients who underwent re-resection of a new enhancing lesion identified on clinical post-treatment follow up MRI. The original standard treatment consisted of surgical resection, standard radiation treatment (60 grays (Gy) in 30 fractions of 2 Gy over 6 weeks) and temozolomide therapy. Each patient underwent a follow up research MRI followed by reresection.

MR Imaging Acquisition Protocols

Each patient was scanned on a 3 T MR scanner (Magnetom Trio; Siemens, Erlangen, Germany). Conventional MR protocol using axial T1 pre-contrast (TR = 280 ms, TE = 2.51 ms, flip angle=90º, voxel size= 1.1 x 0.9 x 3 mm), axial FLAIR (TR = 9710 ms, TE = 93 ms, TI = 2580 ms, voxel size=1.1 x 0.9 x 3 mm) and axial T2 (TR = 6910 ms, TE = 97 ms, voxel size=0.7 x 0.7 x 3 mm), post contrast axial T1 volumetric interpolated brain examination (VIBE) (TR = 8.48 ms, TE = 3.21 ms, flip angle=12º, voxel size=1x1x1 mm). We used IV injection of Gadovist 1.0 (Bayer Schering Pharma, Berlin, Germany) (0.1 mmol/kg). The parameters for diffusion tensor imaging: TR = 3100 ms, TE = 106 ms, 20 directions, b = 0/1000, voxel size= 1.3 × 1.3 × 2.5 mm.

DCE-MR imaging was obtained using a 3D FLASH sequence (TR = 6.5 ms, TE = 1.7/3.9 ms, flip angle = 30°, thickness = 5 mm, 18 sections, temporal resolution = 3.5 seconds, duration = 440 seconds). A fixed dose of 0.05 mmol (equivalent to 5 mL) of Gadovist 1.0 (Bayer Schering Pharma, Berlin, Germany) was injected at 2 mL/s. Two 3D volumetric interpolated sequences with different flip angles (TR = 20 ms, TE = 1.22 ms, flip angle = 4° and 25°, thickness = 5 mm, 18 sections) were acquired before and after the dynamic scan and were used to calculate the T1maps.

For DSC imaging, a second equal dose of gadolinium was injected 10 minutes after the first injection, at a rate of 4 mL/s. We used a T2* EPI gradient recalled-echo sequence (TR = 2380 ms, TE = 54 ms, flip angle = 90°, thickness = 5 mm, 18 sections, temporal resolution = 2.5 seconds, duration = 125 seconds). We performed 7 baseline measurements before contrast administration. The first contrast injection for DCE imaging served to decrease the leakage effects before the DSC imaging.

Postprocessing of DSC Images

DSC images were processed using singular value decomposition as implemented in a commercially available software (Olea Sphere 1.3, Olea Medical, La Ciotat). MR signal intensity was converted to T2 relaxation rate. An automated algorithm selected the most suitable pixels for the vascular input function (VIF). The signal intensity (SI) was converted to relative change in R2 using the standard expression: delR2(t) = -ln(S(t)/So)/TE where S is the SI at time t, So is the baseline SI and TE is the echo time. Corrected CBV maps were generated by applying correction for leakage in rCBV calculations using pre-injection of contrast agent and linear fitting to estimate the T1 contamination caused by extravasation of contrast agent.

Postprocessing of DCE Images

DCE images were processed directly in the software Olea Sphere to generate maps of area-under-the curve (AUC), plasma volume (Vp) and volume transfer coefficient (Ktrans). The SI was converted to percent change in signal intensity (relSI) using the expression: relSI(t) = 100*(S(t)-So)/So, where S is the SI at time t and So is the baseline SI. The relative change in 1/T1 was estimated from this relative change in signal intensity assuming a linear relationship. The VIF was selected from a small region of interest (ROI) placed in the superior sagittal sinus directly from the DCE images. Signal conversion was set as SI to relSI(%).

Image Interpretation

The post-processed parametric maps were coregistered to the corresponding axial T1-weighted postcontrast images. Two neuroradiologists (10 years of experience for CT and 12 years for SC), blinded to the clinical information, separately assessed the conventional and advanced MRI sequences, including perfusion and diffusion.

Both neuroradiologists classified the enhancement pattern of each lesion based on previous classification provided by Reddy et al.⁸ into: Solid enhancement with distinct margin, focal enhancing nodule, peripherally enhancing rim with indistinct margins, hazy mesh-like enhancement⁸ or punctate enhancement. Prior to assessing the study lesions, both readers were trained on the classification with reference images of each category available for their review at the time of cases reading.

Each reader separately performed quantitative and qualitative assessment of perfusion and diffusion sequences. For the qualitative assessment, each reader assessed all the perfusion maps and categorized the lesions into: low [similar to the white matter], intermediate [similar to the cortex] and high [similar to the choroid plexus] (Figure 1 –3). For the quantitative analysis, each reader performed hot spot analysis for each map by placing multiple ROIs (20-30 mm2) on the highest perceived values within the lesion avoiding nearby vessels and in the contralateral white matter avoiding areas of white matter abnormality. ADC maps were visually inspected for presence or absence of diffusion restriction compared with the contralateral normal appearing white matter. A ROI was placed on the regions with lowest ADC value.

Figure 1.

Qualitative assessment of corrected CBV maps: Axial dynamic susceptibility contrast perfusion derived corrected CBV maps showing intermediate (A) and high (B) blood volume in 2 different lesions (arrows).

Figure 2.

Qualitative assessment of k-trans maps: Axial dynamic contrast enhanced MR perfusion derived k-trans maps showing intermediate (A) and high (B) values in 2 different lesions. Note increased K-trans in the choroid plexuses of the lateral ventricles (A).

Figure 3.

Low corrected CBV: Axial dynamic susceptibility contrast MR derived corrected CBV map (A) and axial post-contrast T1WI with coregistered corrected CBV map (B) showing low CBV in a solid enhancing nodule. Contrast enhanced MR perfusion derived k-trans map (C) showing intermediate K-trans in the same lesion.

Statistical Analysis

Inter-rater agreement statistics (k, Kappa) was calculated for the enhancement pattern classification and visual assessment of diffusion and perfusion maps. The strength of agreement is poor for k < 0.20, fair for k 0.21 - 0.40, moderate for k 0.41 - 0.60, good for k 0.61 - 0.80 and very good for k 0.81 - 1.00.

Comparison of the quantitative perfusion and ADC measurements between the 2 readers was performed using concordance correlation coefficient ( ρ _c ). The strength of agreement is almost perfect for ρ _c > 0.99, substantial for ρ _c 0.95 - 0.99, moderate for ρ _c 0.90 - 0.95 and poor for ρ _c < 0.90.

Mann-Whitney and Kruskal-Wallis tests were used to assess for presence of significant differences between the quantitative measurements and the visual assessment of diffusion and perfusion maps respectively for each reader. A P value of 0.05 indicated statistical significance. All data were analyzed by using MedCalc (Version 12; MedCalc Software, Ostend, Belgium).

Results

Twenty-seven consecutive patients were enrolled in the study with a total of 28 lesions. One patient had 2 lesions; each was assessed separately. There were 18 males and 9 females with a median age of 51 years (SD 26.8 years). At the time of the original diagnosis, 18 patients had glioblastoma (WHO grade IV) and 9 patients had grade III gliomas. Nine patients had isocitrate dehydrogenase (IDH) mutant tumors and 11 patients had IDH wild-type tumors. The IDH status was not tested for 7 patients.

The lesions were identified on clinical post-treatment follow up MRIs and were reassessed on the study MRI followed by reresection. The median interval between the research study MR and the last radiation treatment received was 320 days (SD 1088.9 days). The median interval between the research study MR and the first clinical MRI showing the new enhancing lesions was 34 days (SD 61.6 days). Most of the lesions (82.2%) were resected within a month after the research MRI (median 22.5 days, SD 63.6, range 2-281 days).

Quantitative measurements: The concordance between the DCE-derived hotspot measurements for the 2 readers was substantial for AUC and Vp map ( ρ _c = 0.98; CI: 0.96-0.99) and ( ρ _c = 0.97; CI: 0.94-0.99), moderate for k-trans ( ρ _c = 0.94; CI: 0.88-0.97) and poor for Ve ( ρ _c = 0.86; CI: 0.72-0.93). For the DSC-derived corrected CBV maps there was moderate concordance (ρ _c = 0.94; CI: 0.87-0.97). The concordance was poor between the 2 readers’ ADC measurements (ρ _c = 0.24; CI: -0.11-0.53) (Table 1).

Table 1.

Concordance of ADC, DCE and DSC Parameters.

Parameter	ρc	CI
AUC	0.98	0.96-0.99
Vp	0.97	0.94-0.99
K trans	0.94	0.88-0.97
Ve	0.86	0.72-0.93
Corrected CBV	0.94	0.87-0.97
ADC	0.24	-0.11-0.53

Abbreviation: ρc, concordance correlation coefficient.

Qualitative assessment: For the DSC perfusion, the interobserver agreement on corrected CBV maps visual assessment was fair (k = 0.39; 95% CI: 0.1 – 0.68). The interrater agreement on the visual DCE maps qualitative assessment was good for the k-trans map (k = 0.73; 95% CI: 0.46 - 1.0); moderate for the Vp map (k = 0.52; 95% CI: -1.0 - 1.0) and only fair for the AUC and Ve maps (k = 0.37; 95% CI: -0.005 to 0.74) (k = 0.21; 95% CI: -0.17 - 0.59).

The inter-rater agreement on the presence of diffusion restriction was poor (k = 0.07; 95% CI: -0.16 - 0.31). There was also poor agreement on the enhancement pattern classification between the two readers (k = 0.02; 95% CI: -0.29 - 0.33) (Table 2).

Table 2.

Interobserver Agreement on DCE MR, DSC MR, DWI and Enhancement Pattern.

Parameter	k	CI
AUC	0.37	-0.005 to 0.74
Vp	0.52	-1.0 - 1.0
K trans	0.73	0.46 - 1.0
Ve	0.21	-0.17 - 0.59
Corrected CBV	0.39	0.1 – 0.68
Diffusion	0.07	-0.16 - 0.31
Enhancement	0.02	-0.29 - 0.33

Abbreviation: k, Kappa, Inter-rater agreement coefficient.

Comparing the visual and the quantitative assessment for each reader, there was no statistically significant difference in perfusion parameters values corresponding to the subjective visual categorization into low, intermediate or high perfusion. The only exception was statistically significant difference (P = 0.005) for the corrected CBV map for reader 2. There was significant difference in ADC values between the cases classified by reader 2 as showing diffusion restriction and those without [P = 0.03, median ADC was 899 (95% CI: 454.35-1299.41) and 1211 (95% CI: 1038.75-1626.5) respectively].

Discussion

Our study showed suboptimal agreement on the visual assessment of the corrected CBV maps, and, apart from the K-trans maps, there was also lower interobserver agreement on the qualitative interpretation of the DCE derived maps when compared to the quantitative measurements. Moreover, there was no significant quantitative differences between the perfusion categories based on our visual classification. Poor interrater agreement was also noted on the presence and quantification of diffusion restriction in a lesion as well as on the classification of its pattern of enhancement.

Our results regarding the interrater agreement on DSC derived corrected CBV maps interpretation are different from those by Kerkhof et al,¹⁷ who showed suboptimal interobserver agreement on quantitative rCBV assessment and good agreement on visual interpretation of rCBV maps. Of note, our classification of the perfusion maps included 3 categories while they only classified the rCBV into high and low.¹⁷ The satisfactory interobserver agreement on quantitative corrected CBV measurements in our study is in agreement with prior study by Hirai et al.¹⁸ It should be noted that in that study they assessed the relative cerebral blood flow (rCBF) rather than rCBV. However, previous studies had demonstrated strong correlation between the rCBV and rCBF ratios in gliomas.^19,20

The satisfactory agreement on quantitative measurements of DCE derived perfusion maps in our study is in agreement with the results reported by Heo, et al. although they have only assessed the AUC maps.²¹

Different enhancement patterns classifications have been used for lesion characterization in HGG post-treatment follow up setting. Reddy et al described enhancement patterns with a sensitivity, specificity and accuracy of 94%, 50% and 71% for predicting radiation necrosis and 85%, 33% and 61% for tumor recurrence respectively.⁸ In another study, a spreading wavefront pattern of enhancement was assessed and showed sensitivity, specificity and accuracy of 50%, 81.3% and 68% for predicting radiation necrosis, however was not statistically significant (P = 0.13).⁹ While these studies demonstrate the suboptimal accuracy of enhancement pattern in discriminating treatment related changes from disease progression, our study highlights that the classification of different enhancement patterns also suffers from suboptimal interobserver agreement, significantly adding to the suboptimal performance of this approach and limiting its usefulness in daily clinical practice.

DWI is widely used to differentiate HGG recurrence from treatment related changes with lower ADC values in tumor recurrence due to increased cellularity.^22,23 However, treatment related necrosis can also be associated with central diffusion restriction in the non-enhancing central component due to coagulative necrosis.^12,24 While excellent interrater agreement was noted on the qualitative interpretation of DWI for detection of acute stroke,^25,26 in our study, we found poor agreement on presence of diffusion restriction in an enhancing lesion. This could be, in part, related to the fact that diffusion restriction seen with tumor recurrence is usually not as hyperintense on diffusion trace images as the restriction seen with cerebral infarction or abscess. Another possible explanation could be the heterogeneity of the lesions seen in posttreatment HGG follow up which commonly consist of a mixture of tumor recurrence and treatment related changes.

We also found poor agreement between the readers on the ADC measurements which is in agreement with previous study by Heo et al who found lower interclass correlation of the ADC measurement compared to DCE perfusion assessment.²¹ Previous studies have also shown interobserver variability of ADC measurements in different anatomical locations.^27,28 Our findings regarding the poor agreement on quantitative and qualitative DWI interpretation, emphasize the conclusion of a published metanalysis, that despite moderate diagnostic performance of DWI in differentiating radiation changes and tumor recurrence, it should not be relied upon solely in making this decision.¹¹

The study has some limitations. In our quantitative measurements, we did not use histogram analysis or assessment of the whole lesion volume. Instead, we used ROI on representative images of the lesion which would be more practical to use in day to day clinical practice. We did not assess the diagnostic accuracy of the MR perfusion and DWI as this was not the scope of our study and has been separately published based on a larger prospective cohort.²⁹ Similarly, the readers were blinded to the timing of the study MRI in respect to the completion of chemoradiation, IDH tumor status as well as to the radiation planning maps, which are important pieces of information for the radiologist reporting this type of studies in real life and would impact the radiologist’s final diagnostic considerations. However, in this study, we were interested in the agreement between different neuroradiologists on the assessment of these imaging sequences commonly used in the post-treatment follow up of HGG. Finally, given that we included a small group of patients, future studies with larger cohorts are needed to confirm our findings.

In summary, there is greater interobserver variability on the qualitative assessment of DSC and DCE MR perfusion maps compared to the well established quantitative approach, potentially limiting the usefulness of these techniques in clinical practice if the radiologists rely solely on the visual assessment. Similarly, the suboptimal inter-rater agreement on the enhancement pattern classification and the presence of diffusion restriction in a lesion potentially limits their usefulness in differentiating glioma recurrence from treatment related changes.

Footnotes

Authors' Note

This manuscript has not been published previously, and that it is not currently under consideration for publication by any other journal.

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study is supported by grant from the Brain Tumour Foundation of Canada.

ORCID iDs

Nader Zakhari, MD, FRCP(C)

Santanu Chakraborty, MRCP, DMRD, FRCR, FRCP(C), MSc (HQ)

References

Abbasi

Westerlaan

Holtman

Aden

van Laar

van der Hoorn

. Incidence of tumour progression and pseudoprogression in high-grade gliomas: a systematic review and meta-analysis. Clin Neuroradiol. 2018;28(3):401–411. doi:10.1007/s00062-017-0584-x.

Nael

Bauer

Hormigo

, et al. Multiparametric MRI for differentiation of radiation necrosis from recurrent tumor in patients with treated glioblastoma. AJR Am J Roentgenol. 2018;210(1):18–23. doi:10.2214/ajr.17.18003

Soni

Ora

Mohindra

Menda

Bathla

. Diagnostic performance of PET and perfusion-weighted imaging in differentiating tumor recurrence or progression from radiation necrosis in posttreatment gliomas: a review of literature. AJNR Am J Neuroradiol. 2020;41(9):1550–1557. doi:10.3174/ajnr.A6685

Delgado-López

Riñones-Mena

Corrales-García

. Treatment-related changes in glioblastoma: a review on the controversies in response assessment criteria and the concepts of true progression, pseudoprogression, pseudoresponse and radionecrosis. Clin Transl Oncol. 2018;20(8):939–953. doi:10.1007/s12094-017-1816-x

Patel

Baradaran

Delgado

, et al. MR perfusion-weighted imaging in the evaluation of high-grade gliomas after treatment: a systematic review and meta-analysis. Neuro Oncol. 2017;19(1):118–127. doi:10.1093/neuonc/now148

Richter

Klose

Bender

, et al. Dynamic susceptibility perfusion imaging for differentiating progressive disease from pseudoprogression in diffuse glioma molecular subtypes. J Clin Med. 2021;10(4):598. doi:10.3390/jcm10040598

Walker

Ruzevick

Malayeri

, et al.

Postradiation imaging changes in the CNS: how can we differentiate between treatment effect and disease progression?

Future Oncol. 2014;10(7):1277–1297. doi:10.2217/fon.13.271

Reddy

Westerly

Chen

. MRI patterns of T1 enhancing radiation necrosis versus tumour recurrence in high-grade gliomas. J Med Imaging Radiat Oncol. 2013;57(3):349–355. doi:10.1111/j.1754-9485.2012.02472.x

Mullins

Barest

Schaefer

Hochberg

Gonzalez

Lev

. Radiation necrosis versus glioma recurrence: conventional MR imaging clues to diagnosis. AJNR Am J Neuroradiol. 2005;26(8):1967–1972.

10.

Verma

Cowperthwaite

Burnett

Markey

. Differentiating tumor recurrence from treatment necrosis: a review of neuro-oncologic imaging strategies. Neuro Oncol. 2013;15(5):515–534. doi:10.1093/neuonc/nos307

11.

Zhang

Shu

Wang

Dong

. Diagnostic accuracy of diffusion MRI with quantitative ADC measurements in differentiating glioma recurrence from radiation necrosis. J Neurol Sci. 2015;351(1-2):65–71. doi:10.1016/j.jns.2015.02.038

12.

Zakhari

Taccone

Torres

, et al. Diagnostic accuracy of centrally restricted diffusion in the differentiation of treatment-related necrosis from tumor recurrence in high-grade gliomas. AJNR Am J Neuroradiol. 2018;39(2):260–264. doi:10.3174/ajnr.A5485

13.

Zhang

Liu

Tong

, et al. Clinical applications of contrast-enhanced perfusion MRI techniques in gliomas: recent advances and current challenges. Contrast Media Mol Imaging. 2017;2017:7064120. doi:10.1155/2017/7064120

14.

Essig

Shiroishi

Nguyen

, et al. Perfusion MRI: the five most frequently asked technical questions. AJR Am J Roentgenol. 2013;200(1):24–34. doi:10.2214/ajr.12.9543

15.

Welker

Boxerman

Kalnin

Kaufmann

Shiroishi

Wintermark

. ASFNR recommendations for clinical performance of MR dynamic susceptibility contrast perfusion imaging of the brain. AJNR Am J Neuroradiol. 2015;36(6):E41–51. doi:10.3174/ajnr.A4341

16.

Barajas

Jr Chang

Segal

, et al. Differentiation of recurrent glioblastoma multiforme from radiation necrosis after external beam radiation therapy with dynamic susceptibility-weighted contrast-enhanced perfusion MR imaging. Radiology. 2009;253(2):486–496. doi:10.1148/radiol.2532090007

17.

Kerkhof

Hagenbeek

van der Kallen

, et al. Interobserver variability in the radiological assessment of magnetic resonance imaging (MRI) including perfusion MRI in glioblastoma multiforme. Eur J Neurol. 2016;23(10):1528–1533. doi:10.1111/ene.13070

18.

Hirai

Kitajima

Nakamura

, et al. Quantitative blood flow measurements in gliomas using arterial spin-labeling at 3T: intermodality agreement and inter- and intraobserver reproducibility study. AJNR Am J Neuroradiol. 2011;32(11):2073–2079. doi:10.3174/ajnr.A2725

19.

Shin

Lee

Kwun

, et al. Using relative cerebral blood flow and volume to evaluate the histopathologic grade of cerebral gliomas: preliminary results. AJR Am J Roentgenol. 2002;179(3):783–789. doi:10.2214/ajr.179.3.1790783

20.

Hakyemez

Erdogan

Ercan

Ergin

Uysal

Atahan

. High-grade and low-grade gliomas: differentiation by using perfusion MR imaging. Clin Radiol. 2005;60(4):493–502. doi:10.1016/j.crad.2004.09.009

21.

Heo

Kim

Park

Choi

Kim

. Uninterpretable dynamic susceptibility contrast-enhanced perfusion MR images in patients with post-treatment glioblastomas: cross-validation of alternative imaging options. PLoS One. 2015;10(8):e0136380. doi:10.1371/journal.pone.0136380

22.

Kazda

Bulik

Pospisil

, et al. Advanced MRI increases the diagnostic accuracy of recurrent glioblastoma: single institution thresholds and validation of MR spectroscopy and diffusion weighted MR imaging. Neuroimage Clin. 2016;11:316–321. doi:10.1016/j.nicl.2016.02.016

23.

Lee

Choi

Park

, et al. Diffusion-weighted MR imaging for the differentiation of true progression from pseudoprogression following concomitant radiotherapy with temozolomide in patients with newly diagnosed high-grade gliomas. Acad Radiol. 2012;19(11):1353–1361. doi:10.1016/j.acra.2012.06.011

24.

Wang

Chen

Lal

, et al. Evaluation of radiation necrosis and malignant glioma in rat models using diffusion tensor MR imaging. J Neurooncol. 2012;107(1):51–60. doi:10.1007/s11060-011-0719-x

25.

Lansberg

Norbash

Marks

Tong

Moseley

Albers

. Advantages of adding diffusion-weighted magnetic resonance imaging to conventional magnetic resonance imaging for evaluating acute stroke. Arch Neurol. 2000;57(9):1311–1316.

26.

Saur

Kucinski

Grzyska

, et al. Sensitivity and interrater agreement of CT and diffusion-weighted MR imaging in hyperacute stroke. AJNR Am J Neuroradiol. 2003;24(5):878–885.

27.

Ozturk

Sasson

Farrell

, et al. Regional differences in diffusion tensor imaging measurements: assessment of intrarater and interrater variability. AJNR Am J Neuroradiol. 2008;29(6):1124–1127. doi:10.3174/ajnr.A0998

28.

Brander

Kataja

Saastamoinen

, et al. Diffusion tensor imaging of the brain in a healthy adult population: Normative values and measurement reproducibility at 3 T and 1.5 T. Acta Radiol. 2010;51(7):800–807. doi:10.3109/02841851.2010.495351

29.