The modern-day radiologist must be adept at image interpretation, and the one who most successfully leverages new technologies may provide the highest value to patients, clinicians, and trainees. Applications of virtual reality (VR) and augmented reality (AR) have the potential to revolutionize how imaging information is applied in clinical practice and how radiologists practice. This review provides an overview of VR and AR, highlights current applications, future developments, and limitations hindering adoption.
PelargosPENagasawaDTLagmanC, et al.
Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery.J Clin Neurosci2017;
35:1–4.
2.
Committee on Diagnostic Error in Health C, Board on Health Care S, Medicine Ioet al. Technology and Tools in the Diagnostic Process. In: BaloghEPMillerBTBallJR (eds) Improving Diagnosis in Health Care.
Washington, DC:
National Academies Press, 2015, pp.217–262.
3.
SutherlandJBelecJSheikhA, et al.
Applying modern virtual and augmented reality technologies to medical images and models.J Digit Imaging2019;
32:38–53.
4.
MoroCStrombergaZRaikosA.The effectiveness of virtual and augmented reality in health sciences and medical anatomy.2017;
10:549–559.
5.
PlasenciaDM.One step beyond virtual reality: connecting past and future developments.XRDS2015;
22:18–23.
6.
PrattPIvesMLawtonG, et al.
Through the HoloLens looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels. Eur Radiol Exp2018;
2:2.
SutherlandIE. A head-mounted three dimensional display. In: Proceedings of the December 9–11, 1968, fall joint computer conference, part I. New York, NY: ACM, 1968:757–764.
McCarthyCJYuAYCDoS, et al.
Interventional Radiology Training Using a Dynamic Medical Immersive Training Environment (DynaMITE).J Am Coll Radiol2018;
15: 789–793.
RengierFMehndirattaAvon Tengg-KobligkH, et al.
3D printing based on imaging data: review of medical applications.Int J Comput Assist Radiol Surg2010;
5:335–341.
14.
McGurkMAmisAAPotamianosP, et al.
Rapid prototyping techniques for anatomical modelling in medicine.Ann R Coll Surg Engl1997;
79:169–174.
15.
NekooeiSSardabiMRazaviME, et al.
Implantation of Customized, Preshaped Implant for Orbital Fractures with the Aid of Three-dimensional Printing.Middle East Afr J Ophthalmol2018;
25:56–58.
16.
D’UrsoPSEarwakerWJBarkerTM, et al.
Custom cranioplasty using stereolithography and acrylic.Br J Plast Surg2000;
53:200–204.
17.
FaberJBertoPMQuaresmaM.Rapid prototyping as a tool for diagnosis and treatment planning for maxillary canine impaction.Am J Orthod Dentofacial Orthop2006;
129:583–589.
18.
MaviliMECanterHISaglam-AydinatayB, et al.
Use of three-dimensional medical modeling methods for precise planning of orthognathic surgery.J Craniofac Surg2007;
18:740–747.
19.
MullerAKrishnanKGUhlE, et al.
The application of rapid prototyping techniques in cranial reconstruction and preoperative planning in neurosurgery.J Craniofac Surg2003;
14:899–914.
20.
PoukensJHaexJRiedigerD.The use of rapid prototyping in the preoperative planning of distraction osteogenesis of the cranio-maxillofacial skeleton.Comput Aided Surg2003;
8:146–154.
21.
GuarinoJTennysonSMcCainG, et al.
Rapid prototyping technology for surgeries of the pediatric spine and pelvis: benefits analysis.J Pediatr Orthop2007;
27:955–960.
22.
HursonCTanseyAO'DonnchadhaB, et al.
Rapid prototyping in the assessment, classification and preoperative planning of acetabular fractures.Injury2007;
38:1158–1162.
23.
WurmGTomancokBPogadyP, et al.
Cerebrovascular stereolithographic biomodeling for aneurysm surgery. Technical note.J Neurosurg2004;
100:139–145.
24.
GieselFLHartARHahnHK, et al.
3D reconstructions of the cerebral ventricles and volume quantification in children with brain malformations.Acad Radiol2009;
16:610–617.
25.
ArmillottaABonhoefferPDubiniG, et al.
Use of rapid prototyping models in the planning of percutaneous pulmonary valved stent implantation.Proc Inst Mech Eng H2007;
221:407–416.
26.
KimMSHansgenARWinkO, et al.
Rapid prototyping: a new tool in understanding and treating structural heart disease.Circulation2008;
117:2388–2394.
27.
HiramatsuHYamaguchiHNimiS, et al. [
Rapid prototyping of the larynx for laryngeal frame work surgery].Nihon Jibiinkoka Gakkai Kaiho2004;
107:949–955.
28.
D’UrsoPSBarkerTMEarwakerWJ, et al.
Stereolithographic biomodelling in cranio-maxillofacial surgery: a prospective trial.J Craniomaxillofac Surg1999;
27:30–37.
29.
KaletIJWuJLeaseM, et al.
Anatomical information in radiation treatment planning. Proc AMIA Symp1999:291–295.
30.
SunSPWuCJ.Using the full scale 3D solid anthropometric model in radiation oncology positioning and verification.Conf Proc IEEE Eng Med Biol Soc2004;
5:3432–3435.
31.
ZemnickCWoodhouseSAGewanterRM, et al.
Rapid prototyping technique for creating a radiation shield.J Prosthet Dent2007;
97:236–241.
32.
SulaimanABousselLTaconnetF, et al.
In vitro non-rigid life-size model of aortic arch aneurysm for endovascular prosthesis assessment.Eur J Cardiothorac Surg2008;
33:53–57.
33.
SuzukiMOgawaYKawanoA, et al.
Rapid prototyping of temporal bone for surgical training and medical education.Acta Otolaryngol2004;
124:400–402.
34.
KnoxKKerberCWSingelSA, et al.
Rapid prototyping to create vascular replicas from CT scan data: making tools to teach, rehearse, and choose treatment strategies.Catheter Cardiovasc Interv2005;
65:47–53.
35.
BruyereFLerouxCBrunereauL, et al.
Rapid prototyping model for percutaneous nephrolithotomy training.J Endourol2008;
22:91–96.
36.
CansteinCCachotPFaustA, et al.
3D MR flow analysis in realistic rapid-prototyping model systems of the thoracic aorta: comparison with in vivo data and computational fluid dynamics in identical vessel geometries.Magn Reson Med2008;
59:535–546.
37.
SodianRSchmaussDSchmitzC, et al.
3-dimensional printing of models to create custom-made devices for coil embolization of an anastomotic leak after aortic arch replacement.Ann Thorac Surg2009;
88:974–978.
BairamianDLiuSEftekharB.Virtual reality angiogram vs 3-dimensional printed angiogram as an educational tool-A comparative study.Neurosurgery2019;
85:E343–e349.
40.
WakeNBjurlinMARostamiP, et al.
Three-dimensional printing and augmented reality: enhanced precision for robotic assisted partial nephrectomy.Urology2018;
116:227–228.
41.
NicolauSSolerLMutterD, et al.
Augmented reality in laparoscopic surgical oncology.Surg Oncol2011;
20:189–201.
42.
SimpfendorferTGaschCHatibogluG, et al.
Intraoperative computed tomography imaging for navigated laparoscopic renal surgery: first clinical experience.J Endourol2016;
30:1105–1111.
43.
TeberDGuvenSSimpfendorferT, et al.
Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results.Eur Urol2009;
56:332–338.
44.
SuL-MVagvolgyiBPAgarwalR, et al.
Augmented reality during robot-assisted laparoscopic partial nephrectomy: toward real-time 3D-CT to stereoscopic video registration.Urology2009;
73:896–900.
MarescauxJRubinoFArenasM, et al.
Augmented-reality-assisted laparoscopic adrenalectomy.JAMA2004;
292:2214–2215.
47.
BaumhauerMFeuersteinMMeinzerH-P, et al.
Navigation in endoscopic soft tissue surgery: perspectives and limitations.J Endourol2008;
22:751–766.
48.
Besharati TabriziLMahvashM.Augmented reality-guided neurosurgery: accuracy and intraoperative application of an image projection technique.J Neurosurg2015;
123:206–211.
49.
MahvashMBesharati TabriziL.A novel augmented reality system of image projection for image-guided neurosurgery.Acta Neurochir (Wien)2013;
155:943–947.
50.
StadieATKockroRA.Mono-stereo-autostereo: the evolution of 3-dimensional neurosurgical planning.Neurosurgery2013;
72Suppl 1:63–77.
51.
KonishiKHashizumeMNakamotoM, et al.
Augmented reality navigation system for endoscopic surgery based on three-dimensional ultrasound and computed tomography: Application to 20 clinical cases.International Congress Series2005;
1281:537–542.
52.
IeiriSUemuraMKonishiK, et al.
Augmented reality navigation system for laparoscopic splenectomy in children based on preoperative CT image using optical tracking device.Pediatr Surg Int2012;
28:341–346.
53.
SouzakiRIeiriSUemuraM, et al.
An augmented reality navigation system for pediatric oncologic surgery based on preoperative CT and MRI images.J Pediatr Surg2013;
48:2479–2483.
54.
RancatiAAngrigianiCNavaMB, et al.
Augmented reality for breast imaging.Minerva Chir2018;
73:341–344.
55.
DouglasDBBooneJMPetricoinE, et al.
Augmented Reality Imaging System: 3D Viewing of a Breast Cancer. J Nat Sci2016;
2:e215.
56.
DouglasDBPetricoinEFLiottaL, et al.
D3D augmented reality imaging system: proof of concept in mammography.Med Devices (Auckl)2016;
9:277–283.
57.
DevcicZIdakojiIKesselmanA, et al.
4:03 PM Abstract No. 30 Augmented virtual reality assisted treatment planning for splenic artery aneurysms: a pilot study.J Vasc Intervent Radiol2018;
29:S17.
58.
KuhlemannIKleemannMJauerP, et al.
Towards X-ray free endovascular interventions - using HoloLens for on-line holographic visualisation.Healthc Technol Lett2017;
4:184–187.
59.
NicolauSAPennecXSolerL, et al.
An augmented reality system for liver thermal ablation: Design and evaluation on clinical cases.Med Image Anal2009;
13:494–506.
60.
SolbiatiMPasseraKMRotilioA, et al.
Augmented reality for interventional oncology: proof-of-concept study of a novel high-end guidance system platform.Eur Radiol Exp2018;
2:18.
61.
SousaMMendesDPauloS, et al. VRRRRoom: Virtual Reality for Radiologists in the Reading Room. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Denver, Colorado, May 6–11, 2017. New York, NY: ACM, 2017:4057–4062.
62.
LechtzinNBusseAMSmithMT, et al.
A randomized trial of nature scenery and sounds versus urban scenery and sounds to reduce pain in adults undergoing bone marrow aspirate and biopsy.J Altern Complement Med2010;
16:965–972.
63.
EvansD.The effectiveness of music as an intervention for hospital patients: a systematic review.J Adv Nurs2002;
37:8–18.
64.
TanSY.Cognitive and cognitive-behavioral methods for pain control: a selective review.Pain1982;
12:201–228.
65.
DasDAGrimmerKASparnonAL, et al.
The efficacy of playing a virtual reality game in modulating pain for children with acute burn injuries: a randomized controlled trial [ISRCTN87413556].BMC Pediatr2005;
5:1.
66.
HoffmanHGChambersGTMeyerWJ, 3rdet al.
Virtual reality as an adjunctive non-pharmacologic analgesic for acute burn pain during medical procedures.Ann Behav Med2011;
41:183–191.
67.
KhanJDonnellyLKochBL, et al.
A program to decrease the need for pediatric sedation for CT and MRI.Applied Radiology2007;
36:30.
68.
Asl AminabadiNErfanparastLSohrabiA, et al.
The impact of virtual reality distraction on pain and anxiety during dental treatment in 4-6 year-old children: a randomized controlled clinical trial.J Dent Res Dent Clin Dent Prospects2012;
6:117–124.
69.
GoldJIKimSHKantAJ, et al.
Effectiveness of virtual reality for pediatric pain distraction during i.v. placement.Cyberpsychol Behav2006;
9:207–212.
70.
WonASBaileyJBailensonJ, et al.
Immersive virtual reality for pediatric pain.Children (Basel)2017;
4:E52.
71.
ScapinSEchevarria-GuaniloMEBoeira Fuculo JuniorPR, et al.
Virtual Reality in the treatment of burn patients: A systematic review.Burns2018;
44:1403–1416.
72.
HoffmanHGSeibelEJRichardsTL, et al.
Virtual reality helmet display quality influences the magnitude of virtual reality analgesia.J Pain2006;
7:843–850.
73.
ChanPYScharfS.Virtual reality as an adjunctive nonpharmacological sedative during orthopedic surgery under regional anesthesia: a pilot and feasibility study.Anesth Analg2017;
125:1200–1202.
74.
PandyaPGKimTE.Virtual reality distraction decreases routine intravenous sedation and procedure-related pain during preoperative adductor canal catheter insertion: a retrospective study. Korean J Anesthesiol2017;
70:439–445.
75.
HoffmanHGRichardsTLCodaB, et al.
Modulation of thermal pain-related brain activity with virtual reality: evidence from fMRI.Neuroreport2004;
15:1245–1248.
76.
BahetiADThakurMHJankhariaB.Informed consent in diagnostic radiology practice: Where do we stand?Ind J Radiol Imaging2017;
27:517–520.
77.
Satyanarayana RaoKH.Informed consent: an ethical obligation or legal compulsion?J Cutan Aesthet Surg2008;
1:33–35.
78.
CoyneCAXuRRaichP, et al.
Randomized, controlled trial of an easy-to-read informed consent statement for clinical trial participation: a study of the Eastern Cooperative Oncology Group.J Clin Oncol2003;
21:836–842.
79.
PereiraSPHussainiSHWilkinsonML.Informed consent for upper gastrointestinal endoscopy.Gut1995;
37:151–153.
80.
DavisTCHolcombeRFBerkelHJ, et al.
Informed consent for clinical trials: a comparative study of standard versus simplified forms.J Natl Cancer Inst1998;
90:668–674.
81.
PowellRScottNWManyandeA, et al.Psychological preparation and postoperative outcomes for adults undergoing surgery under general anaesthesia. Cochrane Database Syst Rev2016;(5):CD008646.
82.
KruzikN.Benefits of preoperative education for adult elective surgery patients.AORN J2009;
90:381–387.
83.
PraterARostadBSEbertEL, et al.
Towards consensus: training in procedural skills for diagnostic radiology residents-current opinions of residents and faculty at a large academic center.Curr Probl Diagn Radiol2018;
47:387–392.
HarrisonPRaisonNAbeT, et al.
The validation of a novel robot-assisted radical prostatectomy virtual reality module.J Surg Educ2018;
75:758–766.
86.
OlaskyJSankaranarayananGSeymourNE, et al.
Identifying opportunities for virtual reality simulation in surgical education: a review of the Proceedings from the Innovation, Design, and Emerging Alliances in Surgery (IDEAS) Conference: VR Surgery.Surg Innov2015;
22:514–521.
CheungTTMaKWSheWH, et al.
Pure laparoscopic hepatectomy with augmented reality-assisted indocyanine green fluorescence versus open hepatectomy for hepatocellular carcinoma with liver cirrhosis: A propensity analysis at a single center.Asian J Endosc Surg2018;
11:104–111.
94.
KleemannMDeichmannSEsnaashariH, et al.
Laparoscopic navigated liver resection: technical aspects and clinical practice in benign liver tumors.Case Rep Surg2012;
2012:265918.
95.
KhorWSBakerBAminK, et al.
Augmented and virtual reality in surgery-the digital surgical environment: applications, limitations and legal pitfalls.Ann Transl Med2016;
4:454–454.
96.
Corporation PbN. 510(k) Pemarket Notification for OpenSight. Silver Spring, MD: U.S Food and Drug Administration, 2018.
97.
LLC PbST. 510 (k) Premarket Notification for SuRgical Planner (SRP). Silver Spring, MD: U.S Food and Drug Administration, 2018.
98.
WhalleyLJ.Ethical issues in the application of virtual reality to medicine.Comput Biol Med1995;
25:107–114.
