Augmented reality (AR) navigation refers to novel technologies that superimpose images, such as radiographs and navigation pathways, onto a view of the operative field. The development of AR navigation has focused on improving the safety and efficacy of neurosurgical and orthopedic procedures. In this review, the authors focus on 3 types of AR technology used in spine surgery: AR surgical navigation, microscope-mediated heads-up display, and AR head-mounted displays. Microscope AR and head-mounted displays offer the advantage of reducing attention shift and line-of-sight interruptions inherent in traditional navigation systems. With the U.S. Food and Drug Administration’s recent clearance of the XVision AR system (Augmedics, Arlington Heights, IL), the adoption and refinement of AR technology by spine surgeons will only accelerate.
AbeYSatoSKatoK, et al. A novel 3D guidance system using augmented reality for percutaneous vertebroplasty. J Neurosurg Spine. 2013;19(4):492–501. https://doi.org/10.3171/2013.7.SPINE12917
2.
Abul-KasimKOhlinA.The rate of screw misplacement in segmental pedicle screw fixation in adolescent idiopathic scoliosis: the effect of learning and cumulative experience. Acta Orthop. 2011;82(1):50–55. https://doi.org/10.3109/17453674.2010.548032.
CarlBBoppMSaßBNimskyC.Microscope-based augmented reality in degenerative spine surgery: initial experience. World Neurosurg. 2019;128:e541–e551. https://doi.org/10.1016/j.wneu.2019.04.192.
5.
CarlBBoppMSaßBPojskicMVoellgerBNimskyC.Spine surgery supported by augmented reality. Glob Spine J. 2020;10(suppl 2):41S–55S. https://doi.org/10.1177/2192568219868217
6.
CarlBBoppMSaßBVoellgerBNimskyC.Implementation of augmented reality support in spine surgery. Eur Spine J. 2019;28(7):1697–1711. https://doi.org/10.1007/s00586-019-05969-4
7.
DibbleCFMolinaCA.Device profile of the XVision-spine (XVS) augmented-reality surgical navigation system: overview of its safety and efficacy. Expert Rev Med Devices. 2021;18:1–8. https://doi.org/10.1080/17434440.2021.1865795.
8.
EdströmEBurströmGOmarA, et al. Augmented reality surgical navigation in spine surgery to minimize staff radiation exposure. Spine (Phila Pa 1976). 2020;45(1):E45–E53. https://doi.org/10.1097/BRS.0000000000003197.
9.
EdwardsPJKingAPMaurerCR, et al. Design and evaluation of a system for microscope-assisted guided interventions (MAGI). In: Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 1679. Springer; 1999:842–852. https://doi.org/10.1007/10704282_91
10.
Elmi-TeranderABurströmGNachabeR, et al. Pedicle screw placement using augmented reality surgical navigation with intraoperative 3D imaging: a first in-human prospective cohort study. Spine (Phila Pa 1976). 2019;44(7):517–525. https://doi.org/10.1097/BRS.0000000000002876.
11.
Elmi-TeranderASkulasonHSodermanM, et al. Surgical navigation technology based on augmented reality and integrated 3D intraoperative imaging a spine cadaveric feasibility and accuracy study. Spine (Phila Pa 1976). 2016;41(21):E1303–E1311. https://doi.org/10.1097BRS.0000000000001830.
12.
FischerMFuerstBLeeSC, et al. Preclinical usability study of multiple augmented reality concepts for K-wire placement. Int J Comput Assist Radiol Surg. 2016;11(6):1007–1014. https://doi.org/10.1007/s11548-016-1363-x
13.
FotouhiJAlexanderCPUnberathM, et al. Plan in 2-D, execute in 3-D: an augmented reality solution for cup placement in total hip arthroplasty. J Med Imaging. 2018;5(2):021205. https://doi.org/10.1117/1.JMI.5.2.021205.
14.
GavaghanKOliveira-SantosTPeterhansM, et al. Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: phantom studies. Int J Comput Assist Radiol Surg. 2012;7(4):547–556. https://doi.org/10.1007/s11548-011-0660-7
15.
GibbyJTSwensonSACvetkoSRaoRJavanR.Head-mounted display augmented reality to guide pedicle screw placement utilizing computed tomography. Int J Comput Assist Radiol Surg. 2019;14(3):525–535. https://doi.org/101007/s11548-018-1814-7
JiangBPenningtonZZhuA, et al. Three-dimensional assessment of robot-assisted pedicle screw placement accuracy and instrumentation reliability based on a preplanned trajectory. J Neurosurg Spine. 2020;33(4):519–528. https://doi.org/10.3171/2020.3.SPINE20208
18.
JinMLiuZQiuYYanHHanXZhuZ.Incidence and risk factors for the misplacement of pedicle screws in scoliosis surgery assisted by O-arm navigation—analysis of a large series of one thousand, one hundred and forty five screws. Int Orthop. 2017;41(4):773–780. https://doi.org/10.1007/s00264-016-3353-6
19.
JudLFotouhiJAndronicO, et al. Applicability of augmented reality in orthopedic surgery: a systematic review. BMC Musculoskelet Disord. 2020;21(1):103. https://doi.org/10.1186/s12891-020-3110-2
KosterhonMGutenbergAKantelhardtSRArchavlisEGieseA.Navigation and image injection for control of bone removal and osteotomy planes in spine surgery. Oper Neurosurg. 2017;13(2):297–304. https://doi.org/10.1093/ons/opw017
22.
LiebmannFRonerSvon AtzigenM, et al. Pedicle screw navigation using surface digitization on the Microsoft HoloLens. Int J Comput Assist Radiol Surg. 2019;14(7):1157–1165. https://doi.org/10.1007/s11548-019-01973-7
23.
LiuAJinYCottrillE, et al. Clinical accuracy and initial experience with augmented reality-assisted pedicle screw placement: the first 205 screws [published online ahead of print 2021]. J Neurosurg Spine.
24.
LucianoCJBanerjeePPBellotteB, et al. Learning retention of thoracic pedicle screw placement using a high-resolution augmented reality simulator with haptic feedback. Neurosurgery. 2011;69(suppl 1):ons14–19; discussion ons19. https://doi.org/10.1227/NEU.0b013e31821954ed
25.
MolinaCAPhillipsFMColmanMW, et al. A cadaveric precision and accuracy analysis of augmented reality-mediated percutaneous pedicle implant insertion. J Neurosurg Spine. 2021;34:316–324. https://doi.org/10.3171/2020.6.SPINE20370
26.
MolinaCASciubbaDMGreenbergJKKhanMWithamT.Clinical accuracy, technical precision, and workflow of the first in human use of an augmented-reality head-mounted display stereotactic navigation system for spine surgery. Oper Neurosurg. 2020;20(3):300–309. https://doi.org/10.1093/ons/opaa398
27.
MolinaCATheodoreNKarim AhmedA, et al. Augmented reality-assisted pedicle screw insertion: a cadaveric proof-of-concept study. J Neurosurg Spine. 2019;31(1):139–146. https://doi.org/10.3171/2018.12.SPINE181142
28.
MüllerFRonerSLiebmannFSpirigJMFürnstahlPFarshadM.Augmented reality navigation for spinal pedicle screw instrumentation using intraoperative 3D imaging. Spine J. 2020;20(4):621–628. https://doi.org/10.1016/j.spinee.2019.10.012.
29.
NakamuraMTamakiNTamuraSYamashitaHHaraYEharaK.Image-guided microsurgery with the Mehrkoordinaten Manipulator system for cerebral arteriovenous malformations. J Clin Neurosci. 2000;7:10–13. https://doi.org/10.1054/jocn.2000.0702.
30.
PehSChatterjeaAPfarrJ, et al. Accuracy of augmented reality surgical navigation for minimally invasive pedicle screw insertion in the thoracic and lumbar spine with a new tracking device. Spine J. 2020;20(4):629–637. https://doi.org/10.1016/j.spinee.2019.12.009.
31.
QianBPZhangYPQiaoMQiuYMaoSH.Accuracy of freehand pedicle screw placement in surgical correction of thoracolumbar kyphosis secondary to ankylosing spondylitis: a computed tomography investigation of 2314 consecutive screws. World Neurosurg. 2018;116:e850–e855. https://doi.org/10.1016/j.wneu.2018.05.116.
32.
RobertsDWStrohbehnJWHatchJFMurrayWKettenbergerH.A frameless stereotaxic integration of computerized tomographic imaging and the operating microscope. J Neurosurg. 1986;65(4):545–549. https://doi.org/10.3171/jns.1986.65.4.0545
33.
SaylanyASpadolaMBlueRSharmaNOzturkAKYoonJW.The use of a novel heads-up display (HUD) to view intra-operative x-rays during a one-level cervical arthroplasty. World Neurosurg. 2020;138:369–373. https://doi.org/10.1016/j.wneu.2020.03.073.
TepperOMRudyHLLefkowitzA, et al. Mixed reality with hololens: where virtual reality meets augmented reality in the operating room. Plast Reconstr Surg. 2017;140(5):1066–1070. https://doi.org/10.1097/PRS.0000000000003802.
36.
UmebayashiDYamamotoYNakajimaYFukayaNHaraM.Augmented reality visualization-guided microscopic spine surgery: transvertebral anterior cervical foraminotomy and posterior foraminotomy. JAAOS Glob Res Rev. 2018;2(4):e008. https://doi.org/10.5435/jaaosglobal-d-17-00008
37.
U.S. Food & Drug Administration. Public workshop—medical extended reality: toward best evaluation practices for virtual and augmented reality in medicine. https://www.fda.gov/media/136890/download Published March 5, 2020. Accessed June 18, 2021.
38.
VoCDJiangBAzadTDCrawfordNRBydonATheodoreN.Robotic spine surgery: current state in minimally invasive surgery. Glob Spine J. 2020;10(suppl 2):34S–40S. https://doi.org/10.1177/2192568219878131
39.
WangHWangFLeongAPYXuLChenXWangQ.Precision insertion of percutaneous sacroiliac screws using a novel augmented reality-based navigation system: a pilot study. Int Orthop. 2016;40(9):1941–1947. https://doi.org/10.1007/s00264-015-3028-8
40.
WanivenhausFNeuhausCLiebmannFRonerSSpirigJMFarshadM.Augmented reality-assisted rod bending in spinal surgery. Spine J. 2019;19(10):1687–1689. https://doi.org/10.1016/j.spinee.2019.06.019.
41.
WeiNJDoughertyBMyersABadawySM.Using Google glass in surgical settings: systematic review. JMIR Mhealth Uhealth. 2018;6(3):e54. https://doi.org/10.2196/mhealth.9409.
42.
YoonJWChenREHanPKSiPFreemanWDPirrisSM.Technical feasibility and safety of an intraoperative head-up display device during spine instrumentation. Int J Med Robot Comput Assist Surg. 2017;13(3):e1770–e1795. https://doi.org/10.1002/rcs.1770.
