Augmented Reality in Neurosurgery

doi:10.1017/9781009597852.010

5b - Augmented Reality in Neurosurgery

from Chapter 5 - The Computer as a Tool in Understanding and Managing Brain Disease

Published online by Cambridge University Press: 29 November 2025

Stefan Vilsmeier

Edited by

Benjamin Hartley,

Philip E. Stieg,

Rohan Ramakrishna and

Michael L. J. Apuzzo

Show author details

Benjamin Hartley: Affiliation:
Weill Cornell Medical Center
Philip E. Stieg: Affiliation:
Weill Cornell Medical College
Rohan Ramakrishna: Affiliation:
Weill Cornell Medical College
Michael L. J. Apuzzo: Affiliation:
Adjunct of Yale Medical School and Weill Cornell Medical College

Book contents

Get access

Summary

Neurosurgery has always been at the forefront of adopting innovative technologies and this may easily be explained by the unique demands imposed on surgeons when operating in the brain and spine. Augmented reality (AR) has emerged as a promising technology in neurosurgery, aiming to link the digital and physical worlds to enhance clinical practice and education. This review explores the evolution of AR in neurosurgery, from a modest optical technology inception to a digitally enhanced plethora of mixed reality media, and how widespread adoption has been hindered by technical limitations. Various approaches to displaying AR as well as requirements for future-proof patient digital models are discussed. Challenges associated with updating models intra-operatively and the need for precise tracking of the physical environment are also reviewed. The chapter concludes with the authors’ vision for overcoming these technical hurdles, which will be essential for realizing the full potential of AR in neurosurgical practice.

Keywords

Augmented reality virtual reality neurosurgery cranial surgery navigation image guidance training education history innovations

Information

Type: Chapter
Information: Neurosurgery
Beyond the Cutting Edge
, pp. 66 - 79
DOI: https://doi.org/10.1017/9781009597852.010 [Opens in a new window]
Publisher: Cambridge University Press
Print publication year: 2025

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Book purchase

Temporarily unavailable

References

Mezger, U., Jendrewski, C., Bartels, M.. Navigation in surgery. Langenbecks Arch Surg. 2013; 398(4): 501–14.10.1007/s00423-013-1059-4CrossRef Google Scholar PubMed

Ma, L. and Baowei, F.. Comprehensive review of surgical microscopes: technology development and medical applications. J Biomed Opt. 2021; 26 (1): 010901.10.1117/1.JBO.26.1.010901CrossRef Google Scholar PubMed

Michalak, S. M., Rolston, J. D., Lawton, M. T.. Incidence and predictors of complications and mortality in cerebrovascular surgery: national trends from 2007 to 2012. Neurosurgery. 2016; 79 (2): 182–93.10.1227/NEU.0000000000001251CrossRef Google Scholar PubMed

Lakomkin, N., Stannard, B., Fogelson, J. L., et al. Comparison of surgical invasiveness and morbidity of adult spinal deformity surgery to other major operations. Spine J. 2021; 21 (11): 1784–92.10.1016/j.spinee.2021.07.013CrossRef Google Scholar PubMed

How many years of postgraduate training do surgical residents undergo? https://www.facs.org/for-medical-professionals/education/online-guide-to-choosing-a-surgical-residency/guide-to-choosing-a-surgical-residency-for-medical-students/faqs/training/. (Accessed June 11, 2023.)Google Scholar

Kelly, P. J.. Stereotactic imaging, surgical planning and computer-assisted resection of intracranial lesions: methods and results. Adv Tech Stand Neurosurg. 1990; 17: 77–118.10.1007/978-3-7091-6925-4_3CrossRef Google Scholar PubMed

In: Furht, B. (eds). Augmented Reality. Encyclopedia of Multimedia. Springer, Boston, MA (2006).10.1007/0-387-30038-4CrossRef Google Scholar

Hyman, I.. Filippo Brunelleschi. Encyclopedia Britannica, April 11, 2023. https://www.britannica.com/biography/Filippo-Brunelleschi (Accessed June 12, 2023).Google Scholar

Steinhaus, H.. Sur la Localisation au Moyen des Rayons X. Comptes Rendus de L’Acad. des Sci. 1938; 206: 1473–5.Google Scholar

Roberts, D. W., Strohbehn, J. W., Hatch, J. F., et al. A frameless stereotaxic integration of computerized tomographic imaging and the operating microscope. J Neurosurg. 1986; 65 (4): 545–9.10.3171/jns.1986.65.4.0545CrossRef Google Scholar PubMed

Edwards, P. J., Hawkes, D. J., Hill, D. L., et al. Augmentation of reality using an operating microscope for otolaryngology and neurosurgical guidance. J Image Guid Surg. 1995; 1 (3): 172–8.10.1002/(SICI)1522-712X(1995)1:3<172::AID-IGS7>3.0.CO;2-73.0.CO;2-7>CrossRef Google Scholar PubMed

Kawamata, T., Iseki, H., Shibasaki, T., et al. Endoscopic augmented reality navigation system for endonasal transsphenoidal surgery to treat pituitary tumors: technical note. Neurosurgery. 2002; 50 (6): 1393–7.Google Scholar PubMed

Zamorano, L., Vinas, F. C., Buciuc, R., et al. Advanced neurosurgical navigation using a robotic microscope integrated with an infrared-based system. computer-assisted neurosurgery. Springer, Tokyo (1997).Google Scholar

Mascitelli, J. R., Schlachter, L., Chartrain, A. G., et al. Navigation-linked heads-up display in intracranial surgery: early experience. Oper Neurosurg (Hagerstown). 2018; 15 (2): 184–93.Google Scholar PubMed

Fiani, B., Jarrah, R., Griepp, D. W., et al. The role of 3D exoscope systems in neurosurgery: an optical innovation. Cureus. 2021; 13 (6): e15878.Google Scholar PubMed

Guha, D., Alotaibi, N. M., Nguyen, N., et al. Augmented reality in neurosurgery: a review of current concepts and emerging applications. Can J Neurol Sci. 2017; 44 (3): 235–45.10.1017/cjn.2016.443CrossRef Google Scholar PubMed

Gerhardt, J., Sollmann, N., Hiepe, P., et al. Retrospective distortion correction of diffusion tensor imaging data by semi-elastic image fusion – evaluation by means of anatomical landmarks. Clin Neurol Neurosurg. 2019; 183: 105387.10.1016/j.clineuro.2019.105387CrossRef Google Scholar PubMed

Milgram, P., Takemura, H., Utsumi, A., et al. Augmented reality: a class of displays on the reality-virtuality continuum. Proc. SPIE 2351, Telemanipulator and Telepresence Technologies, (21 December 1995).Google Scholar

Keil, H. and Trapp, O.. Fluoroscopic imaging: new advances. Injury. 2022; 53 Suppl. 3: S8–15.10.1016/j.injury.2022.05.035CrossRef Google Scholar PubMed

Microsoft HoloLens 2. https://www.microsoft.com/en-us/hololens. (Accessed June 11, 2023.)Google Scholar

Magic Leap 2. https://www.magicleap.com/magic-leap-2. (Accessed June 11, 2023.)Google Scholar

Nabiyouni, M., Scerbo, S., Bowman, D. A., et al. Relative effects of real-world and virtual-world latency on an augmented reality training task: an AR simulation experiment. Front. ICT 2017; 3: 34.10.3389/fict.2016.00034CrossRef Google Scholar

Negwer, C., Hiepe, P., Meyer, B., et al. Elastic fusion enables fusion of intraoperative magnetic resonance imaging data with preoperative neuronavigation data. World Neurosurg. 2020; 142: e223–8.10.1016/j.wneu.2020.06.166CrossRef Google Scholar PubMed

Barak, T., Vetsa, S., Nadar, A., et al. Surgical strategies for older patients with glioblastoma. J Neurooncol. 2021; 155 (3): 255–64.Google Scholar PubMed

Bailey, T. and Durrant-Whyte, H.. Simultaneous Localisation and Mapping (SLAM): part II state of the art. IEEE Robotics & Automation Magazine 2006; 13 (3): 108–17.10.1109/MRA.2006.1678144CrossRef Google Scholar

Röntgen, W. C.. On a new kind or rays. Journal of the Franklin Institute 1896; 141; 3: 183–91.10.1016/S0016-0032(96)90066-6CrossRef Google Scholar

Why has France lost 80,000 hospital beds in 20 years? https://www.connexionfrance.com/article/French-news/Why-has-France-lost-80-000-hospital-beds-in-20-years. (Accessed June 12, 2023.)Google Scholar

Jean, W. C.. Virtual and augmented reality in neurosurgery: the evolution of its application and study designs. World Neurosurg. 2022; 161: 459–64.10.1016/j.wneu.2021.08.150CrossRef Google Scholar PubMed

Accessibility standard: Inaccessible, or known limited accessibility

Why this information is here

This section outlines the accessibility features of this content - including support for screen readers, full keyboard navigation and high-contrast display options. This may not be relevant for you.

Accessibility Information

The HTML of this chapter is known to have missing or limited accessibility features. We may be reviewing its accessibility for future improvement, but final compliance is not yet assured and may be subject to legal exceptions. If you have any questions, please contact accessibility@cambridge.org.

Content Navigation

Table of contents navigation
Allows you to navigate directly to chapters, sections, or non‐text items through a linked table of contents, reducing the need for extensive scrolling.

Index navigation
Provides an interactive index, letting you go straight to where a term or subject appears in the text without manual searching.

Reading Order & Textual Equivalents

Single logical reading order
You will encounter all content (including footnotes, captions, etc.) in a clear, sequential flow, making it easier to follow with assistive tools like screen readers.

Short alternative textual descriptions
You get concise descriptions (for images, charts, or media clips), ensuring you do not miss crucial information when visual or audio elements are not accessible.

Visual Accessibility

Use of colour is not sole means of conveying information
You will still understand key ideas or prompts without relying solely on colour, which is especially helpful if you have colour vision deficiencies.

Structural and Technical Features

ARIA roles provided
You gain clarity from ARIA (Accessible Rich Internet Applications) roles and attributes, as they help assistive technologies interpret how each part of the content functions.