Throughout its history, neurosurgery has developed a uniquely symbiotic relationship with emerging technologies, largely attributable to the potential for such innovations to provide a practical bridge across the tremendous gaps in applied neuroscience. There is a singular boldness to operating on the nervous system, particularly given that many aspects of both normal function and disease remain incompletely understood. In spite of this, a fundamental pillar of neurosurgery is the mandate to use all available resources in rendering treatments as safe, effective and gentle as possible.
Within this context, technology has accordingly provided some of the most impactful avenues for improving neurosurgical care, and our operating room has evolved into one of the most critical spaces for the development and advancement of novel tools and techniques. In many ways, the history of neurosurgery can be told through its tools. Imaging modalities like pneumoencephalography, computed tomography and magnetic resonance have each transformed practice. Advanced visualization aids such as the operating microscope and endoscope, indocyanine green or 5-ALA and intra-operative stereotaxis have improved the safety and quality of innumerable operations. New devices, ranging from deep brain stimulators to endovascular devices to spinal instrumentation, have wildly expanded the scope of what can be treated.
Neurosurgical innovations are often most impactful when a technological advance can be readily integrated into patient care. At present, neurosurgery is rapidly approaching just such an inflexion point with the rise of 3D modeling.
Broadly defined, 3D modeling is the creation of digital objects in a manner that can be mapped, mathematically and physically, to Cartesian space in three dimensions. As such, 3D models contrast with traditional forms of representing 3D space using 2D techniques such as vanishing point perspective in that the digital objects also encode volumetric information. Informally, this creates the framework for objects to interact with one another and with users in a way that very closely approximates a variety of real-world environments.
Although 3D models can be generated using a variety of techniques, the most common clinically salient strategy uses cross-sectional imaging to build triangular mesh matrices in a process called “segmentation.” Once 3D parts have been defined using the triangular mesh frameworks, they can be further modified by 3D rendering software, much like a physical object can be sculpted, divided, scaled or decorated. The final 3D objects can then be exported to a variety of 3D platforms, including simple viewing devices based on browsers or mobile devices, virtual or augmented reality (VR/AR) devices that might require a wearable headset, or an additive manufacturing process for 3D printing.
Medical 3D models are by no means novel, particularly within the context of teaching clinical anatomy; however, the increasingly widespread availability of software and hardware that support the development, testing and implementation of 3D models across a range of clinical spaces has dramatically accelerated their utility and consequent approval in practice. At present, most innovations in medical 3D modeling are clustered into three domains: education, clinical care and research.
Education Applications
Perhaps the most obvious space for the deployment of high-fidelity 3D models across a range of platforms is simulation and training. Neurosurgery residency curricula are already beginning to integrate resources built on VR/AR or 3D printing technologies, such as approach selection trainers; simulators for aneurysm clipping, pedicle screw placement, ICA blow-out injury management or temporal bone drilling; and guides for cadaveric dissection, among others.8–10,13,16 Still other applications are under development, such as fully immersive angiography suite simulators, which will provide both practical training on capital equipment, as well as example cases for rehearsal, and radiation safety education modules. As these resources become more sophisticated and high-fidelity, they will provide a vital supplement for early neurosurgical training. Accelerating the learning curve by integrating 3D models and simulators is an area of critical need, particularly given the overarching trends in duty hour restrictions and the shifting medical-legal context.
Clinical Applications
Although some clinical applications of 3D modeling are further out in the development pipeline than educational tools, a large number are already in early testing and development. Some of these are patient-facing and passive, such as VR-based educational content for informed consent or postoperative care.1,18,25 Others have a more interactive or treatment-adjunctive dimension, such as postoperative physical therapy instructions delivered by AR or VR-based distraction modules during painful procedures, such as lumbar drain placement or spine injections.3,17,21 Finally, many other applications are surgeon-facing and aimed at enhancing various phases of care. Prominent examples under development include preoperative approach planning with VR or 3D printed models of patient-specific anatomy and pathology in situ, and intra-operative treatment enhancement via AR projections to assist with patient positioning or placement of an EVD, pedicle screw or other device, among many other proposed applications.2,7,12,14,19,22,24 The most integrated applications in contemporary neurosurgical practice are those related to cranial reconstruction, including cutting guides for cranial vault remodeling in pediatric craniosynostosis or bone flap replacement with personalized 3D-printed cranioplasties.4–6,11,15,20,23
Research Applications
The academic applications of 3D modeling are both forward-looking and retrospective. At once, neurosurgeons are engaged in developing novel and innovative applications of these emergent technologies, as well as ensuring their safety in preclinical and clinical assessments. Much of the work to date in 3D modeling medical research has been technical and focused specifically on developing the new tools or more efficient techniques, that have collectively given 3D modeling a meaningful avenue towards clinical implementation.5,10,13,16 In parallel, other efforts have shown preliminary efficacy data in a variety of parallel spaces, including trainee education, patient counseling and treatment enhancement. These efforts highlight one of the most important routes forward for the study of 3D modeling in neurosurgery, as the field evolves from answering more simple questions like “Can we achieve this?” to the more nuanced assessments of “Does incorporating these new tools result in a significant improvement in outcome or quality as compared to standard-of-care, sufficient to justify the additional time, cost or risk?”
Conclusion
In many ways, the pursuit of surgical cures for neurologic disorders is an inherently aspirational endeavor. From a practical perspective, the tools available to remove, restore, regenerate or replace tissue within the central nervous system are crude at best and evolving slowly, edging forward in tandem with the limited pace of neuroscience and bioengineering. Although still in its clinical infancy, 3D modeling stands poised to influence essentially all aspects of neurosurgical practice and training, whether through additive manufacturing, immersive technologies, or other yet-to-be-developed tools at this exciting frontier in translational science.
References
- Bekelis K, Calnan D, Simmons N, MacKenzie TA, Kakoulides G: Effect of an Immersive Preoperative Virtual Reality Experience on Patient Reported Outcomes: A Randomized Controlled Trial. Ann Surg 265:1068–1073, 2017
- Carl B, Bopp M, Voellger B, Saß B, Nimsky C: Augmented Reality in Transsphenoidal Surgery. World Neurosurg 125:e873–e883, 2019
- Chan E, Hovenden M, Ramage E, Ling N, Pham JH, Rahim A, et al: Virtual Reality for Pediatric Needle Procedural Pain: Two Randomized Clinical Trials. J Pediatr 209:160–167.e4, 2019
- Chan S, Conti F, Salisbury K, Blevins NH: Virtual reality simulation in neurosurgery: technologies and evolution. Neurosurgery 72 Suppl 1:154–164, 2013
- Coelho G, Figueiredo EG, Rabelo NN, Teixeira MJ, Zanon N: Development and evaluation of a new pediatric mixed-reality model for neurosurgical training. J Neurosurg Pediatr:1–10, 2019
- Coelho G, Rabelo NN, Vieira E, Mendes K, Zagatto G, Santos de Oliveira R, et al: Augmented reality and physical hybrid model simulation for preoperative planning of metopic craniosynostosis surgery. Neurosurg Focus 48:E19, 2020
- Gibby JT, Swenson SA, Cvetko S, Rao R, Javan R: Head-mounted display augmented reality to guide pedicle screw placement utilizing computed tomography. Int J Comput Assist Radiol Surg 14:525–535, 2019
- Graffeo CS, Peris-Celda M, Perry A, Carlstrom LP, Driscoll CLW, Link MJ: Anatomical Step-by-Step Dissection of Complex Skull Base Approaches for Trainees: Surgical Anatomy of the Posterior Petrosal Approach. J Neurol Surg B Skull Base 80:338–351, 2019
- Graffeo CS, Peris-Celda M, Perry A, Carlstrom LP, Driscoll CLW, Link MJ: Anatomical Step-by-Step Dissection of Complex Skull Base Approaches for Trainees: Surgical Anatomy of the Retrosigmoid Approach. J Neurol Surg B Skull Base:2019 Available: https://www.thieme-connect.com/products/ejournals/html/10.1055/s-0039-1700513.
- Graffeo CS, Perry A, Carlstrom LP, Peris-Celda M, Alexander A, Dickens HJ, et al: 3D printing for complex cranial surgery education: Technical overview and preliminary validation study. J Neurol Surg B Skull Base:2021 Available: https://dx.doi.org/10.1055/s-0040-1722719.
- Hoogenes J, Wong N, Al-Harbi B, Kim KS, Vij S, Bolognone E, et al: A Randomized Comparison of 2 Robotic Virtual Reality Simulators and Evaluation of Trainees’ Skills Transfer to a Simulated Robotic Urethrovesical Anastomosis Task. Urology 111:110–115, 2018
- Hussain R, Lalande A, Berihu Girum K, Guigou C, Grayeli AB: Augmented reality for inner ear procedures: visualization of the cochlear central axis in microscopic videos. Int J Comput Assist Radiol Surg:2020 Available: https://dx.doi.org/10.1007/s11548-020-02240-w.
- Lan Q, Chen A, Zhang T, Li G, Zhu Q, Fan X, et al: Development of Three-Dimensional Printed Craniocerebral Models for Simulated Neurosurgery. World Neurosurg 91:434–442, 2016
- Liu J, Al’Aref SJ, Singh G, Caprio A, Moghadam AAA, Jang S-J, et al: An augmented reality system for image guidance of transcatheter procedures for structural heart disease. PLoS One 14:e0219174, 2019
- Moglia A, Ferrari V, Morelli L, Ferrari M, Mosca F, Cuschieri A: A Systematic Review of Virtual Reality Simulators for Robot-assisted Surgery. Eur Urol 69:1065–1080, 2016
- Mooney MA, Cavallo C, Zhou JJ, Bohl MA, Belykh E, Gandhi S, et al: Three-Dimensional Printed Models for Lateral Skull Base Surgical Training: Anatomy and Simulation of the Transtemporal Approaches. Oper Neurosurg (Hagerstown) 18:193–201, 2020
- Panda A: Effect of virtual reality distraction on pain perception during dental treatment in children. Children 5:1–4, 2017
- Pandrangi VC, Gaston B, Appelbaum NP, Albuquerque FC Jr, Levy MM, Larson RA: The Application of Virtual Reality in Patient Education. Ann Vasc Surg 59:184–189, 2019
- Pellegrino G, Mangano C, Mangano R, Ferri A, Taraschi V, Marchetti C: Augmented reality for dental implantology: a pilot clinical report of two cases. BMC Oral Health 19:158, 2019
- Sawaya R, Bugdadi A, Azarnoush H, Winkler-Schwartz A, Alotaibi FE, Bajunaid K, et al: Virtual Reality Tumor Resection: The Force Pyramid Approach. Oper Neurosurg (Hagerstown) 14:686–696, 2018
- Schlechter AK, Whitaker W, Iyer S, Gabriele G, Wilkinson M: Virtual reality distraction during pediatric intravenous line placement in the emergency department: A prospective randomized comparison study. Am J Emerg Med:2020 Available: https://dx.doi.org/10.1016/j.ajem.2020.04.009.
- Tang R, Ma L-F, Rong Z-X, Li M-D, Zeng J-P, Wang X-D, et al: Augmented reality technology for preoperative planning and intraoperative navigation during hepatobiliary surgery: A review of current methods. Hepatobiliary Pancreat Dis Int 17:101–112, 2018
- Tomlinson SB, Hendricks BK, Cohen-Gadol A: Immersive Three-Dimensional Modeling and Virtual Reality for Enhanced Visualization of Operative Neurosurgical Anatomy. World Neurosurg 131:313–320, 2019
- Vles MD, Terng NCO, Zijlstra K, Mureau MAM, Corten EML: Virtual and augmented reality for preoperative planning in plastic surgical procedures: A systematic review. J Plast Reconstr Aesthet Surg:2020 Available: https://dx.doi.org/10.1016/j.bjps.2020.05.081.
- Wake N, Rosenkrantz AB, Huang R, Park KU, Wysock JS, Taneja SS, et al: Patient-specific 3D printed and augmented reality kidney and prostate cancer models: impact on patient education. 3D Print Med 5:4, 2019