Fusion of augmented reality imaging with the endoscopic view for endonasal skull base surgery

a novel application for surgical navigation based on intraoperative cone beam computed tomography and optical tracking

Review (2020)
Author(s)

Marco Lai (Eindhoven University of Technology, Philips Research)

Simon Skyrman (Karolinska University Hospital)

Caifeng Shan (Philips Research)

Drazenko Babic (Philips Healthcare Nederland, Philips Research)

Robert Homan (Philips Healthcare Nederland)

Erik Edström (Karolinska University Hospital)

Oscar Persson (Karolinska University Hospital)

Gustav Burström (Karolinska University Hospital)

Adrian Elmi-Terander (Karolinska University Hospital)

Benno H.W. Hendriks (Philips Research, TU Delft - Medical Instruments & Bio-Inspired Technology)

Peter H.N. de With (Eindhoven University of Technology)

Research Group
Medical Instruments & Bio-Inspired Technology
DOI related publication
https://doi.org/10.1371/journal.pone.0227312
More Info
expand_more
Publication Year
2020
Language
English
Research Group
Medical Instruments & Bio-Inspired Technology
Journal title
PLoS ONE
Issue number
1
Volume number
15
Article number
e0227312
Downloads counter
270
Collections
Institutional Repository
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

OBJECTIVE: Surgical navigation is a well-established tool in endoscopic skull base surgery. However, navigational and endoscopic views are usually displayed on separate monitors, forcing the surgeon to focus on one or the other. Aiming to provide real-time integration of endoscopic and diagnostic imaging information, we present a new navigation technique based on augmented reality with fusion of intraoperative cone beam computed tomography (CBCT) on the endoscopic view. The aim of this study was to evaluate the accuracy of the method. MATERIAL AND METHODS: An augmented reality surgical navigation system (ARSN) with 3D CBCT capability was used. The navigation system incorporates an optical tracking system (OTS) with four video cameras embedded in the flat detector of the motorized C-arm. Intra-operative CBCT images were fused with the view of the surgical field obtained by the endoscope's camera. Accuracy of CBCT image co-registration was tested using a custom-made grid with incorporated 3D spheres. RESULTS: Co-registration of the CBCT image on the endoscopic view was performed. Accuracy of the overlay, measured as mean target registration error (TRE), was 0.55 mm with a standard deviation of 0.24 mm and with a median value of 0.51mm and interquartile range of 0.39--0.68 mm. CONCLUSION: We present a novel augmented reality surgical navigation system, with fusion of intraoperative CBCT on the endoscopic view. The system shows sub-millimeter accuracy.