Fusion of augmented reality imaging with the endoscopic view for endonasal skull base surgery

Fusion of augmented reality imaging with the endoscopic view for endonasal skull base surgery: a novel application for surgical navigation based on intraoperative cone beam computed tomography and optical tracking

Lai, Marco (Philips Research; Eindhoven University of Technology)
Skyrman, Simon (Karolinska University Hospital)
Shan, Caifeng (Philips Research)
Babic, Drazenko (Philips Research; Philips Healthcare Nederland)
Homan, Robert (Philips Healthcare Nederland)
Edström, Erik (Karolinska University Hospital)
Persson, Oscar (Karolinska University Hospital)
Burström, Gustav (Karolinska University Hospital)
Elmi-Terander, Adrian (Karolinska University Hospital)
Hendriks, B.H.W. (TU Delft Medical Instruments & Bio-Inspired Technology; Philips Research)
de With, Peter H.N. (Eindhoven University of Technology)

2020

OBJECTIVE: Surgical navigation is a well-established tool in endoscopic skull base surgery. However, navigational and endoscopic views are usually displayed on separate monitors, forcing the surgeon to focus on one or the other. Aiming to provide real-time integration of endoscopic and diagnostic imaging information, we present a new navigation technique based on augmented reality with fusion of intraoperative cone beam computed tomography (CBCT) on the endoscopic view. The aim of this study was to evaluate the accuracy of the method. MATERIAL AND METHODS: An augmented reality surgical navigation system (ARSN) with 3D CBCT capability was used. The navigation system incorporates an optical tracking system (OTS) with four video cameras embedded in the flat detector of the motorized C-arm. Intra-operative CBCT images were fused with the view of the surgical field obtained by the endoscope's camera. Accuracy of CBCT image co-registration was tested using a custom-made grid with incorporated 3D spheres. RESULTS: Co-registration of the CBCT image on the endoscopic view was performed. Accuracy of the overlay, measured as mean target registration error (TRE), was 0.55 mm with a standard deviation of 0.24 mm and with a median value of 0.51mm and interquartile range of 0.39--0.68 mm. CONCLUSION: We present a novel augmented reality surgical navigation system, with fusion of intraoperative CBCT on the endoscopic view. The system shows sub-millimeter accuracy.

http://resolver.tudelft.nl/uuid:f06051b8-7a1a-450b-b29b-25ca7dfaddef

https://doi.org/10.1371/journal.pone.0227312

1932-6203

PLoS ONE, 15 (1)

Correction: https://doi.org/10.1371/journal.pone.0229454

Institutional Repository

review

© 2020 Marco Lai, Simon Skyrman, Caifeng Shan, Drazenko Babic, Robert Homan, Erik Edström, Oscar Persson, Gustav Burström, Adrian Elmi-Terander, B.H.W. Hendriks, Peter H.N. de With