Evaluation of Marker Tracking Using Mono and Stereo Vision in Microsoft HoloLens for Surgical Navigation

Evaluation of Marker Tracking Using Mono and Stereo Vision in Microsoft HoloLens for Surgical Navigation

Thabit, Abdullah (Erasmus MC)
Niessen, W.J. (TU Delft ImPhys/Computational Imaging; TU Delft ImPhys/Medical Imaging; Erasmus MC)
Wolvius, Eppo B. (Erasmus MC)
van Walsum, T. (Erasmus MC)

Linte, Cristian A. (editor)
Siewerdsen, Jeffrey H. (editor)

2022

Optical-based navigation systems are widely used in surgical interventions. However, despite their great utility and accuracy, they are expensive and require time and effort to setup for surgeries. Moreover, traditional navigation systems use 2D screens to display instrument positions causing the surgeons to look away from the operative field. Head mounted displays such as the Microsoft HoloLens may provide an attractive alternative for surgical navigation that also permits augmented reality visualization. The HoloLens is equipped with multiple sensors for tracking and scene understanding. Mono and stereo-vision in the HoloLens have been both reported to be used for marker tracking, but no extensive evaluation on accuracy has been done to compare the two approaches. The objective of our work is to investigate the tracking performance of various camera setups in the HoloLens, and to study the effect of the marker size, marker distance from camera, and camera resolution on marker locating accuracy. We also investigate the speed and stability of marker pose for each camera setup. The tracking approaches are evaluated using ArUco markers. Our results show that mono-vision is more accurate in marker locating than stereo-vision when high resolution is used. However, this comes at the expense of higher frame processing time. Alternatively, we propose a combined low-resolution mono-stereo tracking setup that outperforms each tracking approach individually and is comparable to high resolution mono tracking, with a mean translational error of 1.8 ± 0.6mm for 10cm marker size at 50cm distance. We further discuss our findings and their implications for navigation in surgical interventions.

ArUco
marker tracking
Microsoft HoloLens
Surgical navigation

http://resolver.tudelft.nl/uuid:333d7fee-43e0-4a89-a3e5-15a1a8762423

https://doi.org/10.1117/12.2607262

SPIE

9781510649439

Medical Imaging 2022: Image-Guided Procedures, Robotic Interventions, and Modeling

Medical Imaging 2022: Image-Guided Procedures, Robotic Interventions, and Modeling, 2022-03-21 → 2022-03-27, Virtual, Online

Progress in Biomedical Optics and Imaging - Proceedings of SPIE, 1605-7422, 12034

Institutional Repository

conference paper

© 2022 Abdullah Thabit, W.J. Niessen, Eppo B. Wolvius, T. van Walsum