The contribution of grayscale cameras to the accuracy of surgical augmented reality goggles
L. Franschman (TU Delft - Electrical Engineering, Mathematics and Computer Science)
P. Ambrosini – Mentor (TU Delft - Computer Graphics and Visualisation)
Ricardo Guerra Marroquim – Mentor (TU Delft - Computer Graphics and Visualisation)
Alan Hanjalic – Graduation committee member (TU Delft - Intelligent Systems)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
The way that surgeons currently use surgical navigation technology impacts their hand-eye coordination and their ability to view images and data critically. To tackle this issue Augmented Reality goggles, built from the HoloLens 2, have been developed specifically for the purpose of aiding surgeons during surgery and it is called: The HoloNav. Optical reflective spheres are commonly used to track surgical instruments. This research aims to find out if grayscale cameras could contribute to locating these spheres more accurately with the HoloNav. This is done by finding the spheres on the infrared images, reducing the search space on the grayscale images and finding the spheres on the reduced search spaces of the grayscale images. By triangulating those retrieved coordinates and comparing them with the optically tracked coordinates a conclusion can be drawn about the accuracy. The accuracy measured in this research is between 0.66 mm and 10.64 mm (mostly between 1.8 mm and 6.4 mm) depending on the frame. This is quite accurate and similar to the results from related work. With better image quality or different input conditions the accuracy could be improved even more.