The contribution of grayscale cameras to the accuracy of surgical augmented reality goggles

The contribution of grayscale cameras to the accuracy of surgical augmented reality goggles

Franschman, Lesley (TU Delft Electrical Engineering, Mathematics and Computer Science; TU Delft Comp Graphics & Visualisation)

Ambrosini, P. (mentor)
Marroquim, Ricardo (mentor)
Hanjalic, A. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2022-06-22

The way that surgeons currently use surgical navigation technology impacts their hand-eye coordination and their ability to view images and data critically. To tackle this issue Augmented Reality goggles, built from the HoloLens 2, have been developed specifically for the purpose of aiding surgeons during surgery and it is called: The HoloNav. Optical reflective spheres are commonly used to track surgical instruments. This research aims to find out if grayscale cameras could contribute to locating these spheres more accurately with the HoloNav. This is done by finding the spheres on the infrared images, reducing the search space on the grayscale images and finding the spheres on the reduced search spaces of the grayscale images. By triangulating those retrieved coordinates and comparing them with the optically tracked coordinates a conclusion can be drawn about the accuracy. The accuracy measured in this research is between 0.66 mm and 10.64 mm (mostly between 1.8 mm and 6.4 mm) depending on the frame. This is quite accurate and similar to the results from related work. With better image quality or different input conditions the accuracy could be improved even more.

Augmenetd Reality
Accuracy
Grayscale Images
Image Processing
Optical Spheres
locating

http://resolver.tudelft.nl/uuid:f867d6b7-3ad9-4525-ab2c-c15eceb05585

Student theses

bachelor thesis

© 2022 Lesley Franschman