Utilising Deep Learning Models for the Surface Registration Problem in HoloNav

Bachelor Thesis (2022)
Author(s)

G.A. Cicimen (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Contributor(s)

Ricardo Marroquim – Mentor (TU Delft - Computer Graphics and Visualisation)

Abdullah Thabit – Mentor

A. Hanjalic – Graduation committee member (TU Delft - Intelligent Systems)

Faculty
Electrical Engineering, Mathematics and Computer Science
Copyright
© 2022 Alp Cicimen
More Info
expand_more
Publication Year
2022
Language
English
Copyright
© 2022 Alp Cicimen
Graduation Date
22-06-2022
Awarding Institution
Delft University of Technology
Project
['CSE3000 Research Project']
Programme
['Computer Science and Engineering']
Related content

The link to the github repository containing the utilised dataset, scripts, as well as the modified DL models RPMNet and PREDATOR.

https://github.com/alpcicimen/holonav-dl-registration
Faculty
Electrical Engineering, Mathematics and Computer Science
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Surface Registration is a registration problem that handles the registration of two similar surfaces. In most research that utilises Deep Learning (DL) models to handle surface registration two theories are investigated; the first being whether surfaces sampled from the same origin can be registered together, and the second theory being whether the models can register Point Clouds with low overlapping data for utilisation in Simultaneous Localisation and Mapping (SLAM) applications. However, the surface registration to be utilised in the HoloNav Augmented Reality (AR) navigation system will utilise Point Clouds sampled from different origins with a high overlap ratio. This research, therefore, aims to determine the viability of DL methods for surface registration in HoloNav data. To determine the viability, rotation and translation errors in the match were used, with the aforementioned metrics later being evaluated manually with the utilisation of a visualiser. The results indicate that the models can generalise on the navigator data for an initial Euler angle difference of 45 degrees, but due to the difference in sampling density on the utilised point clouds can not provide accurate matches. Therefore, the utilisation of DL models can be considered to be viable if the navigator data has a sampling density similar to the pre-operative model.

Files

License info not available