Integration of 3D tracking systems for Interaction in Spatial Augmented Reality

Integration of 3D tracking systems for Interaction in Spatial Augmented Reality

Tziouvara, I.

Eisemann, E. (mentor)
Verlinden, J. (mentor)
De Haan, G. (mentor)

Electrical Engineering, Mathematics and Computer Science

Intelligent Systems

Computer Science: Media and Knowledge Engineering

2012-12-14

In this thesis, a projector-based Spatial Augmented Reality (SAR) system designed and developed to be applied to support physical and virtual 3D Rapid Prototyping in the field of Industrial Design Engineering is presented. The main contribution is a 3D scanner to get a virtual model of a physical model and tools to support the design of features interactively, on the object’s surface. More specifically, this work contains an approach to set the hardware to support SAR, else known as hardware calibration for SAR. Each hardware entity is calibrated with respect to a common “world”, in order to achieve effective communication. This world is set to coincide with the graphics world, and this allows us to imagine being inside the 3D graphics world while the virtual content is rendered onto the scene’s objects. In order to identify the basic ingredients that enable interaction in our SAR system, we take into account the limitations of Rapid Prototyping process, background knowledge for SAR systems and related work. Therefore, we designed the interaction components of the system according to characteristics of our setting. The SAR system was designed to perform in the peripersonal region. In this region, the user inserts input via a constructed IR tracked pen and a dynamic menu is used as interface to the system. Functionality such as selection, feedback and annotation is enabled for interacting with the SAR system. The system’s application is divided into two parts. The first part includes the use of the RGB-D camera and the IR tracker for the construction of a 3D scanner, in order to produce a virtual model of an object through sampling, segmentation, and registration of sequential point clouds. In the second part, the result of the scanning process, which is a polygonal mesh of the scanned object, is added to the SAR system’s application that enables interaction with virtual models and the ground level of the world. These two parts of the SAR system application aim to support industrial designers in the scanning of a freshly made physical prototype, and enable the design of features on the corresponding virtual model by using the SAR system during the rapid prototyping process. In order to identify the strong points and weaknesses of the current state of the SAR system application, we carried out a user evaluation. 21 students from the Faculty of Industrial Design Engineering evaluated the two parts of the system’s application. The results show that the SAR system is useful and that it has great potential in the field of Industrial Design Engineering. Nevertheless, there is still room for improvement and future work, in order to be fully applied in the field.

Spatial Augmented Reality
projector-based
SAR
Interaction
3D tracking
Computer Graphics
Computer Vision

http://resolver.tudelft.nl/uuid:acc16325-1c25-445d-ac3c-02c3e89170d4

Student theses

master thesis

(c) 2012 Tziouvara, I.