Designing an adaptable and low-cost system for gesture recognition using visible light

Bachelor Thesis (2022)
Author(s)

S. van de Water (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Contributor(s)

Q. Wang – Mentor (TU Delft - Electrical Engineering, Mathematics and Computer Science)

C. Lofi – Graduation committee member (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Faculty
Electrical Engineering, Mathematics and Computer Science
More Info
expand_more
Publication Year
2022
Language
English
Graduation Date
22-06-2022
Awarding Institution
Delft University of Technology
Project
CSE3000 Research Project, Gesture Recognition Empowered by Ambient Light and Embedded AIx
Programme
Computer Science and Engineering
Faculty
Electrical Engineering, Mathematics and Computer Science
Downloads counter
149
Collections
thesis
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

This paper describes the design of an adaptable, low-cost, and energy efficient gesture detection system. The system leverages the ambient light available in the environment to perform Visible Light Sensing (VLS) using powerful Convolutional Neural Networks. The focus lies on designing a system that is capable of robust gesture detection in any environment while only utilizing a limited number (3) of photodiode sensors. The research conducted in this paper contributes to two crucial aspects of VLS gesture recognition systems. First, it shows how the photodiode sensors can be automatically fine-tuned using four resistors to achieve excellent sensing performance in a wide range of lighting environments from 50 Lux up to 150k Lux. Secondly it is shown that a photodiode arrangement consisting of an equilateral triangle with sides of 5cm facilitates the highest performance and robustness using Dynamic Time Warping for general and user-friendly gestures.

Files

License info not available