Constructing A Dataset For Gesture Recognition Using Ambient Light

Bachelor thesis (2022)

Authors

O.T. Akadiri Electrical Engineering, Mathematics and Computer Science

Contributors

Q. Wang Embedded Systems - EEMCS (coach)
Q. Wang Embedded Systems - EEMCS (mentor)
C. Lofi Web Information Systems - EEMCS (mentor)
Faculty
Electrical Engineering, Mathematics and Computer Science, Electrical Engineering, Mathematics and Computer Science
Copyright: © 2022 Femi Akadiri
More Info
expand_more

Published Date

22-06-2022

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Abstract

Public technology has been shown to have a strong dependence on physical touch, which increases the transmission of diseases. Gesture recognition helps to reduce this transmission, as the dependence on physical touch is removed. Furthermore, the use of visible light for gesture recognition would reduce the power consumption of public technology, as less power would have to be supplied for a light source. In this paper, a dataset for gesture recognition using ambient light is presented, alongside the design process and challenges faced. The gestures were collected using three photodiodes in order for a machine learning algorithm to identify the patterns made by the shadows cast when the gestures are performed. The dataset consists of 10 gestures performed by a total of 50 people 5 times on each hand. This was collected under 5 different light intensity ranges. This dataset was then passed through a machine learning model to be trained and tested, resulting in a 86.8% (3.s.f) validation accuracy. There are many factors related to the light source that caused the accuracy of the algorithm not to be as high as expected, however, the highest accuracy was found in environments with light intensities of 100-1000 lux; a well-lit indoor room.