Constructing A Dataset For Gesture Recognition Using Ambient Light

Constructing A Dataset For Gesture Recognition Using Ambient Light

Akadiri, Femi (TU Delft Electrical Engineering, Mathematics and Computer Science)

Wang, Q. (graduation committee)
Wang, Q. (mentor)
Lofi, C. (mentor)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2022-06-22

Public technology has been shown to have a strong dependence on physical touch, which increases the transmission of diseases. Gesture recognition helps to reduce this transmission, as the dependence on physical touch is removed. Furthermore, the use of visible light for gesture recognition would reduce the power consumption of public technology, as less power would have to be supplied for a light source. In this paper, a dataset for gesture recognition using ambient light is presented, alongside the design process and challenges faced. The gestures were collected using three photodiodes in order for a machine learning algorithm to identify the patterns made by the shadows cast when the gestures are performed. The dataset consists of 10 gestures performed by a total of 50 people 5 times on each hand. This was collected under 5 different light intensity ranges. This dataset was then passed through a machine learning model to be trained and tested, resulting in a 86.8% (3.s.f) validation accuracy. There are many factors related to the light source that caused the accuracy of the algorithm not to be as high as expected, however, the highest accuracy was found in environments with light intensities of 100-1000 lux; a well-lit indoor room.

Gesture recognition
Dataset
Ambient light
Photodiode
Arduino Nano 33 BLE

http://resolver.tudelft.nl/uuid:fbe34222-63d8-4d1d-a750-0ce6e0a9c132

Student theses

bachelor thesis

© 2022 Femi Akadiri