Recognising Gestures Using Ambient Light and Convolutional Neural Networks

Adapting Convolutional Neural Networks for Gesture Recognition on Resource-constrained Microcontrollers

Bachelor Thesis (2022)
Author(s)

W. Narchi (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Contributor(s)

Q. Wang – Mentor (TU Delft - Embedded Systems)

Mingkun Yang – Mentor (TU Delft - Embedded Systems)

R. Zhu – Mentor (TU Delft - Embedded Systems)

Christoph Lofi – Graduation committee member (TU Delft - Web Information Systems)

Faculty
Electrical Engineering, Mathematics and Computer Science
Copyright
© 2022 William Narchi
More Info
expand_more
Publication Year
2022
Language
English
Copyright
© 2022 William Narchi
Graduation Date
22-07-2022
Awarding Institution
Delft University of Technology
Project
['CSE3000 Research Project']
Programme
['Computer Science and Engineering']
Faculty
Electrical Engineering, Mathematics and Computer Science
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

This paper presents how a convolutional neural network can be constructed in order to recognise gestures using photodiodes and ambient light. A number of candidates are presented and evaluated, with the most performant being adopted for in-depth analysis. This network is then compressed in order to be ran on an Arduino Nano 33 BLE microcontroller to present its feasibility in embedded operation. The final utilised network was observed to have accuracies between 75.4% and 86.8% depending on the testing conditions. Further, all candidates were found to be sufficiently compact and low-latency for real-time operation.

Files

License info not available