Designing a Software Receiver for Gesture Recognition with Ambient Light
D.A. Barantiev (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Q. Wang – Mentor (TU Delft - Embedded Systems)
R. Zhu – Mentor (TU Delft - Embedded Systems)
Mingkun Yang – Mentor (TU Delft - Embedded Systems)
Christoph Lofi – Graduation committee member (TU Delft - Web Information Systems)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
There is a growing need for touch-free interaction with public utilities such as coffeemakers and vending machines that will help prevent the spread of diseases such as COVID-19. One solution is the integration of embedded gesture recognition systems relying on ambient light. However, existing work so far is found to be inefficient in terms of size, cost and recognisable gestures. This research is part of the development of a smaller and more economical machine learning-powered gesture recognition system using only 3 photodiodes and an Arduino microcontroller. The goal is to design the software for sensor reading, gesture detection and data preprocessing. The resulting receiver samples at 100 Hz, uses an adaptable threshold for identifying gesture endpoints and a mix of FFT,
maximum division and Linear Interpolation for signal processing. It is evaluated in two lighting conditions on two distinct gestures and is found to provide a
good trade-off between simplicity, real-time processing within milliseconds and robustness against environmental changes. This is achieved with a small RAM memory footprint of only 2 KB and independence of classification backend. The existing design
can be further improved in the future through software optimisation and extended environment dynamics support.