Low-Power Gesture Recognition Using Convolutional Neural Networks and Ambient Lighting

This paper presents a study focused on developing an efficient signal processing pipeline and identifying suitable machine learning models for real-time gesture recognition using a testbed consisting of an Arduino Nano 33 BLE and three OPT101 photodiodes. Our research aims to address the challenges of limited computational power whilst...

Touchless Hand Gesture-Based Digit Recognition: using Light-Sensors, Convolutional Neural Networks and a Microcontroller

Touchless interaction with computers has become more important in recent years, especially in the context of the COVID-19 pandemic.<br/>Applications include situations where touch input is not possible or not desirable, e.g. for hygienic purposes in a public setting or a medical setting.<br/>Practical examples for touchless interaction include...

Towards a low-cost air-written character recognition system: Designing an embedded machine learning system to recognise the first 10 letters of the Latin alphabet

This study introduces a novel system that leverages three photodiodes and ambient light to identify air-written characters on a resource-constrained device. Through experimentation, suitable methods of data preprocessing, machine learning and model compression were selected to recognize the first 10 characters of the Latin alphabet. The final...

Recognising Gestures Using Ambient Light and Convolutional Neural Networks: Adapting Convolutional Neural Networks for Gesture Recognition on Resource-constrained Microcontrollers

This paper presents how a convolutional neural network can be constructed in order to recognise gestures using photodiodes and ambient light. A number of candidates are presented and evaluated, with the most performant being adopted for in-depth analysis. This network is then compressed in order to be ran on an Arduino Nano 33 BLE...