Embedded AI Enabled Air-Writing for a Post-COVID World

Extended Abstract

Conference paper (2022)

Authors

K.S. Goedemondt Student
J. Yang Web Information Systems - EEMCS
Q. Wang Embedded Systems - EEMCS
Research Group
Signal Processing Systems (EEMCS) (TU Delft)
Copyright: © 2022 K.S. Goedemondt, J. Yang, Q. Wang
More Info
expand_more

Published Date

2022

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Department

Microelectronics

Research Group

Signal Processing Systems

Abstract

Touchscreens and buttons had became a medium for virus transmission during the COVID-19 pandemic. We have seen in our daily life that people use tissues and keys to press buttons inside elevators, on public screens, etc. In the post- COVID world, touch-free interaction with public touchscreens and buttons may become more popular. Motivated by the rise of visible light communication and sensing, we design a real-time embedded system to enable touch-free fingertip writing of the digits 0–9 with only ambient light and simple photodiodes. We propose an embedded deep learning model to learn the spatial and temporal patterns in the dynamic shadow for air-writing digits recognition. The model is devised with a lightweight convolutional architecture such that it can run on a resource-limited device. We evaluate our model using the LightDigit dataset [1] and report the results in terms of accuracy and inference time.

Files

67_68_pag.pdf
(.pdf | 4.21 Mb)