Digit recognition with visible light using three photodiodes and 3D-preprocessed data

Bachelor Thesis (2023)
Author(s)

G. van de Linde (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Contributor(s)

Q. Wang – Mentor (TU Delft - Embedded Systems)

R. Zhu – Mentor (TU Delft - Embedded Systems)

M. Yang – Mentor (TU Delft - Embedded Systems)

R. Venkatesha Venkatesha Prasad – Graduation committee member (TU Delft - Networked Systems)

Faculty
Electrical Engineering, Mathematics and Computer Science, Electrical Engineering, Mathematics and Computer Science
Copyright
© 2023 Gijs van de Linde
More Info
expand_more
Publication Year
2023
Language
English
Copyright
© 2023 Gijs van de Linde
Graduation Date
03-07-2023
Awarding Institution
Delft University of Technology
Project
CSE3000 Research Project
Programme
Computer Science and Engineering
Faculty
Electrical Engineering, Mathematics and Computer Science, Electrical Engineering, Mathematics and Computer Science
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

This paper describes the feasibility of digit detection using three photodiodes and an Arduino Nano 33 BLE. This is done using a controlled lighting condition, using a bright lamp. It dives into the process of data collection, preprocessing and model selection for a recurrent neural network to do the classification of gestures into digits. Using a ”ConvLSTM double conv. layer model” with 128 units we were able to achieve an average accuracy of 0.500 ± 0.091 on a 5-Fold cross-validation procedure based on data that was collected in a controlled lighting environment. While this provides a foundation for digit detection using time-series data in a controlled light environment, further suggestions are made for future improvements and expansions in this area.

Files

License info not available