ScreenSense: Utilizing Communication Signals for Dynamic Finger Tracking for On-Screen Antennas
S.P. Gupta (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Qing Wang – Mentor (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Shun Zhuge – Mentor (TU Delft - Electrical Engineering, Mathematics and Computer Science)
M.A. Neerincx – Graduation committee member (TU Delft - Electrical Engineering, Mathematics and Computer Science)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Future 6G smartphones are proposed to embed transparent on-screen antenna arrays that use communication signals for passive finger tracking. Our research proposes two novel localisation methods that exploit the finger's electromagnetic backscattering response. Using model-generated time-series data, we simulate the spatiotemporal backscattering of a finger hovering above a transparent planar array at sub-terahertz frequencies. We compare a classical matched filter and subspace methods against our proposed approaches: a CNN-adapted matched filter (MF-CNN) and a multi-tone CNN position regressor (MT-CNN), alongside a near-field subspace baseline. The learned methods achieve sub-millimeter accuracy and remain robust\newline across variations in signal-to-noise ratio, array size, dielectric properties, and hover height, with MT-CNN offering the best trade-off between accuracy and latency.