Understanding Challenges and Opportunities of Technology-Supported Sign Language Learning

Conference paper (2022)

Authors

Sarah Faltaous Universität Duisburg-Essen
Torben Winkler Universität Duisburg-Essen
C. Schneegass Ludwig Maximilians University
Uwe Gruenefeld Universität Duisburg-Essen
Stefan Schneegass Universität Duisburg-Essen
Affiliation
External organisation
Audio Visual Electrical muscle stimulation Sign language learning
More Info
expand_more

Published Date

2022

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Affiliation

External organisation

Abstract

Around 466 million people in the world live with hearing loss, with many benefiting from sign language as a mean of communication. Through advancements in technology-supported learning, autodidactic acquisition of sign languages, e.g., American Sign Language (ASL), has become possible. However, little is known about the best practices for teaching signs using technology. This work investigates the use of different conditions for teaching ASL signs: audio, visual, electrical muscle stimulation (EMS), and visual combined with EMS. In a user study, we compare participants' accuracy in executing signs, recall ability after a two-week break, and user experience. Our results show that the conditions involving EMS resulted in the best overall user experience. Moreover, ten ASL experts rated the signs performed with visual and EMS combined highest. We conclude our work with the potentials and drawbacks of each condition and present implications that will benefit the design of future learning systems.