EyeIDEA: Paving the Way Towards an Augmented Eye-Tracking IDE

Master Thesis (2021)
Author(s)

A.C. Langerak (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Contributor(s)

Maurício Aniche – Mentor (TU Delft - Software Engineering)

Willem Paul Brinkman – Graduation committee member (TU Delft - Interactive Intelligence)

Faculty
Electrical Engineering, Mathematics and Computer Science
Copyright
© 2021 arjan Langerak
More Info
expand_more
Publication Year
2021
Language
English
Copyright
© 2021 arjan Langerak
Graduation Date
06-04-2021
Awarding Institution
Delft University of Technology
Programme
['Electrical Engineering | Embedded Systems']
Faculty
Electrical Engineering, Mathematics and Computer Science
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Since their invention, the keyboard and mouse are the most used input devices that software developers use to interact with source code. However, these devices have their IDE interaction issues as developers need to spend a significant amount of time learning how to use them efficiently and effectively. To tackle some of these issues, we used an eye-tracker to provide an alternative input method. With eye-tracking, it is possible to infer where developers are putting their attention to that can be utilized to improve the IDE user experience and productivity. Therefore, we present EyeIDEA, an experimental plugin for Intellij IDEA that integrates eye-tracking to provide source code navigation, debugging interactions, and fine-grained information about user habits based on eye-tracking. A user study was conducted with TU Delft students to investigate the perceived usefulness of our eye-tracking IDE. Based on their reactions, we found that the gaze-based interactions feel quick and natural. Moreover, there is a strong preference for eye-tracking interactions that only require a single code element or button as input. Additionally, users perceived that an eye-tracking IDE could substitute a
mouse, especially when suffering from health-related issues or when performing light programming work. However, eye-tracking also brings new challenges, including integrating eye-tracking with keyboard/mouse input and accounting for accuracy and precision issues that influence the overall usability. A short video demonstration of our tool is available at https://www.youtube.com/watch?v=ShvIX04rcr4.

Files

License info not available