Test Code Comprehension: Insights from an Eye Tracker

Master thesis (2020)

Authors

Sharanya Sharanya Suresha Konandur Electrical Engineering, Mathematics and Computer Science

Contributors

Maurício Aniche Software Engineering - EEMCS (supervisor 1)
E. Larios Vargas Computer Science & Engineering-Teaching Team - EEMCS (supervisor 1)
A.E. Zaidman Software Engineering - EEMCS (supervisor 2)
O.E. Scharenborg (supervisor 2)
Faculty
Electrical Engineering, Mathematics and Computer Science
Copyright: © 2020 Sharanya Sharanya Suresha Konandur
More Info
expand_more

Published Date

09-11-2020

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Abstract

Software maintenance is an essential and time-consuming task during the software development cycle. Readability of test code is a crucial element for performing programming tasks, such as testing, bug fixing and maintaining code. Hence poorly written tests are difficult to maintain and lose their value to developers. In order to overcome this problem, we need to understand how programmers read the test code. Therefore we conducted an empirical study to analyze the various reading patterns in novices and professionals using a sophisticated eye tracking device. Our results show that (i) all programmers first comprehended the production code and then switched between test and production codes, (ii) novices had higher fixations reading test code and assert statements, (iii) professionals revisited the test code more than novices, (iv) professionals had significantly lesser test code coverage than novices, and (v) there is a significant difference in reading test code between novice and professionals.