Developer-Friendly Test Cases: Generating Understandable Test Names Based on Coverage Improvement

Bachelor thesis (2021)

Authors

N. Nijkamp Electrical Engineering, Mathematics and Computer Science

Contributors

C.E. Brandt Software Engineering - EEMCS (supervisor 1)
A.E. Zaidman Software Engineering - EEMCS (supervisor 1)
Faculty
Electrical Engineering, Mathematics and Computer Science
Copyright: © 2021 Nienke Nijkamp
More Info
expand_more

Published Date

30-06-2021

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Abstract

TestCube amplifies existing unit tests and creates a new test suite with additional coverage for the source code. The names automatically generated by TestCube do not give any information on the behaviour or the coverage improvement of the amplified test case. In this paper, we present an approach to naming these amplified test cases by representing methods where the coverage is improved. These tests represent the covered methods on source code level and give the developer increased readability and understanding of the amplified test cases. We conducted a research study amongst 16 participants with a background in Computer Science. Participants were asked to indicate their agreement with the original test names, the test names generated by the approach and test names written by experts. The study found that participants strongly disagreed with the original TestCube names, and the names generated by our approach posed a real improvement to their satisfaction with the test names. With a few improvements, the test names generated by the approach will perform as acceptable as the manually written names.