The Impact of Test Case Summaries on Bug Fixing Performance

An Empirical Investigation

Conference paper (2016)

Authors

Sebastiano Panichella University of Zürich
A. Panichella Software Engineering - EEMCS
M.M. Beller Software Engineering - EEMCS
A.E. Zaidman Software Engineering - EEMCS
Harald C. Gall University of Zürich
Research Group
Software Engineering (EEMCS) (TU Delft)
Copyright: © 2016 Sebastiano Panichella, A. Panichella, M.M. Beller, A.E. Zaidman, Harald C. Gall
DOI
help_outline
https://doi.org/10.1145/2884781.2884847
Software testing Empirical Study Test Case Summarization
More Info
expand_more

Published Date

14-05-2016

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Department

Software Technology

Research Group

Software Engineering

Abstract

Automated test generation tools have been widely investigated with the goal of reducing the cost of testing activities. However, generated tests have been shown not to help developers in detecting and finding more bugs even though they reach higher structural coverage compared to manual testing. The main reason is that generated tests are diff-cult to understand and maintain. Our paper proposes an approach, coined TestDescriber, which automatically generates test case summaries of the portion of code exercised by each individual test, thereby improving understandability. We argue that this approach can complement the current techniques around automated unit test generation or searchbased techniques designed to generate a possibly minimal set of test cases. In evaluating our approach we found that (1) developers find twice as many bugs, and (2) test case summaries significantly improve the comprehensibility of test cases, which is considered particularly useful by developers.

Files

PID4080971.pdf
(.pdf | 1.01 Mb)