Exploring DDU in Practice

Master thesis (2018)

Authors

A.W.Z. Ang Electrical Engineering, Mathematics and Computer Science

Contributors

A. van Deursen (mentor)
R.F. Lima Maranhao De Abreu (graduation committee member)
A.E. Zaidman (graduation committee member)
C. Witteveen (graduation committee member)
Faculty
Electrical Engineering, Mathematics and Computer Science, Electrical Engineering, Mathematics and Computer Science
Copyright: © 2018 Aaron Ang
More Info
expand_more

Published Date

17-04-2018

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Abstract

The quality of test suites is commonly measured using adequacy metrics that focus on error detection, like test coverage. However, the diagnostic performance of spectrum-based fault localization techniques, that can potentially reduce the time spent on debugging, rely on diagnosability of test suites --- the property of faults to be easily and precisely located. Therefore, in prior work, Perez et al. proposed a new metric, called DDU, that measures the diagnosability of test suites. However, DDU is not yet usable in practice due to its output value between 0 and 1. A developer would not know what test to write next given a certain DDU value. In this study, we explore the performance of DDU in practice by analyzing open source projects. We find no evidence that DDU is correlated to diagnosability and, thus, DDU is currently only useful when combined with test generation techniques.