Test Code Quality and Its Relation to Issue Handling Performance

Test Code Quality and Its Relation to Issue Handling Performance

Athanasiou, Dimitrios (Software Improvement Group)
Nugroho, Ariadi (Software Improvement Group)
Visser, Joost (Software Improvement Group)
Zaidman, A.E. (TU Delft Software Engineering)

2014

Automated testing is a basic principle of agile development. Its benefits include early defect detection, defect causelocalization and removal of fear to apply changes to the code. Therefore, maintaining high quality test code is essential. This study introduces a model that assesses test code quality by combining source code metrics that reflect three main aspects of test codequality: completeness, effectiveness and maintainability. The model is inspired by the Software Quality Model of the SoftwareImprovement Group which aggregates source code metrics into quality ratings based on benchmarking. To validate the model we assess the relation between test code quality, as measured by the model, and issue handling performance. An experiment isconducted in which the test code quality model is applied to 18 open source systems. The test quality ratings are tested for correlation with issue handling indicators, which are obtained by mining issue repositories. In particular, we study the (1) defect resolution speed, (2) throughput and (3) productivity issue handling metrics. The results reveal a significant positive correlation between test code quality and two out of the three issue handling metrics (throughput and productivity), indicating that good test code quality positively influences issue handling performance.

Testing
metrics
measurement
defects
bugs

http://resolver.tudelft.nl/uuid:cff455fe-0d49-4a07-96de-351bd240cb4e

https://doi.org/10.1109/TSE.2014.2342227

0098-5589

IEEE Transactions on Software Engineering, 40 (11), 1100-1125

Institutional Repository

journal article

© 2014 Dimitrios Athanasiou, Ariadi Nugroho, Joost Visser, A.E. Zaidman