Java Unit Testing Tool Competition - Seventh Round

Java Unit Testing Tool Competition - Seventh Round

Kifetew, Fitsum (Fondazione Bruno Kessler)
Devroey, Xavier (TU Delft Software Engineering)
Rueda, Urko (Universitat Politécnica de Valencia)

2019

We report on the results of the seventh edition of the JUnit tool competition. This year, four tools were executed on a benchmark with (i) new classes, selected from real-world software projects, and (ii) challenging classes from the previous edition. We use Randoop and manual test suites from the projects as baselines. Given the interesting findings of last year, we analyzed the effectiveness of the combined test suites generated by all competing tools and compared; results are confronted with the manual test suites of the projects, as well as those generated by the competing tools. This paper describes our methodology and the results, highlight challenges faced during the contest.

Java
automation
benchmark
combined performance
mutation testing
statistical analysis
tool competition
unit testing

http://resolver.tudelft.nl/uuid:e265e18a-6dd2-4f9d-8a01-3229cbc4066f

https://doi.org/10.1109/SBST.2019.00014

IEEE, Piscataway

978-1-7281-2234-2

2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing (SBST): Proceedings

SBST '19: 12th International Workshop on Search-Based Software Testing, 2019-05-27, Montreal, Canada

Institutional Repository

conference paper

© 2019 Fitsum Kifetew, Xavier Devroey, Urko Rueda