Java Unit Testing Tool Competition - Eighth Round

Java Unit Testing Tool Competition - Eighth Round

Devroey, Xavier (TU Delft Software Engineering)
Panichella, Sebastiano (Zurich University of Applied Science (ZHAW))
Gambi, Alessio (University of Passau)

2020

We report on the results of the eighth edition of the Java unit testing tool competition. This year, two tools, EvoSuite and Randoop, were executed on a benchmark with (i) new classes under test, selected from open-source software projects, and (ii) the set of classes from one project considered in the previous edition. We relied on an updated infrastructure for the execution of the different tools and the subsequent coverage and mutation analysis based on Docker containers. We considered two different time budgets for test case generation: one an three minutes. This paper describes our method- ology and statistical analysis of the results, presents the results achieved by the contestant tools and highlights the challenges we faced during the competition.

tool competition
benchmark
software testing
test case generation
unit testing
Java
JUnit

http://resolver.tudelft.nl/uuid:2057bad9-650a-4f2c-ac57-1093574fa83e

https://doi.org/10.1145/3387940.3392265

ACM DL

9781450379632

Proceedings - 2020 IEEE/ACM 42nd International Conference on Software Engineering Workshops, ICSEW 2020

42nd International Conference on Software Engineering, 2020-06-27 → 2020-07-19, Seoul, Korea, Republic of

Virtual/online event due to COVID-19

Institutional Repository

conference paper

© 2020 Xavier Devroey, Sebastiano Panichella, Alessio Gambi