Java unit testing tool competition

Sixth round

Conference paper (2018)

Authors

Urko Rueda Molina Universitat Politécnica de Valencia
Fitsum Meshesha Kifetew Fondazione Bruno Kessler
A. Panichella Software Engineering - EEMCS , University of Luxembourg
Research Group
Software Engineering (EEMCS) (TU Delft)
Java Automation Benchmark Statistical analysis Unit testing Mutation testing Combined performance Tool competition
More Info
expand_more

Published Date

2018

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Department

Software Technology

Research Group

Software Engineering

Abstract

We report on the advances in this sixth edition of the JUnit tool competitions. This year the contest introduces new benchmarks to assess the performance of JUnit testing tools on different types of real-world software projects. Following on the statistical analyses from the past contest work, we have extended it with the combined tools performance aiming to beat the human made tests. Overall, the 6th competition evaluates four automated JUnit testing tools taking as baseline human written test cases for the selected benchmark projects. The paper details the modifications performed to the methodology and provides full results of the competition.

Files

Java_Unit.pdf
(.pdf | 1.71 Mb)