Investigating the performance of SPEA-II on automatic test case generation

Investigating the performance of SPEA-II on automatic test case generation

Li, Erwin (TU Delft Electrical Engineering, Mathematics and Computer Science)

Panichella, A. (mentor)
Olsthoorn, Mitchell (mentor)
Stallenberg, D.M. (mentor)
Verwer, S.E. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2023-06-28

Software testing is an important but time-consuming task, making automatic test case generation an appealing solution. The current state-of-the-art algorithm for test case generation is DynaMOSA, which is an improvement of NSGA-II that applies domain knowledge to make it more suitable for test case generation. Although these enhancements are applicable to other evolutionary algorithms,
no research has been done on how effective other algorithms can function as the base. In this paper, we apply the DynaMOSA modifications to SPEA-II to create a new algorithm, DynaSPEA-II. We conduct an empirical experiment where we evaluate the DynaMOSA enhancements, and directly compare DynaSPEA-II to
DynaMOSA. The algorithms are assessed on a benchmark consisting of 36 diverse JavaScript classes w.r.t. branch coverage. Our results show that adding DynaMOSA enhancements to SPEA-II results in higher coverage in 13.9% of classes, with an average increase of 4.92% for classes where a statistically significant difference was found. DynaSPEA-II performed equally to DynaMOSA, with no statistically significant difference being found between the two.

Search-Based Software Testing
Many Objective Optimisation
automatic testing

http://resolver.tudelft.nl/uuid:f1c1087b-3661-46b6-912a-98ebb8ae2550

Student theses

bachelor thesis

© 2023 Erwin Li