Understandable Test Generation Through Capture/Replay and LLMs

Automatic unit test generators, particularly search-based software testing (SBST) tools such as EvoSuite, efficiently generate unit test suites with acceptable coverage. Although this removes the burden of writing unit tests from developers, these generated tests often pose challenges in terms of comprehension for developers. In my doctoral...

Generating Understandable Unit Tests through End-to-End Test Scenario Carving

Automatic unit test generators such as EvoSuite are able to automatically generate unit test suites with high coverage. This removes the burden of writing unit tests from developers, but the generated tests are often difficult to understand for them. In this paper, we introduce the MicroTestCarver approach that generates unit tests starting from...

Basic Block Coverage for Unit Test Generation at the SBST 2022 Tool Competition

Basic Block Coverage (BBC) is a secondary objective for search-based unit test generation techniques relying on the approach level and branch distance to drive the search process. Unlike the approach level and branch distance, which considers only information related to the coverage of explicit branches coming from conditional and loop...

Commonality-Driven Unit Test Generation

Various search-based test generation techniques have been proposed to automate the generation of unit tests fulfilling different criteria (e.g., line coverage, branch coverage, mutation score, etc.). Despite several advances made over the years, search-based unit test generation still suffers from a lack of guidance due to the limited amount of...

Unit test generation for common and uncommon behaviors

Various search-based test generation techniques have been proposed to automate the process of test generation to fulfill different criteria (e.g., line coverage, branch coverage, mutation score, etc.). Despite these techniques' undeniable accomplishments, they still suffer from a lack of guidance coming from the data gathered from the production...

Java Unit Testing Tool Competition - Eighth Round

We report on the results of the eighth edition of the Java unit testing tool competition. This year, two tools, EvoSuite and Randoop, were executed on a benchmark with (i) new classes under test, selected from open-source software projects, and (ii) the set of classes from one project considered in the previous edition. We relied on an updated...

Generating Highly-structured Input Data by Combining Search-based Testing and Grammar-based Fuzzing

Software testing is an important and time-consuming task that is often done manually. In the last decades, researchers have come up with techniques to generate input data (e.g., fuzzing) and automate the process of generating test cases (e.g., search-based testing). However, these techniques are known to have their own limitations: search-based...

Java Unit Testing Tool Competition - Seventh Round

We report on the results of the seventh edition of the JUnit tool competition. This year, four tools were executed on a benchmark with (i) new classes, selected from real-world software projects, and (ii) challenging classes from the previous edition. We use Randoop and manual test suites from the projects as baselines. Given the interesting...

When, how, and why developers (do not) test in their IDEs

The research community in Software Engineering and Software Testing in particular builds many of its contributions on a set of mutually shared expectations. Despite the fact that they form the basis of many publications as well as open-source and commercial testing applications, these common expectations and beliefs are rarely ever questioned...

Effects of Refactoring on Productivity in Relation to Code Understandability

Depending on the context, the benefits of clean code with respect to understandability might be less plain in the short term than is often claimed. This work has studied a system with legacy code in an industrial environment to evaluate if giving ‘clean code’ to developers would immediately lead to increases in productivity. They were given...

Selecting Bug-prone Components to Study the Effectiveness of Reengineering and Unit Testing

Many software companies see their code grow into legacy code. Making changes to such code is risky, as existing functionality elsewhere can easily be broken. By reengineering the code and covering it with unit tests, the code can be brought back into a maintainable state. In this study we measure the effect of reengineering and unit testing code...

Extending Project Lombok to improve JUnit tests

In this thesis, we look at unit and integration test suites and look for ways to improve the quality of the tests. The first step in this research is the development of the JUnitCategorizer tool to distinguish between unit tests and integration tests. JUnitCategorizer determines the actual class under test using a new heuristic and ultimately...

Automatic Unit Test Generation

While test generators have the potential to significantly reduce the costs of software testing and have the ability to increase the quality of the software tests (and thus, the software itself), they unfortunately have only limited support for testing object-oriented software and their underlying test generation techniques fail to scale up to...