document

Generating Class-Level Integration Tests Using Call Site Information

Derakhshanfar, P. (author), Devroey, Xavier (author), Panichella, A. (author), Zaidman, A.E. (author), van Deursen, A. (author)

Search-based approaches have been used in the literature to automate the process of creating unit test cases. However, related work has shown that generated tests with high code coverage could be ineffective, i.e., they may not detect all faults or kill all injected mutants. In this paper, we propose Cling, an integration-level test case...

journal article 2023

document

JUGE: An Infrastructure for Benchmarking Java Unit Test Generators

Devroey, Xavier (author), Gambi, Alessio (author), Galeotti, Juan Pablo (author), Just, René (author), Kifetew, Fitsum Meshesha (author), Panichella, Sebastiano (author), Panichella, A. (author)

Researchers and practitioners have designed and implemented various automated test case generators to support effective software testing. Such generators exist for various languages (e.g., Java, C#, or Python) and various platforms (e.g., desktop, web, or mobile applications). The generators exhibit varying effectiveness and efficiency,...

journal article 2022

document

Basic Block Coverage for Unit Test Generation at the SBST 2022 Tool Competition

Derakhshanfar, P. (author), Devroey, Xavier (author)

Basic Block Coverage (BBC) is a secondary objective for search-based unit test generation techniques relying on the approach level and branch distance to drive the search process. Unlike the approach level and branch distance, which considers only information related to the coverage of explicit branches coming from conditional and loop...

conference paper 2022

document

Basic block coverage for search-based unit testing and crash reproduction

Derakhshanfar, P. (author), Devroey, Xavier (author), Zaidman, A.E. (author)

Search-based techniques have been widely used for white-box test generation. Many of these approaches rely on the approach level and branch distance heuristics to guide the search process and generate test cases with high line and branch coverage. Despite the positive results achieved by these two heuristics, they only use the information...

journal article 2022

document

Summary of Search-based Crash Reproduction using Behavioral Model Seeding

Derakhshanfar, P. (author), Devroey, Xavier (author), Perrouin, Gilles (author), Zaidman, A.E. (author), van Deursen, A. (author)

This is an extended abstract of the article: Pouria Derakhshanfar, Xavier Devroey, Gilles Perrouin, Andy Zaidman and Arie van Deursen. 2019. Search-based crash reproduction using behavioural model seeding. In: Software Testing, Verification and Reliability (May 2020). http://doi.org/10.1002/stvr.1733.

conference paper 2021

document

Experience Report on Soft and Project Skills Building through Repetition

Devroey, Xavier (author), Amrani, Moussa (author), Vanderose, Benoît (author)

Acquiring soft and project skills during their studies is of paramount importance for computer science students to integrate large development teams after graduating. Project-oriented learning offers interesting opportunities for teachers to tutor students, and allows them to acquire and train those skills in addition to the core topics of the...

conference paper 2021

document

Crash reproduction difficulty, an initial assessment

Cherry, B.C.D. (author), Devroey, Xavier (author), Derakhshanfar, P. (author), Vanderose, Benoît (author)

This study presents the initial step towards a thorough analysis of the difficulty to reproduce a crash using searchbased crash reproduction. Traditionally, code size and complexity are considered representative indicators of the difficulty for search-based approaches, like search-based unit test generation, to generate tests. However, unlike...

journal article 2020

document

Extended abstract: Test them all, is it worth it? Assessing configuration sampling on the JHipster Web development stack

Halin, Axel (author), Nuttinck, Alexandre (author), Acher, Mathieu (author), Devroey, Xavier (author), Perrouin, Gilles (author), Baudry, Benoit (author)

This is an extended abstract of the article: Axel Halin, Alexandre Nuttinck, Mathieu Acher, Xavier Devroey, Gilles Perrouin, and Benoit Baudry. 2018. Test them all, is it worth it? Assessing config- uration sampling on the JHipster Web development stack. In Em- pirical Software Engineering (17 Jul 2018). https://doi.org/10.1007/ s10664-018-9635-4.

conference paper 2020

document

An Application of Model Seeding to Search-based Unit Test Generation for Gson

Olsthoorn, Mitchell (author), Derakhshanfar, P. (author), Devroey, Xavier (author)

Model seeding is a strategy for injecting additional information in a search-based test generation process in the form of models, representing usages of the classes of the software under test. These models are used during the search-process to generate logical sequences of calls whenever an instance of a specific class is required. Model seeding...

conference paper 2020

document

It is not Only About Control Dependent Nodes: Basic Block Coverage for Search-Based Crash Reproduction

Derakhshanfar, P. (author), Devroey, Xavier (author), Zaidman, A.E. (author)

Search-based techniques have been widely used for white-box test generation. Many of these approaches rely on the approach level and branch distance heuristics to guide the search process and generate test cases with high line and branch coverage. Despite the positive results achieved by these two heuristics, they only use the information...

conference paper 2020

document

Commonality-Driven Unit Test Generation

Evers, B. (author), Derakhshanfar, P. (author), Devroey, Xavier (author), Zaidman, A.E. (author)

Various search-based test generation techniques have been proposed to automate the generation of unit tests fulfilling different criteria (e.g., line coverage, branch coverage, mutation score, etc.). Despite several advances made over the years, search-based unit test generation still suffers from a lack of guidance due to the limited amount of...

conference paper 2020

document

Java Unit Testing Tool Competition - Eighth Round

Devroey, Xavier (author), Panichella, Sebastiano (author), Gambi, Alessio (author)

We report on the results of the eighth edition of the Java unit testing tool competition. This year, two tools, EvoSuite and Randoop, were executed on a benchmark with (i) new classes under test, selected from open-source software projects, and (ii) the set of classes from one project considered in the previous edition. We relied on an updated...

conference paper 2020

document

Crash Reproduction Using Helper Objectives

Derakhshanfar, P. (author), Devroey, Xavier (author), Zaidman, A.E. (author), van Deursen, A. (author), Panichella, A. (author)

Evolutionary-based crash reproduction techniques aid developers in their debugging practices by generating a test case that reproduces a crash given its stack trace. In these techniques, the search process is typically guided by a single search objective called Crash Distance. Previous studies have shown that current approaches could only...

conference paper 2020

document

Search-based crash reproduction using behavioural model seeding

Derakhshanfar, P. (author), Devroey, Xavier (author), Perrouin, Gilles (author), Zaidman, A.E. (author), van Deursen, A. (author)

Search-based crash reproduction approaches assist developers during debugging by generating a test case, which reproduces a crash given its stack trace. One of the fundamental steps of this approach is creating objects needed to trigger the crash. One way to overcome this limitation is seeding: using information about the application during the...

journal article 2020

document

A benchmark-based evaluation of search-based crash reproduction

Soltani, M. (author), Derakhshanfar, P. (author), Devroey, Xavier (author), van Deursen, A. (author)

Crash reproduction approaches help developers during debugging by generating a test case that reproduces a given crash. Several solutions have been proposed to automate this task. However, the proposed solutions have been evaluated on a limited number of projects, making comparison difficult. In this paper, we enhance this line of research by...

journal article 2020

document

MALTESQUE 2019 Workshop Summary

Arcelli Fontana, Francesca (author), Perrouin, Gilles (author), Ampatzoglou, Apostolos (author), Archer, Mathieu (author), Walter, Bartosz (author), Cordy, Maxime (author), Palomba, Fabio (author), Devroey, Xavier (author)

journal article 2020

document

Report from the 1st Int. Workshop on Education through Advanced Software Engineering and Artificial Intelligence (EASEAI ’19)

Vanderose, Benoît (author), Frenay, Benoît (author), Henry, Julie (author), Devroey, Xavier (author)

In the past years, everyday life has been profoundly transformed by the development and widespread of digital technologies. General, as well as specialized audiences, have to face an ever-increasing amount of knowledge and learn new abilities. This first edition of the EASEAI workshop tried to address that challenge by looking at software...

journal article 2020

document

Botsing, a Search-based Crash Reproduction Framework for Java

Derakhshanfar, P. (author), Devroey, Xavier (author), Panichella, A. (author), Zaidman, A.E. (author), van Deursen, A. (author)

Approaches for automatic crash reproduction aim to generate test cases that reproduce crashes starting from the crash stack traces. These tests help developers during their debugging practices. One of the most promising techniques in this research field leverages search-based software testing techniques for generating crash reproducing test...

conference paper 2020

document

Pandemic programming: How COVID-19 affects software developers and how their organizations can help

Ralph, Paul (author), Baltes, Sebastian (author), Adisaputri, Gianisa (author), Torkar, Richard (author), Kovalenko, V.V. (author), Kalinowski, Marcos (author), Novielli, Nicole (author), Yoo, Shin (author), Devroey, Xavier (author), Tan, Xin (author), Zhou, Minghui (author), Turhan, Burak (author), Hoda, Rashina (author), Hata, Hideaki (author), Robles, Gregorio (author), Milani Fard, Amin (author), Alkadhi, Rana (author)

Context: As a novel coronavirus swept the world in early 2020, thousands of software developers began working from home. Many did so on short notice, under difficult and stressful conditions.<br/><br/>Objective: This study investigates the effects of the pandemic on developers’ wellbeing and productivity.<br/><br/>Method: A questionnaire survey...

journal article 2020

document

Good Things Come In Threes: Improving Search-based Crash Reproduction With Helper Objectives

Derakhshanfar, P. (author), Devroey, Xavier (author), Zaidman, A.E. (author), van Deursen, A. (author), Panichella, A. (author)

Writing a test case reproducing a reported software crash is a common practice to identify the root cause of an anomaly in the software under test. However, this task is usually labor-intensive and time-taking. Hence, evolutionary intelligence approaches have been successfully applied to assist developers during debugging by generating a test...

conference paper 2020