- document
-
Soltani, M. (author), Derakhshanfar, P. (author), Devroey, Xavier (author), van Deursen, A. (author)Crash reproduction approaches help developers during debugging by generating a test case that reproduces a given crash. Several solutions have been proposed to automate this task. However, the proposed solutions have been evaluated on a limited number of projects, making comparison difficult. In this paper, we enhance this line of research by...journal article 2020
- document
-
Spadini, D. (author), Schvarcbacher, Martin (author), Oprescu, Ana (author), Bruntink, Magiel (author), Bacchelli, A. (author)Test smells are poor design decisions implemented in test code, which can have an impact on the effectiveness and maintainability of unit tests. Even though test smell detection tools exist, how to rank the severity of the detected smells is an open research topic. In this work, we aim at investigating the severity rating for four test smells...conference paper 2020
- document
-
van Driel, W.D. (author), Bikker, Jan Willem (author), Tijink, Matthijs (author), Di Bucchianico, A (author)It is known that quantitative measures for the reliability of software systems can be derived from software reliability models, and, as such, support the product development process. Over the past four decades, research activities in this area have been performed. As a result, many software reliability models have been proposed. It was shown...journal article 2020
- document
-
Arnar Briem, Jón (author), Smit, Jordi (author), Sellik, Hendrig (author), Rapoport, Pavel (author), Gousios, G. (author), Aniche, Maurício (author)Mistakes in boundary conditions are the cause of many bugs in software. These mistakes happen when, e.g., developers make use of '<' or '>' in cases where they should have used '<=' or '>='. Mistakes in boundary conditions are often hard to find and manually detecting them might be very time-consuming for developers. While...conference paper 2020
- document
-
Devroey, Xavier (author), Panichella, Sebastiano (author), Gambi, Alessio (author)We report on the results of the eighth edition of the Java unit testing tool competition. This year, two tools, EvoSuite and Randoop, were executed on a benchmark with (i) new classes under test, selected from open-source software projects, and (ii) the set of classes from one project considered in the previous edition. We relied on an updated...conference paper 2020
- document
-
Derakhshanfar, P. (author), Devroey, Xavier (author), Zaidman, A.E. (author), van Deursen, A. (author), Panichella, A. (author)Evolutionary-based crash reproduction techniques aid developers in their debugging practices by generating a test case that reproduces a crash given its stack trace. In these techniques, the search process is typically guided by a single search objective called Crash Distance. Previous studies have shown that current approaches could only...conference paper 2020
- document
-
Derakhshanfar, P. (author), Devroey, Xavier (author), Perrouin, Gilles (author), Zaidman, A.E. (author), van Deursen, A. (author)Search-based crash reproduction approaches assist developers during debugging by generating a test case, which reproduces a crash given its stack trace. One of the fundamental steps of this approach is creating objects needed to trigger the crash. One way to overcome this limitation is seeding: using information about the application during the...journal article 2020
- document
-
Abdessalem, Raja Ben (author), Panichella, A. (author), Nejati, Shiva (author), Briand, Lionel (author), Stifter, Thomas (author)In the past years, several automated repair strategies have been proposed to fix bugs in individual software programs without any human intervention. There has been, however, little work on how automated repair techniques can resolve failures that arise at the system-level and are caused by undesired interactions among different system...conference paper 2020
- document
-
Soltani, M. (author), Panichella, A. (author), van Deursen, A. (author)Software systems fail. These failures are often reported to issue tracking systems, where they are prioritized and assigned to responsible developers to be investigated. When developers debug software, they need to reproduce the reported failure in order to verify whether their fix actually prevents the failure from happening again. Since...journal article 2020
- document
-
Derakhshanfar, P. (author), Devroey, Xavier (author), Panichella, A. (author), Zaidman, A.E. (author), van Deursen, A. (author)Approaches for automatic crash reproduction aim to generate test cases that reproduce crashes starting from the crash stack traces. These tests help developers during their debugging practices. One of the most promising techniques in this research field leverages search-based software testing techniques for generating crash reproducing test...conference paper 2020
- document
-
Derakhshanfar, P. (author), Devroey, Xavier (author), Zaidman, A.E. (author), van Deursen, A. (author), Panichella, A. (author)Writing a test case reproducing a reported software crash is a common practice to identify the root cause of an anomaly in the software under test. However, this task is usually labor-intensive and time-taking. Hence, evolutionary intelligence approaches have been successfully applied to assist developers during debugging by generating a test...conference paper 2020
- document
-
Olsthoorn, Mitchell (author), van Deursen, A. (author), Panichella, A. (author)Software testing is an important and time-consuming task that is often done manually. In the last decades, researchers have come up with techniques to generate input data (e.g., fuzzing) and automate the process of generating test cases (e.g., search-based testing). However, these techniques are known to have their own limitations: search-based...conference paper 2020
- document
-
Roy, Devjeet (author), Zhang, Ziyi (author), Ma, Maggie (author), Arnaoudova, Venera (author), Panichella, A. (author), Panichella, Sebastiano (author), Gonzalez, Danielle (author), Mirakhorli, Mehdi (author)Automated test case generation tools have been successfully proposed to reduce the amount of human and infrastructure resources required to write and run test cases. However, recent studies demonstrate that the readability of generated tests is very limited due to (i) uninformative identifiers and (ii) lack of proper documentation. Prior...conference paper 2020
- document
-
Aniche, Maurício (author), Hermans, F.F.J. (author), van Deursen, A. (author)Software testing is an important topic in software engineering education, and yet highly challenging from an educational perspective: students are required to learn several testing techniques, to be able to distinguish the right technique to apply, to evaluate the quality of their test suites, and to write maintainable test code. In this paper,...conference paper 2019
- document
-
Plazar, Quentin (author), Acher, Mathieu (author), Perrouin, Gilles (author), Devroey, Xavier (author), Cordy, Maxime (author)Uniform or near-uniform generation of solutions for large satisfiability formulas is a problem of theoretical and practical interest for the testing community. Recent works proposed two algorithms (namely UniGen and QuickSampler) for reaching a good compromise between execution time and uniformity guarantees, with empirical evidence on SAT...conference paper 2019
- document
-
Spadini, D. (author), Palomba, F. (author), Baum, Tobias (author), Hanenberg, Stefan (author), Bruntink, Magiel (author), Bacchelli, A. (author)Test-Driven Code Review (TDR) is a code review practice in which a reviewer inspects a patch by examining the changed test code before the changed production code. Although this practice has been mentioned positively by practitioners in informal literature and interviews, there is no systematic knowledge of its effects, prevalence, problems, and...conference paper 2019
- document
-
Vanhecke, Jeremy (author), Devroey, Xavier (author), Perrouin, Gilles (author)Test definition and execution is an essential but time-consuming task during system development. To speed up the process, model-based testing and other related approaches propose to generate/write abstract test cases and to concretize them using either transformations, an adapter, or a mixture of the two. QTaste is an industrial data-driven test...conference paper 2019
- document
-
Panichella, A. (author)Over the last decades, white-box search-based techniques have been applied to automate the design and the execution of test cases. While most of the research effort has been devoted to unit-level testing, integration-level test case generation requires to solve several open challenges, such as the combinatorial explosion of conditions or pre...conference paper 2019
- document
-
Abdelgawad, Ahmed (author), Comes, M. (author)Evaluation and testing are major steps in the development of any information system, particularly if it is to be used in high-risk contexts such as conflicts. While thus far there are various approaches for testing against technology requirements; usability or usefulness, there is a lack of a comprehensive evaluation framework that combines the...conference paper 2019
- document
-
Kechagia, M. (author), Devroey, Xavier (author), Panichella, A. (author), Gousios, G. (author), van Deursen, A. (author)Application Programming Interfaces (APIs) typically come with (implicit) usage constraints. The violations of these constraints (API misuses) can lead to software crashes. Even though there are several tools that can detect API misuses, most of them suffer from a very high rate of false positives. We introduce Catcher, a novel API misuse...conference paper 2019