- document
-
Birchler, Christian (author), Khatiri, Sajad (author), Derakhshanfar, P. (author), Panichella, Sebastiano (author), Panichella, A. (author)Testing with simulation environments helps to identify critical failing scenarios for self-driving cars (SDCs). Simulation-based tests are safer than in-field operational tests and allow detecting software defects before deployment. However, these tests are very expensive and are too many to be run frequently within limited time constraints...journal article 2023
- document
-
Derakhshanfar, P. (author), Devroey, Xavier (author), Panichella, A. (author), Zaidman, A.E. (author), van Deursen, A. (author)Search-based approaches have been used in the literature to automate the process of creating unit test cases. However, related work has shown that generated tests with high code coverage could be ineffective, i.e., they may not detect all faults or kill all injected mutants. In this paper, we propose Cling, an integration-level test case...journal article 2023
- document
-
van Meerten, M.C. (author), Kulahcioglu Ozkan, Burcu (author), Panichella, A. (author)Blockchain systems are prone to concurrency bugs due to the nondeterminism in the delivery order of messages between the distributed nodes. These bugs are hard to detect since they can only be triggered by a specific order or timing of concurrent events in the execution. <br/>Systematic concurrency testing techniques, which explore all possible...conference paper 2023
- document
-
Applis, L.H. (author), Panichella, A. (author), Marang, R.J. (author)More machine learning (ML) models are introduced to the field of Software Engineering (SE) and reached a stage of maturity to be considered for real-world use; But the real world is complex, and testing these models lacks often in explainability, feasibility and computational capacities. Existing research introduced meta-morphic testing to...conference paper 2023
- document
-
Veldkamp, L.S. (author), Olsthoorn, Mitchell (author), Panichella, A. (author)Web Application Programming Interfaces (APIs) allow systems to be addressed programmatically and form the backbone of the internet. RESTful and RPC APIs are among the most common API architectures used. In the last decades, researchers have proposed various techniques for automated testing of RESTful APIs, however, to the best of the authors'...conference paper 2023
- document
-
van Dinten, I. (author), Zaidman, A.E. (author), Panichella, A. (author)Test case prioritization techniques have emerged as effective strategies to optimize this process and mitigate the regression testing costs. Commonly, black-box heuristics guide optimal test ordering, leveraging information retrieval (e.g., cosine distance) to measure the test case distance and sort them accordingly. However, a challenge...conference paper 2023
- document
-
Bartlett, A.J. (author), Liem, C.C.S. (author), Panichella, A. (author)Deep learning (DL) models are known to be highly accurate, yet vulnerable to adversarial examples. While earlier research focused on generating adversarial examples using whitebox strategies, later research focused on black-box strategies, as models often are not accessible to external attackers. Prior studies showed that black-box approaches...conference paper 2023
- document
-
Gissurarson, Matthías Páll (author), Applis, L.H. (author), Panichella, A. (author), van Deursen, A. (author), Sands, David (author)Automatic program repair (APR) regularly faces the challenge of overfitting patches — patches that pass the test suite, but do not actually address the problems when evaluated manually. Currently, overfit detection requires manual inspection or an oracle making quality control of APR an expensive task. With this work, we want to introduce...conference paper 2022
- document
-
Panichella, A. (author), Panichella, Sebastiano (author), Fraser, Gordon (author), Sawant, Anand Ashok (author), Hellendoorn, Vincent (author)Test smells aim to capture design issues in test code that reduces its maintainability. These have been extensively studied and generally found quite prevalent in both human-written and automatically generated test-cases. However, most evidence of prevalence is based on specific static detection rules. Although those are based on the original,...journal article 2022
- document
-
Olsthoorn, Mitchell (author), van Deursen, A. (author), Panichella, A. (author)Transaction-reverting statements are key constructs within Solidity that are extensively used for authority and validity checks. Current state-of-the-art search-based testing and fuzzing approaches do not explicitly handle these statements and therefore can not effectively detect security vulnerabilities. In this paper, we argue that it is...conference paper 2022
- document
-
Devroey, Xavier (author), Gambi, Alessio (author), Galeotti, Juan Pablo (author), Just, René (author), Kifetew, Fitsum Meshesha (author), Panichella, Sebastiano (author), Panichella, A. (author)Researchers and practitioners have designed and implemented various automated test case generators to support effective software testing. Such generators exist for various languages (e.g., Java, C#, or Python) and various platforms (e.g., desktop, web, or mobile applications). The generators exhibit varying effectiveness and efficiency,...journal article 2022
- document
-
Applis, L.H. (author), Panichella, A. (author), van Deursen, A. (author)Metamorphic testing is a well-established testing technique that has been successfully applied in various domains, including testing deep learning models to assess their robustness against data noise or malicious input. Currently, metamorphic testing approaches for machine learning (ML) models focused on image processing and object recognition...conference paper 2021
- document
-
Panichella, A. (author), Liem, C.C.S. (author)Mutation testing is a well-established technique for assessing a test suite’s quality by injecting artificial faults into production code. In recent years, mutation testing has been extended to machine learning (ML) systems, and deep learning (DL) in particular; researchers have proposed approaches, tools, and statistically sound heuristics to...conference paper 2021
- document
-
Olsthoorn, Mitchell (author), Panichella, A. (author)Test Case Selection (TCS) aims to select a subset of the test suite to run for regression testing. The selection is typically based on past coverage and execution cost data. Researchers have successfully used multi-objective evolutionary algorithms (MOEAs), such as NSGA-II and its variants, to solve this problem. These MOEAs use traditional...conference paper 2021
- document
-
Lenarduzzi, Valentina (author), Panichella, A. (author)Testing serverless applications plays an important role in software quality assurance. The current status of testing and debugging in serverless-based applications depicted by the experts helped us highlight issues and challenges that need to be deeply investigated.journal article 2021
- document
-
Olsthoorn, Mitchell (author), Derakhshanfar, P. (author), Panichella, A. (author)State-of-the-art search-based approaches for test case generation work at test case level, where tests are represented as sequences of statements. These approaches make use of genetic operators (i.e., mutation and crossover) that create test variants by adding, altering, and removing statements from existing tests. While this encoding schema has...conference paper 2021
- document
-
Vogl, Sebastian (author), Schweikl, Sebastian (author), Fraser, Gordon (author), Arcuri, Andrea (author), Campos, José (author), Panichella, A. (author)EvoSuite is a search-based unit test generation tool for Java. This paper summarises the results and experiences of EvoSuite's participation at the ninth unit testing competition at SBST 2021, where EvoSuite achieved the highest overall score.conference paper 2021
- document
-
Stallenberg, D.M. (author), Olsthoorn, Mitchell (author), Panichella, A. (author)With the ever-increasing use of web APIs in modern-day applications, it is becoming more important to test the system as a whole. In the last decade, tools and approaches have been proposed to automate the creation of system-level test cases for these APIs using evolutionary algorithms (EAs). One of the limiting factors of EAs is that the...conference paper 2021
- document
-
Zhu, Q. (author), Zaidman, A.E. (author), Panichella, A. (author)Mutation testing is well-known for its efficacy in assessing test quality, and starting to be applied in the industry. However, what should a developer do when confronted with a low mutation score? Should the test suite be plainly reinforced to increase the mutation score, or should the production code be improved as well, to make the...journal article 2021
- document
-
Devroey, Xavier (author), Panichella, Sebastiano (author), Gambi, Alessio (author)We report on the results of the eighth edition of the Java unit testing tool competition. This year, two tools, EvoSuite and Randoop, were executed on a benchmark with (i) new classes under test, selected from open-source software projects, and (ii) the set of classes from one project considered in the previous edition. We relied on an updated...conference paper 2020