- document
-
van Meerten, M.C. (author), Kulahcioglu Ozkan, Burcu (author), Panichella, A. (author)Blockchain systems are prone to concurrency bugs due to the nondeterminism in the delivery order of messages between the distributed nodes. These bugs are hard to detect since they can only be triggered by a specific order or timing of concurrent events in the execution. <br/>Systematic concurrency testing techniques, which explore all possible...conference paper 2023
- document
-
Applis, L.H. (author), Panichella, A. (author), Marang, R.J. (author)More machine learning (ML) models are introduced to the field of Software Engineering (SE) and reached a stage of maturity to be considered for real-world use; But the real world is complex, and testing these models lacks often in explainability, feasibility and computational capacities. Existing research introduced meta-morphic testing to...conference paper 2023
- document
-
Panichella, A. (author), Di Domenico, Giuseppe (author)Spatial mode division de-multiplexing of optical signals has many real-world applications, such as quantum computing and both classical and quantum optical communication. In this context, it is crucial to develop devices able to efficiently sort optical signals according to the optical mode they belong to and route them on different paths....conference paper 2023
- document
-
Veldkamp, L.S. (author), Olsthoorn, Mitchell (author), Panichella, A. (author)Web Application Programming Interfaces (APIs) allow systems to be addressed programmatically and form the backbone of the internet. RESTful and RPC APIs are among the most common API architectures used. In the last decades, researchers have proposed various techniques for automated testing of RESTful APIs, however, to the best of the authors'...conference paper 2023
- document
-
Bartlett, A.J. (author), Liem, C.C.S. (author), Panichella, A. (author)Deep learning (DL) models are known to be highly accurate, yet vulnerable to adversarial examples. While earlier research focused on generating adversarial examples using whitebox strategies, later research focused on black-box strategies, as models often are not accessible to external attackers. Prior studies showed that black-box approaches...conference paper 2023
- document
-
Applis, L.H. (author), Panichella, A. (author)We present HasBugs, an extensible and manually-curated dataset of real-world 25 Haskell Bugs from 6 open source repositories. We provide a faulty, tested, and fixed version of each bug in our dataset with reproduction packages, description, and bug context. For technical users, the dataset is meant to either help researchers adapt techniques...conference paper 2023
- document
-
van Dinten, I. (author), Zaidman, A.E. (author), Panichella, A. (author)Test case prioritization techniques have emerged as effective strategies to optimize this process and mitigate the regression testing costs. Commonly, black-box heuristics guide optimal test ordering, leveraging information retrieval (e.g., cosine distance) to measure the test case distance and sort them accordingly. However, a challenge...conference paper 2023
- document
-
Gissurarson, Matthías Páll (author), Applis, L.H. (author), Panichella, A. (author), van Deursen, A. (author), Sands, David (author)Automatic program repair (APR) regularly faces the challenge of overfitting patches — patches that pass the test suite, but do not actually address the problems when evaluated manually. Currently, overfit detection requires manual inspection or an oracle making quality control of APR an expensive task. With this work, we want to introduce...conference paper 2022
- document
-
Panichella, A. (author)A key idea in many-objective optimization is to approximate the optimal Pareto front using a set of representative non-dominated solutions. The produced solution set should be close to the optimal front (convergence) and well-diversified (diversity). Recent studies have shown that measuring both convergence and diversity depends on the shape (or...conference paper 2022
- document
-
Olsthoorn, Mitchell (author), Stallenberg, D.M. (author), van Deursen, A. (author), Panichella, A. (author)Ethereum is the largest and most prominent smart contract platform. One key property of Ethereum is that once a contract is deployed, it can not be updated anymore. This increases the importance of thoroughly testing the behavior and constraints of the smart contract before deployment. Existing approaches in related work either do not scale or...conference paper 2022
- document
-
Olsthoorn, Mitchell (author), van Deursen, A. (author), Panichella, A. (author)Transaction-reverting statements are key constructs within Solidity that are extensively used for authority and validity checks. Current state-of-the-art search-based testing and fuzzing approaches do not explicitly handle these statements and therefore can not effectively detect security vulnerabilities. In this paper, we argue that it is...conference paper 2022
- document
-
Stallenberg, D.M. (author), Olsthoorn, Mitchell (author), Panichella, A. (author)Search-based test case generation approaches make use of static type information to determine which data types should be used for the creation of new test cases. Dynamically typed languages like JavaScript, however, do not have this type information. In this paper, we propose an unsupervised probabilistic type inference approach to infer data...conference paper 2022
- document
-
Applis, L.H. (author), Panichella, A. (author), van Deursen, A. (author)Metamorphic testing is a well-established testing technique that has been successfully applied in various domains, including testing deep learning models to assess their robustness against data noise or malicious input. Currently, metamorphic testing approaches for machine learning (ML) models focused on image processing and object recognition...conference paper 2021
- document
-
Panichella, A. (author), Liem, C.C.S. (author)Mutation testing is a well-established technique for assessing a test suite’s quality by injecting artificial faults into production code. In recent years, mutation testing has been extended to machine learning (ML) systems, and deep learning (DL) in particular; researchers have proposed approaches, tools, and statistically sound heuristics to...conference paper 2021
- document
-
Olsthoorn, Mitchell (author), Panichella, A. (author)Test Case Selection (TCS) aims to select a subset of the test suite to run for regression testing. The selection is typically based on past coverage and execution cost data. Researchers have successfully used multi-objective evolutionary algorithms (MOEAs), such as NSGA-II and its variants, to solve this problem. These MOEAs use traditional...conference paper 2021
- document
-
Olsthoorn, Mitchell (author), Derakhshanfar, P. (author), Panichella, A. (author)State-of-the-art search-based approaches for test case generation work at test case level, where tests are represented as sequences of statements. These approaches make use of genetic operators (i.e., mutation and crossover) that create test variants by adding, altering, and removing statements from existing tests. While this encoding schema has...conference paper 2021
- document
-
Schröder, C.J. (author), van der Feltz, Adriaan (author), Panichella, A. (author), Aniche, Maurício (author)Deciding what constitutes a single module, what classes belong to which module or the right set of modules for a specific software system has always been a challenging task. The problem is even harder in large-scale software systems composed of thousands of classes and hundreds of modules. Over the years, researchers have been proposing...conference paper 2021
- document
-
Vogl, Sebastian (author), Schweikl, Sebastian (author), Fraser, Gordon (author), Arcuri, Andrea (author), Campos, José (author), Panichella, A. (author)EvoSuite is a search-based unit test generation tool for Java. This paper summarises the results and experiences of EvoSuite's participation at the ninth unit testing competition at SBST 2021, where EvoSuite achieved the highest overall score.conference paper 2021
- document
-
Stallenberg, D.M. (author), Olsthoorn, Mitchell (author), Panichella, A. (author)With the ever-increasing use of web APIs in modern-day applications, it is becoming more important to test the system as a whole. In the last decade, tools and approaches have been proposed to automate the creation of system-level test cases for these APIs using evolutionary algorithms (EAs). One of the limiting factors of EAs is that the...conference paper 2021
- document
-
Yildiz, B. (author), Hung, H.S. (author), Krijthe, J.H. (author), Liem, C.C.S. (author), Loog, M. (author), Migut, M.A. (author), Oliehoek, F.A. (author), Panichella, A. (author), Pawełczak, Przemysław (author), Picek, S. (author), de Weerdt, M.M. (author), van Gemert, J.C. (author)We present ReproducedPapers.org : an open online repository for teaching and structuring machine learning reproducibility. We evaluate doing a reproduction project among students and the added value of an online reproduction repository among AI researchers. We use anonymous self-assessment surveys and obtained 144 responses. Results suggest...conference paper 2021