- document
-
Zaidman, A. (author), Van Rompaey, B. (author), Van Deursen, A. (author), Demeyer, S. (author)Many software production processes advocate rigorous development testing alongside functional code writing, which implies that both test code and production code should co-evolve. To gain insight in the nature of this co-evolution, this paper proposes three views (realized by a tool called TeMo) that combine information from a software project’s...journal article 2010
- document
-
Brinkman, W.P. (author), Haakma, R. (author), Bouwhuis, D.G. (author)This paper presents the results of a meta-analysis carried out on the results of six experiments to support the claim that component-specific usability measures are on average statistically more powerful than overall usability measures when comparing different versions of a part of a system. An increase in test effectiveness implies the need for...journal article 2008
- document
-
Birchler, Christian (author), Khatiri, Sajad (author), Derakhshanfar, P. (author), Panichella, Sebastiano (author), Panichella, A. (author)Testing with simulation environments helps to identify critical failing scenarios for self-driving cars (SDCs). Simulation-based tests are safer than in-field operational tests and allow detecting software defects before deployment. However, these tests are very expensive and are too many to be run frequently within limited time constraints...journal article 2023
- document
-
Aniche, Maurício (author), Treude, Christoph (author), Zaidman, A.E. (author)One of the main challenges that developers face when testing their systems lies in engineering test cases that are good enough to reveal bugs. And while our body of knowledge on software testing and automated test case generation is already quite significant, in practice, developers are still the ones responsible for engineering test cases...journal article 2021
- document
-
Soltani, M. (author), Derakhshanfar, P. (author), Devroey, Xavier (author), van Deursen, A. (author)Crash reproduction approaches help developers during debugging by generating a test case that reproduces a given crash. Several solutions have been proposed to automate this task. However, the proposed solutions have been evaluated on a limited number of projects, making comparison difficult. In this paper, we enhance this line of research by...journal article 2020
- document
-
Lenarduzzi, Valentina (author), Panichella, A. (author)Testing serverless applications plays an important role in software quality assurance. The current status of testing and debugging in serverless-based applications depicted by the experts helped us highlight issues and challenges that need to be deeply investigated.journal article 2021
- document
-
van Driel, W.D. (author), Bikker, Jan Willem (author), Tijink, Matthijs (author), Di Bucchianico, A (author)It is known that quantitative measures for the reliability of software systems can be derived from software reliability models, and, as such, support the product development process. Over the past four decades, research activities in this area have been performed. As a result, many software reliability models have been proposed. It was shown...journal article 2020
- document
-
Panichella, A. (author), Panichella, Sebastiano (author), Fraser, Gordon (author), Sawant, Anand Ashok (author), Hellendoorn, Vincent (author)Test smells aim to capture design issues in test code that reduces its maintainability. These have been extensively studied and generally found quite prevalent in both human-written and automatically generated test-cases. However, most evidence of prevalence is based on specific static detection rules. Although those are based on the original,...journal article 2022
- document
-
Swillus, M. (author), Zaidman, A.E. (author)Software testing is an integral part of modern software engineering practice. Past research has not only underlined its significance, but also revealed its multi-faceted nature. The practice of software testing and its adoption is influenced by many factors that go beyond tools or technology. This paper sets out to investigate the context of...journal article 2023
- document
-
Khatami, Ali (author), Zaidman, A.E. (author)To ensure the quality of software systems, software engineers can make use of a variety of quality assurance approaches, for example, software testing, modern code review, automated static analysis, and build automation. Each of these quality assurance practices have been studied in depth in isolation, but there is a clear knowledge gap when...journal article 2024
- document
-
Derakhshanfar, P. (author), Devroey, Xavier (author), Zaidman, A.E. (author)Search-based techniques have been widely used for white-box test generation. Many of these approaches rely on the approach level and branch distance heuristics to guide the search process and generate test cases with high line and branch coverage. Despite the positive results achieved by these two heuristics, they only use the information...journal article 2022
- document
-
Brandt, C.E. (author), Zaidman, A.E. (author)Automatically generating test cases for software has been an active research topic for many years. While current tools can generate powerful regression or crash-reproducing test cases, these are often kept separately from the maintained test suite. In this paper, we leverage the developer’s familiarity with test cases amplified from existing,...journal article 2022
- document
-
Derakhshanfar, P. (author), Devroey, Xavier (author), Perrouin, Gilles (author), Zaidman, A.E. (author), van Deursen, A. (author)Search-based crash reproduction approaches assist developers during debugging by generating a test case, which reproduces a crash given its stack trace. One of the fundamental steps of this approach is creating objects needed to trigger the crash. One way to overcome this limitation is seeding: using information about the application during the...journal article 2020
- document
-
Soltani, M. (author), Panichella, A. (author), van Deursen, A. (author)Software systems fail. These failures are often reported to issue tracking systems, where they are prioritized and assigned to responsible developers to be investigated. When developers debug software, they need to reproduce the reported failure in order to verify whether their fix actually prevents the failure from happening again. Since...journal article 2020
- document
-
Spadini, D. (author), Aniche, Maurício (author), Bruntink, Magiel (author), Bacchelli, A. (author)When testing software artifacts that have several dependencies, one has the possibility of either instantiating these dependencies or using mock objects to simulate the dependencies’ expected behavior. Even though recent quantitative studies showed that mock objects are widely used both in open source and proprietary projects, scientific...journal article 2018
- document
-
Devroey, Xavier (author), Gambi, Alessio (author), Galeotti, Juan Pablo (author), Just, René (author), Kifetew, Fitsum Meshesha (author), Panichella, Sebastiano (author), Panichella, A. (author)Researchers and practitioners have designed and implemented various automated test case generators to support effective software testing. Such generators exist for various languages (e.g., Java, C#, or Python) and various platforms (e.g., desktop, web, or mobile applications). The generators exhibit varying effectiveness and efficiency,...journal article 2022
- document
-
Xiang, Shang (author)Software applications inevitably crash, and it is time-consuming to recreate the crash conditions for debugging. Recently, researchers have developed frameworks relying on genetic algorithms, e.g. Botsing, for automated crash reproduction. However, the existing approaches process exceptions of different types as if they were the same. In this...master thesis 2020
- document
-
van Meerten, Martijn (author)Distributed concurrency bugs (DC bugs) are bugs that are triggered by a specific order of events in distributed systems. Traditional model checkers systematically or randomly test interleavings but suffer from the state-space explosion in long executions. This thesis presents DiscoTest, a testing tool for DC bugs in blockchain consensus...master thesis 2022
- document
-
Evers, Björn (author)Various search-based test generation techniques have been proposed to automate the process of test generation to fulfill different criteria (e.g., line coverage, branch coverage, mutation score, etc.). Despite these techniques' undeniable accomplishments, they still suffer from a lack of guidance coming from the data gathered from the production...master thesis 2020
- document
-
Betanzo Sanchez, Fernando (author)The testing of quantum applications can be approached from three perspectives. The first one concerns the certification of the accuracy of the quantum device where the application is run. The second one has to do with the classical verification of the result output by the application. Yet a third one addresses the problem from the software...master thesis 2020