- document
-
Khatami, Ali (author), Zaidman, A.E. (author)To ensure the quality of software systems, software engineers can make use of a variety of quality assurance approaches, for example, software testing, modern code review, automated static analysis, and build automation. Each of these quality assurance practices have been studied in depth in isolation, but there is a clear knowledge gap when...journal article 2024
- document
-
van Dorth tot Medler, Jan (author)Background: For rigorous software testing, integration and end-to-end tests are essential to ensure the expected behavior of multiple interacting components of the system. When software is subjected to integration or end-to-end tests, it is often unfeasible to test every code change individually, as the runtime of these tests is usually...master thesis 2023
- document
-
Abolfazli, Amir (author), Spiegelberg, Jakob (author), Anand, A. (author), Palmer, Gregory (author)Configurable software systems have become increasingly popular as they enable customized software variants. The main challenge in dealing with configuration problems is that the number of possible configurations grows exponentially as the number of features increases. Therefore, algorithms for testing customized software have to deal with the...conference paper 2023
- document
-
Ardıç, B.A. (author), Zaidman, A.E. (author)Software testing is generally acknowledged to be an important weapon in the arsenal of software engineers to produce correct and reliable software systems. However, given the importance of the topic, little is known about where software engineers get their testing knowledge and skills from. Is this through (higher) education, training...conference paper 2023
- document
-
Aniche, Maurício (author), Treude, Christoph (author), Zaidman, A.E. (author)One of the main challenges that developers face when testing their systems lies in engineering test cases that are good enough to reveal bugs. And while our body of knowledge on software testing and automated test case generation is already quite significant, in practice, developers are still the ones responsible for engineering test cases...journal article 2021
- document
-
Panichella, A. (author), Liem, C.C.S. (author)Mutation testing is a well-established technique for assessing a test suite’s quality by injecting artificial faults into production code. In recent years, mutation testing has been extended to machine learning (ML) systems, and deep learning (DL) in particular; researchers have proposed approaches, tools, and statistically sound heuristics to...conference paper 2021
- document
-
Lenarduzzi, Valentina (author), Panichella, A. (author)Testing serverless applications plays an important role in software quality assurance. The current status of testing and debugging in serverless-based applications depicted by the experts helped us highlight issues and challenges that need to be deeply investigated.journal article 2021
- document
-
Halin, Axel (author), Nuttinck, Alexandre (author), Acher, Mathieu (author), Devroey, Xavier (author), Perrouin, Gilles (author), Baudry, Benoit (author)This is an extended abstract of the article: Axel Halin, Alexandre Nuttinck, Mathieu Acher, Xavier Devroey, Gilles Perrouin, and Benoit Baudry. 2018. Test them all, is it worth it? Assessing config- uration sampling on the JHipster Web development stack. In Em- pirical Software Engineering (17 Jul 2018). https://doi.org/10.1007/ s10664-018-9635-4.conference paper 2020
- document
-
Arnar Briem, Jón (author), Smit, Jordi (author), Sellik, Hendrig (author), Rapoport, Pavel (author), Gousios, G. (author), Aniche, Maurício (author)Mistakes in boundary conditions are the cause of many bugs in software. These mistakes happen when, e.g., developers make use of '<' or '>' in cases where they should have used '<=' or '>='. Mistakes in boundary conditions are often hard to find and manually detecting them might be very time-consuming for developers. While...conference paper 2020
- document
-
Devroey, Xavier (author), Panichella, Sebastiano (author), Gambi, Alessio (author)We report on the results of the eighth edition of the Java unit testing tool competition. This year, two tools, EvoSuite and Randoop, were executed on a benchmark with (i) new classes under test, selected from open-source software projects, and (ii) the set of classes from one project considered in the previous edition. We relied on an updated...conference paper 2020
- document
-
Roy, Devjeet (author), Zhang, Ziyi (author), Ma, Maggie (author), Arnaoudova, Venera (author), Panichella, A. (author), Panichella, Sebastiano (author), Gonzalez, Danielle (author), Mirakhorli, Mehdi (author)Automated test case generation tools have been successfully proposed to reduce the amount of human and infrastructure resources required to write and run test cases. However, recent studies demonstrate that the readability of generated tests is very limited due to (i) uninformative identifiers and (ii) lack of proper documentation. Prior...conference paper 2020
- document
-
Spadini, D. (author), Palomba, F. (author), Baum, Tobias (author), Hanenberg, Stefan (author), Bruntink, Magiel (author), Bacchelli, A. (author)Test-Driven Code Review (TDR) is a code review practice in which a reviewer inspects a patch by examining the changed test code before the changed production code. Although this practice has been mentioned positively by practitioners in informal literature and interviews, there is no systematic knowledge of its effects, prevalence, problems, and...conference paper 2019
- document
-
Spadini, D. (author), Aniche, Maurício (author), Storey, Margaret-Anne (author), Bruntink, Magiel (author), Bacchelli, A. (author)Automated testing is considered an essential process for ensuring software quality. However, writing and maintaining high-quality test code is challenging and frequently considered of secondary importance. For production code, many open source and industrial software projects employ code review, a well-established software quality practice, but...conference paper 2018
- document
-
Levaja, I. (author)Software testing is as old as software development itself – they could not exist one without the other. However, are they equally important? Do software developers devote an equivalent amount of time to both produce software and to test it? An ongoing study of the TestRoots project aims to examine and improve the state of the art of software...master thesis 2016
- document
-
Greiler, M.S. (author), Van Deursen, A. (author), Storey, M.A. (author)Paper accepted for publication in the Proceedings of the Sixth International Conference on Software Testing, Verification and Validation, IEEE Computer Society, 18-22 March 2013, ISBN 978-1-4673-5961-0, doi: 10.1109/ICST.2013.45 Designing automated tests is a challenging task. One important concern is how to design test fixtures, i.e. code that...report 2013
- document
-
Hurdugaci, V. (author)Regression testing is an expensive process because, most of times, all the available test cases are executed. Many techniques of test selection/filtering have been researched and implemented, each having its own strong and weak points. This paper introduces a tool that helps developers and testers to identify the tests that need to be executed...master thesis 2011
- document
-
Zaidman, A. (author), Van Rompaey, B. (author), Van Deursen, A. (author), Demeyer, S. (author)Many software production processes advocate rigorous development testing alongside functional code writing, which implies that both test code and production code should co-evolve. To gain insight in the nature of this co-evolution, this paper proposes three views (realized by a tool called TeMo) that combine information from a software project’s...journal article 2010
- document
-
Brinkman, W.P. (author), Haakma, R. (author), Bouwhuis, D.G. (author)This paper presents the results of a meta-analysis carried out on the results of six experiments to support the claim that component-specific usability measures are on average statistically more powerful than overall usability measures when comparing different versions of a part of a system. An increase in test effectiveness implies the need for...journal article 2008
- document
-
Lubsen, Z.A. (author)Unit testing is generally accepted as an aid to produce high quality code, and can provide quick feedback to developers on the quality of the software. To have a high quality and well maintained test suite requires the production and test code to synchronously co-evolve, as added or changed production code should be tested as soon as possible....master thesis 2008