Print Email Facebook Twitter Massively Parallel, Highly Efficient, but What about the Test Suite Quality? Applying Mutation Testing to GPU Programs Title Massively Parallel, Highly Efficient, but What about the Test Suite Quality? Applying Mutation Testing to GPU Programs Author Zhu, Q. (TU Delft Software Engineering) Zaidman, A.E. (TU Delft Software Engineering) Date 2020 Abstract Thanks to rapid advances in programmability and performance, GPUs have been widely applied in High Performance Computing (HPC) and safety-critical domains. As such, quality assurance of GPU applications has gained increasing attention. This brings us to mutation testing, a fault-based testing technique that assesses the test suite quality by systematically introducing small artificial faults. It has been shown to perform well in exposing faults. In this paper, we investigate whether GPU programming can benefit from mutation testing. In addition to conventional mutation operators, we propose nine GPU-specific mutation operators based on the core syntax differences between CPU and GPU programming. We conduct a preliminary study on six CUDA systems. The results show that mutation testing can effectively evaluate the test quality of GPU programs: conventional mutation operators can guide the engineers to write simple direct tests, while GPU-specific mutation operators can lead to more intricate test cases which are better at revealing GPU-specific weaknesses. To reference this document use: http://resolver.tudelft.nl/uuid:dc9e6893-9a4c-4ecf-bc18-61fa7e5128d7 DOI https://doi.org/10.1109/ICST46399.2020.00030 Publisher IEEE Embargo date 2022-07-01 ISBN 9781728157771 Source Proceedings - 2020 IEEE 13th International Conference on Software Testing, Verification and Validation, ICST 2020 Event 13th IEEE International Conference on Software Testing, Verification and Validation, ICST 2020, 2020-03-23 → 2020-03-27, Porto, Portugal Series Proceedings - 2020 IEEE 13th International Conference on Software Testing, Verification and Validation, ICST 2020 Bibliographical note Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public. Part of collection Institutional Repository Document type conference paper Rights © 2020 Q. Zhu, A.E. Zaidman Files PDF 09159103.pdf 421.8 KB Close viewer /islandora/object/uuid:dc9e6893-9a4c-4ecf-bc18-61fa7e5128d7/datastream/OBJ/view