Print Email Facebook Twitter DeepTC-Enhancer Title DeepTC-Enhancer: Improving the Readability of Automatically Generated Tests Author Roy, Devjeet (Washington State University Pullman) Zhang, Ziyi (Washington State University Pullman) Ma, Maggie (Infra Supply Chain and Automation) Arnaoudova, Venera (Washington State University Pullman) Panichella, A. (TU Delft Software Engineering) Panichella, Sebastiano (Zurich University of Applied Science (ZHAW)) Gonzalez, Danielle (Rochester Institute of Technology) Mirakhorli, Mehdi (Rochester Institute of Technology) Date 2020 Abstract Automated test case generation tools have been successfully proposed to reduce the amount of human and infrastructure resources required to write and run test cases. However, recent studies demonstrate that the readability of generated tests is very limited due to (i) uninformative identifiers and (ii) lack of proper documentation. Prior studies proposed techniques to improve test readability by either generating natural language summaries or meaningful methods names. While these approaches are shown to improve test readability, they are also affected by two limitations: (1) generated summaries are often perceived as too verbose and redundant by developers, and (2) readable tests require both proper method names but also meaningful identifiers (within-method readability). In this work, we combine template based methods and Deep Learning (DL) approaches to automatically generate test case scenarios (elicited from natural language patterns of test case statements) as well as to train DL models on path-based representations of source code to generate meaningful identifier names. Our approach, called DeepTC-Enhancer, recommends documentation and identifier names with the ultimate goal of enhancing readability of automatically generated test cases. An empirical evaluation with 36 external and internal developers shows that (1) DeepTC-Enhancer outperforms significantly the baseline approach for generating summaries and performs equally with the baseline approach for test case renaming, (2) the transformation proposed by DeepTC-Enhancer results in a significant increase in readability of automatically generated test cases, and (3) there is a significant difference in the feature preferences between external and internal developers. Subject deep learningempirical studyevolutionmaintenanceprogram comprehensionsoftware testingtest case generation To reference this document use: http://resolver.tudelft.nl/uuid:f15dbaed-d186-4b4f-8a75-4bcf67c13317 DOI https://doi.org/10.1145/3324884.3416622 Publisher IEEE / ACM ISBN 978-1-7281-7281-1 Source Proceedings - 2020 35th IEEE/ACM International Conference on Automated Software Engineering, ASE 2020 Event 35th IEEE/ACMInternational Conference on Automated Software Engineering (ASE ’20),, 2020-09-21 → 2020-09-25 Series Proceedings - 2020 35th IEEE/ACM International Conference on Automated Software Engineering, ASE 2020 Bibliographical note Accepted author manuscript Part of collection Institutional Repository Document type conference paper Rights © 2020 Devjeet Roy, Ziyi Zhang, Maggie Ma, Venera Arnaoudova, A. Panichella, Sebastiano Panichella, Danielle Gonzalez, Mehdi Mirakhorli Files PDF 2020_ASE_DeepTC.pdf 1.17 MB Close viewer /islandora/object/uuid:f15dbaed-d186-4b4f-8a75-4bcf67c13317/datastream/OBJ/view