Framework Matters
Energy Efficiency of UI Automation Testing Frameworks
Timmie M.R. Lagermann (Roskilde University)
Kristina Sophia Carter (Roskilde University)
Su Mei Gwen Ho (Roskilde University)
Luís Cruz (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Kerstin Eder (University of Bristol)
Maja H. Kirkeby (Roskilde University)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
We examine per action energy consumption across four web user interface (UI) automation testing frameworks to determine whether consistent tendencies can guide energy-aware test design. Using a controlled client-server setup with external power metering, we use varying repetitions in each UI action run (refresh, click variants, checkbox, drag&drop, input-text, scroll) and repeat each UI action run 35 times. Across each of the actions, energy costs vary by both framework and action. Puppeteer is the most efficient for left-click, right-click, double-click, checkbox, and input-text; Selenium is the most efficient for refresh and scroll; Nightwatch is generally the least energy efficient. The energy cost of performing the same action varied by up to a factor of six depending on the framework. This indicates that providing transparency of energy consumption for UI automation testing frameworks allows developers to make informed, energy-aware decisions when testing a specific UI action.
help_outline