The Energy Impact of Batch Testing in Continuous Integration

An Empirical Study of Static and Dynamic Batching Strategies

Conference Paper (2026)
Author(s)

Máté Oszkó (Student TU Delft)

Xutong Liu (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Andy Zaidman (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Carolin Brandt (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Department
Software Technology
DOI related publication
https://doi.org/10.1145/3803437.3805602 Final published version
More Info
expand_more
Publication Year
2026
Language
English
Department
Software Technology
Pages (from-to)
1544-1552
Publisher
ACM
ISBN (electronic)
9798400726361
Event
ACM International Conference on the Foundations of Software Engineering, FSE 2026 (2026-07-05 - 2026-07-09), Montreal, Canada
Page Views
88
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Continuous integration pipelines execute automated tests on every commit, consuming substantial energy. Batch testing, which groups multiple commits into a single test run, has been shown to reduce test executions in simulation studies, but no prior work has measured whether these reductions translate into actual energy savings. This study measures CPU package energy consumption of CI builds under a baseline run-all approach and two batching strategies (BatchStop4 and linear-4 lwd) across eight open-source Java projects. BatchStop4 achieves energy savings between 57% and 88%, while linear-4 lwd achieves savings between 59% and 94%. Energy savings correlate almost perfectly with time savings (r >0.99), indicating that batching reduces energy primarily by shortening total execution time. Baseline failure rate strongly predicts achievable savings, while CPU utilisation shows no significant relationship. These findings provide empirical evidence that batch testing effectively reduces the environmental footprint of continuous integration, particularly for projects with low failure rates.