A Benchmark Framework for Byzantine Fault Tolerance Testing Algorithms

Conference Paper (2025)
Authors

J.M. Louro Neto (TU Delft - Software Engineering)

Burcu Ozkan (TU Delft - Software Engineering)

Research Group
Software Engineering
To reference this document use:
https://doi.org/10.4230/OASIcs.FMBC.2025.13
More Info
expand_more
Publication Year
2025
Language
English
Research Group
Software Engineering
ISBN (electronic)
978-3-95977-371-3
DOI:
https://doi.org/10.4230/OASIcs.FMBC.2025.13
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Recent discoveries of vulnerabilities in the design and implementation of Byzantine fault-tolerant protocols underscore the need for testing and exploration techniques to ensure their correctness. While there has been some recent effort for automated test generation for BFT protocols, there is no benchmark framework available to systematically evaluate their performance. We present ByzzBench, a benchmark framework designed to evaluate the performance of testing algorithms in detecting Byzantine fault tolerance bugs. ByzzBench is designed for a standardized implementation of BFT protocols and their execution in a controlled testing environment. It controls the nondeterminism in the concurrency, network, and process faults in the protocol execution, enabling the functionality to enforce particular execution scenarios and thereby facilitating the implementation of testing algorithms for BFT protocols.