Laying the foundation for building a Quantum Networking Benchmark suite using Quantum Network Applications

Abstract

The rapid advancement of Quantum Network architectures necessitates a comprehensive and quantitative comparison to assess their effectiveness and performance. Unfortunately, there does not exist an implemented quantum network benchmark suite capable of determining the superior architecture. Hence, our study aims to establish the foundation for developing a benchmark suite by leveraging existing quantum network applications. However, the specific inclusion of quantum network applications in the suite remains to be determined. Therefore, to address this gap, our study will explore the potential inclusion of the Clauser-Horne-Shimony-Holt (CHSH) game based on its effectiveness in identifying errors within various properties of the quantum networking system. We use an exploratory research methodology involving experiments performed on simulated quantum networks utilizing SquidASM. Each experiment simulates multiple quantum networks, with a single property as the independent variable. For each value of the independent variable, we calculate both the success probability of the game and the number of successes per second. Subsequently, we employ the one-way ANOVA test to examine if there are significant variations in these performance metrics. Our results demonstrate that the CHSH game exhibits sensitivity to all properties affecting the quality of entanglement between nodes, execution time, and the error probability of both single-qubit gates and measure operations. Additionally, we compare the success probabilities based on different input combinations using the Root Mean Squared metric to uncover any underlying patterns within the data. As a result, we discovered a procedure for quantifying the difference between the error probabilities of measurements of zero and one. Based on the outcomes of our study, we consider the CHSH game to be a suitable addition to the benchmark suite if the testing requirements of the suite align with the qualities offered by the application. We anticipate that these results will aid the development of the benchmark suite and advance the understanding of quantum network architectures and their evaluation