The interlaboratory comparability and reproducibility of all-solid-state battery cell cycling performance are poorly understood due to the lack of standardized set-ups and assembly parameters. This study quantifies the extent of this variability by providing commercially sourced battery materials—LiNi_0.6Mn_0.2Co_0.2O₂ for the positive electrode, Li₆PS₅Cl as the solid electrolyte and indium for the negative electrode—to 21 research groups. Each group was asked to use their own cell assembly protocol but follow a specific electrochemical protocol. The results show large variability in assembly and electrochemical performance, including differences in processing pressures, pressing durations and In-to-Li ratios. Despite this, an initial open circuit voltage of 2.5 and 2.7 V vs Li⁺/Li is a good predictor of successful cycling for cells using these electroactive materials. We suggest a set of parameters for reporting all-solid-state battery cycling results and advocate for reporting data in triplicate.