Understanding diffusion mechanisms in solid electrolytes is crucial for advancing solid-state battery technologies. This study investigates the role of structural disorder in Li7−xPS6−xBrx argyrodites using ab initio molecular dynamics, focusing on the correlation between key structural descriptors and Li-ion conductivity. Commonly suggested parameters, such as configurational entropy, bromide site occupancy, and bromine content, correlate with Li-ion diffusivity but do not consistently explain conductivity trends. We find that a uniform distribution of bromine and sulfur ions across the 4a and 4d sublattices is critical for achieving high conductivity by facilitating optimal lithium jump activation energies, anion-lithium distances, and charge distribution. Additionally, we introduce the ionic potential as a simple descriptor that predicts argyrodite conductivity by assessing the interaction strength between cations and anions. By analyzing the correlation between ionic potential and conductivity for a range of argyrodite compositions published over the past decade, we demonstrate its broad applicability. Minimizing and equalizing ionic potentials across both sublattices enhances conductivity by reducing the strength of anion-lithium interactions. Our analysis of local environments coordinating Li jumps reveals that balancing high and low-energy pathways is crucial for enabling macroscopic diffusion, supported by investigating percolating pathways. This study highlights the significance of the anionic framework in lithium mobility and informs the design of solid electrolytes for improved energy storage systems.