The origin and limit of asymmetric transmission in chiral resonators