Railway ballasted track stiffness is an important indicator to identify supporting condition that ensures that the facility is well designed and functioned. Although many studies have been performed on track stiffness based on experimental tests and finite-element methods, the factors influencing the track stiffness have not been completely confirmed yet, especially the influences from ballast and subgrade layers at the mesoscopic level. To address this research gap, a combination of the discrete element method and the finite difference method model was utilized to study the factors influencing the track stiffness from the particle level. Factors (related to ballast layer properties) are bulk density, thickness, and stiffness, and another factor (related to subgrade properties) is elastic modulus. Additionally, the relationship between the track stiffness and the mechanical behavior of ballast was analyzed. This study quantified the influences of track components on the track stiffness and accordingly proposed how to improve it from the ballast and subgrade layers at the mesoscopic level, which can provide guidance for railway ballasted track design and maintenance. @en