Asphalt aging often leads to rapid degradation of road performance, which seriously affects the service life of asphalt pavement. Exploring the influence of asphalt oil sources, asphalt grades, and filler types on asphalt microcharacteristics in the asphalt aging process can provide an essential reference to guide asphalt pavement maintenance. In this study, we selected seven kinds of asphalt and three fillers commonly used in China for research. The pressurized aging vessel (PAV) and homemade ultraviolet (UV) aging equipment were used to perform thermo-oxidative aging and UV aging tests, respectively, of asphalt. The microcharacteristics of asphalt before and after aging were analyzed via attenuated total reflectance fourier transformation infrared spectroscopy and nuclear magnetic resonance ¹H spectroscopy. The results show that the oil source of asphalt exerted the most significant influence on the microcharacteristics of the aged asphalt, while the effect of the asphalt grade was relatively limited. The addition of fillers did not affect the aging mechanism of asphalt. UV and PAV aging generated apparent differences in the changes in the aged asphalt microstructure.