This study characterized the morphology, high-temperature property, rheological property, adhesion, cohesion, and chemical component of asphalt binder under aqueous solutions of different pH values. Then the physicochemical properties of asphalt binder were comprehensively evaluated by the improved radar chart. The properties of asphalt binder stripped layer-by-layer were explored to elucidate its gradient damage behaviors. The results indicate that the pH 3 solution reveals the greatest impact on the morphology of 90 asphalt (90 A) and styrene-butadiene-styrene modified asphalt (SBS MA), leading to the wide cracks on 90 A and the network cracks on SBS MA. The comprehensive assessment index of 90 A exposed to pH 3, pH 5, pH 7, pH 9, and pH 11 solutions can be reduced by 20.8%, 20.2%, 1.5%, 14.0%, and 25.5%, respectively. While for SBS MA, its corresponding values variation are 23.2%, 17.7%, 4.6%, 8.7%, and 13.0%, respectively. The acid solutions significantly affect the comprehensive properties of 90 A, but their pH value has little effect. 90 A exposure to the higher pH value of alkali solution reveals the worse comprehensive properties. Acid solute and alkali solute can aggravate the effect of aqueous solution on the comprehensive properties of SBS MA, and the degree of aggravation increases with the increase of solute concentration. The properties of asphalt binders exhibit varied gradient damage behaviors under different solute environments. The most serious damage occurs at 25–50 µm of 90 A and 0–50 µm of SBS MA. This study facilitates an accurate understanding of the mechanism of pavement distresses and composition design and construction utilization of asphalt binders.