Terminal blend rubberized asphalt (TBRA) is widely used as binder of asphalt mixtures due to its technical characteristics of storage stability. However, its road performance deteriorates due to the aging process of TBRA. The purpose of this study is to evaluate the aging characteristics of TBRA binders containing 0%, 5%, 10%, 15%, and 20% content of crumb rubber (CR) by weight of the neat binder. All the binders were treated with rolling thin-film oven test (RTFOT) and pressure aging vessel (PAV), respectively. The chemical compositional changes were monitored by attenuated total reflection (ATR)-Fourier transform infrared spectroscopy (FTIR), and physical and rheological properties were tested on neat asphalt and TBRA binders. FTIR test results show that TBRA binders offer greater long-term aging resistance than the neat asphalt binder, and E10TB (10% by weight CR) exhibits the highest long-term aging resistance. With the increase of CR, the temperature sensitivity property of the TBRA binders increases, whereas their high-temperature stability decreases. After PAV aging, blending CRs into neat asphalt causes a higher phase angle aging index and Jnr aging index, and lower critical temperature aging index, complex modulus aging index, softening point increment, and rutting factor aging index, indicating their superior long-term aging resistance. Moreover, based on the correlation analysis, the critical temperature aging index (CTAI) has a good linear relationship with the physical aging index (SPI) and chemical aging index (δICA).