Clay brick is one of the major components of demolition waste, which is generally landfilled. Effective and new uses of recycled clay brick may provide sustainability benefits in terms of landfill reduction. Therefore, this research aims at applying Recycled fine clay brick aggregates (RFCBA) with sizes from 0.075 mm–4.75 mm to prepare Self-compacting concrete (SCC). The effects of RFCBA on fresh and hardened properties of SCC were investigated. Saturated surface dry RFCBA was used to replace Natural fine aggregate (NFA) with the percentage of 25%, 50%, 75% and 100%, respectively, in making the SCC mixes. Although experimental results showed that the flowability, passing ability, and segregation resistance of SCC containing RFCBA (RFCBA-SCC) decreased with the increasing RFCBA content, these properties still satisfy the criteria of SCC. The compressive strength, splitting strength, flexural strength, and elastic modulus of the RFCBA-SCC mixes decreased with an increase of RFCBA content. Due to their porous nature, recycled fine clay brick aggregates may also be a source of additional water for internal curing. The internal curing effect was confirmed by the mercury intrusion porosimetry, X-ray diffraction, and thermogravimetric analysis measurements. Moreover, a significant autogenous shrinkage reduction of SCC is achieved by using the RFCBA due to the release of additional water pre-stored in the RFCBA. Therefore, it can be concluded that the addition of RFCBA to SCC mixtures can provide additional practical benefits in the hardened state.