Conditionally automated driving requires drivers to resume vehicle control within constrained time budgets upon receiving takeover requests. Accurately predicting drivers’ takeover time (ToT) is essential for dynamically adjusting time budgets to individual needs across scenarios. This study addresses enduring challenges in reliability and interpretability of ToT prediction models by optimizing predictor selection. Using a driving simulator experiment, we examine the relationship between ToT, driver characteristics, and perceived Spare Capacity (pSC, a cognitive construct from Task-Capability Interface theory) using Category Boosting models. Results show that (i) incorporating 13 additional driver characteristics does not significantly improve prediction accuracy when pSC is already considered; and (ii) individual characteristics influence how drivers cognitively process takeover scenarios, and their predictive contribution likely overlaps with pSC. These findings suggest that monitoring cognitive states may be more effective for ToT prediction than extensive profiling of driver characteristics. This study provides a critical first step toward predictive frameworks for adaptive takeover strategies and offers guidance for designing personalized human–vehicle interactions.