Elucidating the population dynamics of correlated electron-hole pairs (bound excitons) in semiconducting quantum dots (QDs) is key for developing our fundamental understanding of nanoscale photophysics as well as for the optimal design of devices, such as lasers. For decades, it was assumed that holes did not contribute to band edge bleach signals in QDs. Here, we employ two-dimensional electronic spectroscopy to monitor electron and hole dynamics in both CdSe and CdSe/CdS/ZnS QDs to probe electron and hole dynamics. Based on a combination of time and frequency resolution, we observe a previously unresolved bleaching signal in CdSe QDs on timescales faster than 30 fs due to hole cooling. Atomistic semiempirical pseudopotential calculations are used to rationalize the order of magnitude difference in the observed hole dynamics in CdSe and CdSe/CdS/ZnS QDs. This picture advances our understanding of QD excitonics past the prevailing continuum effective mass theories generally used to describe QD electronic structure and dynamics.