Ductal carcinoma in situ (DCIS) may progress to ipsilateral invasive breast cancer (iIBC), but often never will. Because DCIS is treated as early breast cancer, many women with harmless DCIS face overtreatment. To identify features associated with progression, we developed an artificial intelligence-based DCIS morphometric analysis pipeline (AIDmap) on hematoxylin-eosin-stained (H&E) tissue sections. We analyzed 689 digitized H&Es of pure primary DCIS of which 226 were diagnosed with subsequent iIBC and 463 were not. The distribution of 15 duct morphological measurements was summarized in 55 morphometric variables. A ridge regression classifier with cross validation predicted 5-years-free of iIBC with an area-under the curve of 0.67 (95% CI 0.57–0.77). A combined clinical-morphometric signature, characterized by small-sized ducts, a low number of cells and a low DCIS/stroma ratio, was associated with outcome (HR = 0.56; 95% CI 0.28–0.78). AIDmap has potential to identify harmless DCIS that may not need treatment.