Multitask Learning for Joint Semantic Segmentation and Classification of Ovarian Lesions in Ultrasound Scans
D.Z. Rogmans (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Nergis Tömen – Mentor (TU Delft - Pattern Recognition and Bioinformatics)
Jan C. van Gemert – Mentor (TU Delft - Pattern Recognition and Bioinformatics)
Ricardo Marroquim – Graduation committee member (TU Delft - Computer Graphics and Visualisation)
J. Dijkstra – Mentor (TU Delft - Biomechanical Engineering)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Distinguishing between benign and malignant ovarian cysts is a challenging task that depends on subjective visual markers in ultrasound scans. Current manual methods remain prone to costly misdiagnoses and the application of these methods depend heavily on the clinician's level of expertise. Recent research demonstrates promising applications of Convolutional Neural Networks (CNNs) for ovarian tumor classification; however, we observed that their performance is limited when applied to a diverse and complex dataset. To address this, we propose, implement, and evaluate three improvements to a baseline classifier.
First, we use a deep learning-based approach to remove burned-in medical annotations and introduce a weighted mean squared error (MSE) loss to improve its effectiveness by emphasizing relevant regions. This aims to better recover the original image content prior to annotation and remove annotations which can act as confounders. Second, we enhance classification by fusing image features with two readily available clinical factors at an intermediate stage of the network. Third, and central to this study, we incorporate a segmentation path that acts as a regularizer, encouraging the shared encoder to learn lesion-specific features that benefit the classification head.
These three contributions are informed by domain-specific knowledge of ovarian lesions and collectively demonstrate promising directions for improving deep learning-based models in this setting.