A Domain Decompositionbased CNN Architecture for High-Resolution Image Segmentation

A Domain Decompositionbased CNN Architecture for High-Resolution Image Segmentation

Verburg, Corné (TU Delft Electrical Engineering, Mathematics and Computer Science)

Heinlein, A. (mentor)
Lahaye, D.J.P. (graduation committee)
Vuik, Cornelis (graduation committee)
Cyr, Eric (mentor)

Delft University of Technology

Applied Mathematics

2024-04-09

This thesis addresses the challenge of segmenting ultra-high-resolution images. Limitations of current approaches to segment these are that either detailed spatial contextual information is lost or many redundant computations are necessary. To overcome these issues, we propose a novel approach combining the U-Net architecture with domain decomposition strategies to balance incorporating spatial context and maintaining computational efficiency. Our proposed method partitions input images into non-overlapping patches, each processed independently on a separate device. A communication network facilitates the exchange of information between patches, enhancing the model's understanding of the spatial context.

Through theoretical analysis and practical experimentation on device memory usage during training, we demonstrate that our approach incurs minimal additional memory overhead for inter-device communication. Evaluation on synthetic and realistic datasets, including the Inria Aerial Image and DeepGlobe Satellite Segmentation datasets, demonstrates the effectiveness of our approach. Our model achieves competitive performance compared to the baseline U-Net model, with consistent class predictions around boundaries. Visualization of feature maps highlights the role of the communication network in transferring contextual information. Furthermore, it is shown that our approach remains scalable even when trained on limited subdomains.

In conclusion, our proposed model offers an intuitive solution for segmenting ultra-high-resolution images by effectively incorporating spatial context. Future research could explore variations of our model, such as overlapping subdomains or communication on different levels of the U-Net, to further enhance boundary consistency and information transfer.

CNN
Domain Decomposition
Machine learning
high resolution
image segmentation

http://resolver.tudelft.nl/uuid:17281ec4-7b2a-4362-b4bc-ec2516e3b01a

Student theses

master thesis

© 2024 Corné Verburg