Integrating radar and multi-spectral data to detect cocoa crops: a deep learning approach
A.M. Therias (TU Delft - Architecture and the Built Environment)
Azarakhsh Rafiee – Mentor (TU Delft - Digital Technologies)
Stef Lhermitte – Graduation committee member (TU Delft - Mathematical Geodesy and Positioning)
Philip van der Lugt – Graduation committee member (Meridia Land B.V.)
More Info
expand_more
Github repository (data preparation and model training)
https://github.com/atherias/cocoa_detection_thesis/Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
The production of cocoa beans contributes to 7.5% of European Union (EU) driven deforestation. For this reason, the recent European Union Deforestation-free Regulation (EUDR) requires producers to perform comprehensive tracking of cocoa farm extents. However, cocoa crops present unique detection challenges due to their complex canopy structure, spectral similarity to forest, variable farming methods, and location in frequently cloudy regions. Previous work employs Multispectral Imagery (MSI) and/or Synthetic Aperture Radar (SAR) for pixel-based classification of satellite images. Convolutional Neural Network (CNN)s offer
a promising approach to semantic segmentation of cocoa parcels that considers = both spectral and spatial characteristics. This thesis aims to evaluate the impact of combining SAR and MSI data in the training of a CNN for cocoa detection, in order to demonstrate the importance of texture, moisture and canopy characteristics in identifying cocoa canopies. A U-NET is employed to evaluate
how prediction results are impacted by the stacking of MSI datasets with different SAR polarizations, seasons and temporality. The results show that the addition of single-day and temporal SAR to a single-day MSI image can improve the predictions, reaching an F1 score of 86.62%. This research demonstrates the influence of SAR measurement season and polarization, and ground truth classes, on the semantic segmentation of cocoa.