A trainable Gaussian color model for determining the color invariant

A trainable Gaussian color model for determining the color invariant

Gioia, Gianpaolo (TU Delft Electrical Engineering, Mathematics and Computer Science)

Lengyel, A. (mentor)
van Gemert, J.C. (mentor)
Marroquim, Ricardo (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2022-01-28

The possibility to improve an existing method by making (part of) it learnable is explored in this research. The work that this research extends added prior knowledge to a Convolutional Neural Network (CNN) to improve its performance when dealing with an illumination shift. The method used for the preprocessing, is the color invariant. The method was used in a zero-domain adaptation setting, where the network is trained without having access to the target domain. The research demonstrated improved performance, motivating further improvements.

The Color Invariant Convolution (CIConv) layer implements the color invariant edge detectors. The layer converts the RGB input of each pixel to spectral differential quotients, which are used to determine the color invariant representation. This is done through two fixed linear transformations that only approximate these values. This indicates that an even better approximation can be obtained by making this transition learnable.

Two methods are used to make this transition learnable; a linear learning method and a non-linear learning method. The linear learning method uses the original transformation but allows for change and the non-linear method replaces the linear transform with a neural network. Both methods show potential for achieving better results than the fixed transformation, but only the linear learning method actually does perform better in a classification experiment. All experiments are done following the zero-shot day to night domain adaptation on a synthetic dataset.

Color Invariants
CNN
Domain Adaptation

http://resolver.tudelft.nl/uuid:5de6c0a4-6617-479a-a886-a4a1ff1fc6dd

Student theses

bachelor thesis

© 2022 Gianpaolo Gioia