Benchmarking the hyper-parameter sensitivity of VAE models for cancer treatment
A. Korkić (TU Delft - Electrical Engineering, Mathematics and Computer Science)
S. Makrodimitris – Mentor (TU Delft - Pattern Recognition and Bioinformatics)
T. Abdelaal – Mentor (TU Delft - Pattern Recognition and Bioinformatics)
M. Charrout – Mentor (TU Delft - Pattern Recognition and Bioinformatics)
M.A.M.E. Eltager – Mentor (TU Delft - Pattern Recognition and Bioinformatics)
MJT Reinders – Graduation committee member (TU Delft - Pattern Recognition and Bioinformatics)
E. Isufi – Coach (TU Delft - Multimedia Computing)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Cancer has been known as a deadly and complex disease to tackle. By applying machine learning algorithms we hope to improve personalized treatment for cancer patients. These machine learning algorithms are trying to learn a (latent) representation of the input. The problem is that this representation is hard to interpret and to observe the actual connections between the input and the output. That is why these algorithms are considered to behave like a black-box. In this research, a benchmark is conducted to measure how sensitive these algorithms are to changes in their hyper-parameters. The focus of this experiment are different types of variational auto encoders. We will measure how sensitive they are to changes in their: latent space dimension, learning rate and type of optimizer. The models will be trained on a dataset that contains the RNA gene-expression of different types of cancer tissues. To conclude that the optimizer may play the most important role performance wise for VAE models. Using the optimizer Adam and RMSprop results overall in lower reconstruction loss and overall in a more consistent performance.