The Effect of Different Initialization Methods on VAEs for Modeling Cancer using RNA Genome Expressions

Bachelor thesis (2021)

Authors

I.S. Kroskinski Electrical Engineering, Mathematics and Computer Science

Contributors

M.J.T. Reinders Pattern Recognition and Bioinformatics - EEMCS (supervisor 2)
S. Makrodimitris Pattern Recognition and Bioinformatics - EEMCS (supervisor 1)
T.R.M. Abdelaal Pattern Recognition and Bioinformatics - EEMCS (supervisor 1)
M. Charrout Pattern Recognition and Bioinformatics - EEMCS (supervisor 1)
M.A.M.E. Eltager Pattern Recognition and Bioinformatics - EEMCS (supervisor 1)
E. Isufi (coach)
Faculty
Electrical Engineering, Mathematics and Computer Science
Copyright: © 2021 Ivo Kroskinski
Machine Learning VAE RNA Initialization Cancer
More Info
expand_more

Published Date

02-07-2021

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Abstract

Variational Auto-Encoders are a class of machine learning models that have been used in varying context, such as cancer research. Earlier research has shown that initialization plays a crucial part in training these models, since it can increase performance. Therefore, this paper studies the effect initialization methods on VAEs. This research shows that if using only one hidden layer, Uniform methods and Xavier methods perform best depending on the VAE model, where the standard VAE shows the most sensitivity to these methods. But, if using more hidden layers, the uniform method performs significantly worse than a method that uses the number of inputs of the layer such as the default implementation of PyTorch, Xavier Normal or XavierUniform. However, after enough epochs in all other models these initialization methods converge.