The Effect of Different Initialization Methods on VAEs for Modeling Cancer using RNA Genome Expressions

The Effect of Different Initialization Methods on VAEs for Modeling Cancer using RNA Genome Expressions

Kroskinski, Ivo (TU Delft Electrical Engineering, Mathematics and Computer Science)

Reinders, M.J.T. (graduation committee)
Makrodimitris, S. (mentor)
Abdelaal, T.R.M. (mentor)
Charrout, M. (mentor)
Eltager, M.A.M.E. (mentor)
Isufi, E. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2021-07-02

Variational Auto-Encoders are a class of machine learning models that have been used in varying context, such as cancer research. Earlier research has shown that initialization plays a crucial part in training these models, since it can increase performance. Therefore, this paper studies the effect initialization methods on VAEs. This research shows that if using only one hidden layer, Uniform methods and Xavier methods perform best depending on the VAE model, where the standard VAE shows the most sensitivity to these methods. But, if using more hidden layers, the uniform method performs significantly worse than a method that uses the number of inputs of the layer such as the default implementation of PyTorch, Xavier Normal or XavierUniform. However, after enough epochs in all other models these initialization methods converge.

VAE
Initialization
Cancer
RNA
Machine Learning

http://resolver.tudelft.nl/uuid:f0b67b91-0469-4fa6-84a5-d7084dcc7d5a

Student theses

bachelor thesis

© 2021 Ivo Kroskinski