A study of the impact of CNN architecture variation on predicting brain activity using feature-weighted receptive fields
V. Murgoci (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Xucong Zhang – Mentor (TU Delft - Pattern Recognition and Bioinformatics)
Nergis Tömen – Graduation committee member (TU Delft - Pattern Recognition and Bioinformatics)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
This study investigates the relationship between deep learning models and the human brain, specifically focusing on the prediction of brain activity in response to static visual stimuli using functional magnetic resonance imaging (fMRI). By leveraging intermediate outputs of pre-trained convolutional neural networks (CNNs) with feature-weighted receptive fields, it becomes possible to estimate brain activity in the visual cortex. The primary objective of this research is to analyze how different CNN architectures affect the accuracy of predicting brain activity. To accomplish this, we utilize the novel fMRI Natural Scenes Dataset, which provides a large-scale data set for comprehensive analysis. Through this investigation, we aim to gain insights into the impact of CNN architectures on the prediction accuracy of brain activity in the context of visual stimuli.