Identification of subjects from reconstructed images

Identification of subjects from reconstructed images: Identification of individual subjects based on image reconstructions generated from fMRI brain scans

Mercier, Arthur (TU Delft Electrical Engineering, Mathematics and Computer Science)

Zhang, X. (mentor)
Tömen, N. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2023-06-27

Reconstructing seen images from functional magnetic resonance imaging (fMRI) brain scans has been a growing topic of interest in the field of neuroscience, fostered by innovation in machine learning and AI. This paper investigates the possible presence of personal features allowing the identification of subjects from their reconstructed images. Identifying the extent to which personal information is present is necessary to prevent privacy and data protection breaches. Additionally, personal features may reveal information about how people see the world, furthering work in computer-brain interfacing or helping people with neurological conditions that affect sight. In this paper, a CNN model is presented that allows to identify subjects from their reconstructed image with an average accuracy of 90.4%. An encoder-decoder model was used to produce the reconstructed images from the Generic Object Data set. The accuracy shows that personal features are indeed present in the reconstructed images, raising important ethical and legal considerations when using image reconstruction technology.

Visual stimulus reconstruction
fMRI
Generic Object Decoding
Subject identification
Personal data
Privacy

http://resolver.tudelft.nl/uuid:0b585466-cd6d-48f9-a093-5a6c5f83d27b

Student theses

bachelor thesis

© 2023 Arthur Mercier