Intent-Aware Diverse Social Image Retrieval
Bo Wang (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Martha Larson – Mentor
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Behind each photographic act is a rationale that impacts the visual appearance
of the resulting photo. Better understanding of this rationale has great
potential to support image retrieval systems in serving user needs. However,
at present, surprisingly little is known about the connection between what
a picture shows (the literally depicted conceptual content) and why that picture
was taken (the photographer intent). In the thesis, we investigate photographer
intent in a large Flickr data set. First, an expert annotator carries
out a large number of iterative intent judgments to create a taxonomy of intent
classes. Next, analysis of the distribution of concepts and intent classes
reveals patterns of independence both at a global and user level. Finally,
we report the results of experiments showing that a deep neural network
classifier is capable of learning to differentiate between these intent classes,
and that these classes support the diversification of image search results.