Crowd vs. Experts

Nichesourcing for knowledge intensive tasks in cultural heritage

Conference Paper (2014)
Author(s)

Jasper Oosterman (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Alessandro Bozzon (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Geert Jan Houben (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Archana Nottamkandath (Vrije Universiteit Amsterdam)

Chris Dijkshoorn (Vrije Universiteit Amsterdam)

Lora Aroyo (Vrije Universiteit Amsterdam)

Mieke H R Leyssen (Centrum Wiskunde & Informatica (CWI))

Myriam C. Traub (Centrum Wiskunde & Informatica (CWI))

Research Group
Support Software Technology
DOI related publication
https://doi.org/10.1145/2567948.2576960 Final published version
More Info
expand_more
Publication Year
2014
Language
English
Research Group
Support Software Technology
Pages (from-to)
567-568
ISBN (electronic)
9781450327459
Event
23rd International Conference on World Wide Web, WWW 2014 (2014-04-07 - 2014-04-11), Seoul, Korea, Republic of
Downloads counter
170

Abstract

The results of our exploratory study provide new insights to crowdsourcing knowledge intensive tasks. We designed and performed an annotation task on a print collection of the Rijksmuseum Amsterdam, involving experts and crowd workers in the domain-specific description of depicted ow- ers. We created a testbed to collect annotations from ower experts and crowd workers and analyzed these in regard to user agreement. The findings show promising results, demonstrating how, for given categories, nichesourcing can provide useful annotations by connecting crowdsourcing to domain expertise.