A Survey of Crowdsourcing Methods for Commonsense Knowledge Collection
I.E.I. Renţea (TU Delft - Electrical Engineering, Mathematics and Computer Science)
G. He – Mentor (TU Delft - Web Information Systems)
U.K. Gadiraju – Mentor (TU Delft - Web Information Systems)
Jie Yang – Mentor (TU Delft - Web Information Systems)
G.J. Houben – Graduation committee member (TU Delft - Web Information Systems)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Commonsense knowledge is information that all humans own and use to interpret common situations and react to them accordingly. This kind of information is necessary for the training of artificial intelligence models to reach a performance as close as possible to human performance. Researchers have developed methods that use crowdsourcing to collect this kind of knowledge from the general public. This research focuses on systematically surveying the existing literature about these methods. We created a taxonomy to describe and compare the existing work based on the following three measures that were the most common ones reported: efficiency, cost, and quality.