Chatterbox

Conversational Interfaces for Microtask Crowdsourcing

Conference Paper (2019)
Author(s)

P. Mavridis (TU Delft - Web Information Systems)

Owen Huang (Student TU Delft)

Sihang Qui (TU Delft - Web Information Systems)

Ujwal Gadiraju (Leibniz Universität)

A Bozzon (TU Delft - Web Information Systems, TU Delft - Human-Centred Artificial Intelligence)

Research Group
Web Information Systems
Copyright
© 2019 P. Mavridis, Owen Huang, S. Qiu, Ujwal Gadiraju, A. Bozzon
DOI related publication
https://doi.org/10.1145/3320435.3320439
More Info
expand_more
Publication Year
2019
Language
English
Copyright
© 2019 P. Mavridis, Owen Huang, S. Qiu, Ujwal Gadiraju, A. Bozzon
Research Group
Web Information Systems
Pages (from-to)
243-251
ISBN (print)
978-1-4503-6021-0
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Conversational interfaces can facilitate human-computer interactions. Whether or not conversational interfaces can improve worker experience and work quality in crowdsourcing marketplaces has remained unanswered. We investigate the suitability of text-based conversational interfaces for microtask crowdsourcing. We designed a rigorous experimental campaign aimed at gauging the interest and acceptance by crowdworkers for this type of work interface. We compared Web and conversational interfaces for five common microtask types and measured the execution time, quality of work, and the perceived satisfaction of 316 workers recruited from the FigureEight platform. We show that conversational interfaces can be used effectively for crowdsourcing microtasks, resulting in a high satisfaction from workers, and without having a negative impact on task execution time or work quality.

Files

3320435.3320439.pdf
(pdf | 2.57 Mb)
- Embargo expired in 23-03-2023
License info not available