- document
-
Sharifi Noorian, S. (author), Qiu, S. (author), Sayin, Burcu (author), Balayn, A.M.A. (author), Gadiraju, Ujwal (author), Yang, J. (author), Bozzon, A. (author)High-quality data plays a vital role in developing reliable image classification models. Despite that, what makes an image difficult to classify remains an unstudied topic. This paper provides a first-of-its-kind, model-agnostic characterization of image atypicality based on human understanding. We consider the setting of image classification...conference paper 2023
- document
-
Sharifi Noorian, S. (author), Qiu, S. (author), Gadiraju, Ujwal (author), Yang, J. (author), Bozzon, A. (author)Unknown unknowns represent a major challenge in reliable image recognition. Existing methods mainly focus on unknown unknowns identification, leveraging human intelligence to gather images that are potentially difficult for the machine. To drive a deeper understanding of unknown unknowns and more effective identification and treatment, this...conference paper 2022
- document
-
Gupta, A. (author), Basu, D. (author), Ghantasala, Ramya (author), Qiu, S. (author), Gadiraju, Ujwal (author)Trust is an important component of human-AI relationships and plays a major role in shaping the reliance of users on online algorithmic decision support systems. With recent advances in natural language processing, text and voice-based conversational interfaces have provided users with new ways of interacting with such systems. Despite the...conference paper 2022
- document
-
Jung, Ji Youn (author), Qiu, S. (author), Bozzon, A. (author), Gadiraju, Ujwal (author)Conversational agents are being widely adopted across several domains to serve a variety of purposes ranging from providing intelligent assistance to companionship. Recent literature has shown that users develop intuitive folk theories and a metaphorical understanding of conversational agents (CAs) due to the lack of a mental model of the...conference paper 2022
- document
-
Edixhoven, Tom (author), Qiu, S. (author), Kuiper, Lucie (author), Dikken, Olivier (author), Smitskamp, Gwennan (author), Gadiraju, Ujwal (author)In popular crowdsourcing marketplaces like Amazon Mechanical Turk, crowd workers complete tasks posted by requesters in return for monetary rewards. Task requesters are solely responsible for deciding whether to accept or reject submitted work. Rejecting work can directly affect the monetary reward of corresponding workers, and indirectly...conference paper 2021
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)Due to the coronavirus pandemic, remote work from home has rapidly become a necessity around the world, drastically changing the potential landscape for the future of work. Over the last couple of decades, microtask crowdsourcing has emerged as a viable means of carrying out remote online work to earn one’s living — an alternative to traditional...conference paper 2020
- document
-
van Alphen, G.A. (author), Qiu, S. (author), Bozzon, A. (author), Houben, G.J.P.M. (author)In online crowd mapping, crowd workers recruited through crowdsourcing marketplaces collect geographic data. Compared to traditional mapping methods, where workers physically explore the area, the benefit of using online crowd mapping is the potential to be cost-effective and time-efficient. Previous studies have focused on mapping urban objects...conference paper 2020
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author), Houben, G.J.P.M. (author)The trend of remote work leads to the prosperity of crowdsourcing marketplaces. In crowdsourcing marketplaces, online workers can select their preferable tasks and then complete them to get paid, while requesters design and publish tasks to acquire their desirable data. The standard user interface of the crowdsourcing task is the web page,...conference paper 2020
- document
-
Samiotis, I.P. (author), Qiu, S. (author), Mauri, A. (author), Liem, C.C.S. (author), Lofi, C. (author), Bozzon, A. (author)Human annotation is still an essential part of modern transcription workflows for digitizing music scores, either as a standalone approach where a single expert annotator transcribes a complete score, or for supporting an automated Optical Music Recognition (OMR) system. Research on human computation has shown the effectiveness of crowdsourcing...conference paper 2020
- document
-
Qiu, S. (author), Bozzon, A. (author), Gadiraju, Ujwal (author)Searching the web to learn new things or gain knowledge has become a common activity. Recent advances in conversational user interfaces have led to a new research opportunity - that of analyzing the potential of conversational interfaces in improving the effectiveness of search as learning (SAL). Addressing this knowledge gap, in this...conference paper 2020
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)Conversational agents are playing an increasingly important role in providing users with natural communication environments, improving outcomes in a variety of domains in human-computer interaction. Crowdsourcing marketplaces are simultaneously flourishing, and it has never been easier to acquire large-scale human input from online workers....conference paper 2020
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)The rise in popularity of conversational agents has enabled humans to interact with machines more naturally. Recent work has shown that crowd workers in microtask marketplaces can complete a variety of human intelligence tasks (HITs) using conversational interfaces with similar output quality compared to the traditional Web interfaces. In...conference paper 2020
- document
-
Sharifi Noorian, S. (author), Qiu, S. (author), Psyllidis, A. (author), Bozzon, A. (author), Houben, G.J.P.M. (author)Up-to-date listings of retail stores and related building functions are challenging and costly to maintain. We introduce a novel method for automatically detecting, geo-locating, and classifying retail stores and related commercial functions, on the basis of storefronts extracted from street-level imagery. Specifically, we present a deep...conference paper 2020
- document
-
Najafian, S. (author), Herzog, Daniel (author), Qiu, S. (author), Inel, O. (author), Tintarev, N. (author)Most recommender systems propose items to individual users. However, in domains such as tourism, people often consume items in groups rather than individually. Different individual preferences in such a group can be difficult to resolve, and often compromises need to be made. Social choice strategies can be used to aggregate the preferences of...conference paper 2020
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)Information overload is a problem many of us can relate to nowadays. The deluge of user generated content on the Internet, and the easy accessibility to a vast amount of data compounds the problem of remembering and retaining information that is consumed. To make information consumed more memorable, strategies such as note-taking have been found...conference paper 2020
- document
-
Qiu, S. (author), Bozzon, A. (author), Houben, G.J.P.M. (author)This demo presents VirtualCrowd, a simulation platform for crowdsourcing campaigns. The platform allows the design, configuration, step-by-step execution, and analysis of customized tasks, worker profiles, and crowdsourcing strategies. The platform will be demonstrated through a crowd-mapping example in two cities, which will highlight the...conference paper 2020
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)This demo presents TickTalkTurk, a tool that can assist task requesters in quickly deploying crowdsourcing tasks in a customizable conversational worker interface. The conversational worker interface can convey task instructions, deploy microtasks, and gather worker input in a dialogue-based workflow. The interface is implemented as a Web...conference paper 2020
- document
-
Mavridis, P. (author), Huang, Owen (author), Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)Conversational interfaces can facilitate human-computer interactions. Whether or not conversational interfaces can improve worker experience and work quality in crowdsourcing marketplaces has remained unanswered. We investigate the suitability of text-based conversational interfaces for microtask crowdsourcing. We designed a rigorous...conference paper 2019
- document
-
Qiu, S. (author), Psyllidis, A. (author), Bozzon, A. (author), Houben, G.J.P.M. (author)Knowledge about the organization of the main physical elements (e.g. streets) and objects (e.g. trees) that structure cities is important in the maintenance of city infrastructure and the planning of future urban interventions. In this paper, a novel approach to crowd-mapping urban objects is proposed. Our method capitalizes on strategies for...conference paper 2019
- document
-
Tintarev, N. (author), Sullivan, Emily (author), Guldin, Dror (author), Qiu, S. (author), Odjik, Daan (author)Recommender systems for news articles on social media select and filter content through automatic personalization. As a result, users are often unaware of opposing points of view, leading to informational blindspots and potentially polarized opinions. They may be aware of a topic, but only be exposed to one viewpoint on this topic. However,...conference paper 2018