Great Chain of Agents: The Role of Metaphorical Representation of Agents in Conversational Crowdsourcing

Conversational agents are being widely adopted across several domains to serve a variety of purposes ranging from providing intelligent assistance to companionship. Recent literature has shown that users develop intuitive folk theories and a metaphorical understanding of conversational agents (CAs) due to the lack of a mental model of the...

Conversational Crowdsourcing

Crowdsourcing has become a standard approach for the collection of the human input required by scientists and practitioners alike to execute their experiments, or to train, control, and verify the behavior of their intelligent systems. Despite years of successful research and industrial application, how to improve the engagement and satisfaction...

Conversation Workflows with Micro-breaks in Conversational Crowdsourcing

With the growing popularity of conversational interfaces, new use-cases in which conversation may be an effective medium for human-computer interaction are explored. Recent works have shown how conversational interfaces can improve worker engagement in micro-task crowdsourcing and that task performance is comparable to web-based interfaces. This...

Remote Work Aided by Conversational Agents

Due to the coronavirus pandemic, remote work from home has rapidly become a necessity around the world, drastically changing the potential landscape for the future of work. Over the last couple of decades, microtask crowdsourcing has emerged as a viable means of carrying out remote online work to earn one’s living — an alternative to traditional...

Just the right mood for HIT!: Analyzing the role of worker moods in conversational microtask crowdsourcing

Conversational agents are playing an increasingly important role in providing users with natural communication environments, improving outcomes in a variety of domains in human-computer interaction. Crowdsourcing marketplaces are simultaneously flourishing, and it has never been easier to acquire large-scale human input from online workers....

Crowdsourced Knowledge Base Construction using Text-Based Conversational Agents

Knowledge Base Construction (KBC) is a challenging and complex task involving several substeps and many experts of a knowledge domain. Crowdsourcing approach has been used to support KBC with promising scalability and output quality, but to enable even more people to participate in KBC, there is a need to broaden the pool of workers beyond the...

Effective crowdsourced generation of training data for chatbots natural language understanding

Chatbots are text-based conversational agents. Natural Language Understanding (NLU) models are used to extract meaning and intention from user messages sent to chatbots. The user experience of chatbots largely depends on the performance of the NLU model, which itself largely depends on the initial dataset the model is trained with. The training...