CrowdCO-OP: Sharing Risks and Rewards in Crowdsourcing

Paid micro-task crowdsourcing has gained in popularity partly due to the increasing need for large-scale manually labelled datasets which are often used to train and evaluate Artificial Intelligence systems. Modern paid crowdsourcing platforms use a piecework approach to rewards, meaning that workers are paid for each task they complete, given...

TaskGenie: Crowd-Powered Task Generation for Struggling Search

Search tasks provide a medium for the evaluation of system performance and the underlying analytical aspects of IR systems. Researchers have recently developed new interfaces or mechanisms to support vague information needs and struggling search. However, little attention has been paid to the generation of a unified task set for evaluation...

How do user opinions influence their interaction with web search results?

Understanding the influence of users' opinions on their search behavior together with their inherent biases in web search has garnered widespread interest in recent times. This is largely due to the implications of promoting critical thinking, explaining phenomena such as political polarization, or the manifestation of echo chambers. It is...

Editorial: User Modeling and Recommendations