- document
-
Demartini, Gianluca (author), Sadiq, Shazia (author), Yang, J. (author)This Special Issue of the Journal of Data and Information Quality (JDIQ) contains novel theoretical and methodological contributions on data curation involving humans in the loop. In this editorial, we summarize the scope of the issue and briefly describe its content.contribution to periodical 2024
- document
-
Allen, G.M. (author), Hu, Andrea (author), Gadiraju, Ujwal (author)Crowdsourcing is a valuable tool to gather human input which enables the development of reliable artificial intelligence systems. Microtask platforms like Prolific and Amazon's Mechanical Turk have flourished by creating environments where crowd workers can provide such human input in a diverse and representative manner. Such marketplaces...conference paper 2023
- document
- Yang, J. (author), Bozzon, A. (author), Gadiraju, Ujwal (author), Lease, Matthew (author) contribution to periodical 2023
- document
-
Lammerts, Philippe (author), Lippmann, P. (author), Hsu, Yen Chia (author), Casati, Fabio (author), Yang, J. (author)Hate speech moderation remains a challenging task for social media platforms. Human-AI collaborative systems offer the potential to combine the strengths of humans' reliability and the scalability of machine learning to tackle this issue effectively. While methods for task handover in human-AI collaboration exist that consider the costs of...conference paper 2023
- document
-
Mesbah, Sepideh (author), Arous, Ines (author), Yang, J. (author), Bozzon, A. (author)Evaluating design ideas is necessary to predict their success and assess their impact early on in the process. Existing methods rely either on metrics computed by systems that are effective but subject to errors and bias, or experts' ratings, which are accurate but expensive and long to collect. Crowdsourcing offers a compelling way to...conference paper 2023
- document
-
Lammerts, Philippe (author)Hate speech detection on social media platforms remains a challenging task. Manual moderation by humans is the most reliable but infeasible, and machine learning models for detecting hate speech are scalable but unreliable as they often perform poorly on unseen data. Therefore, human-AI collaborative systems, in which we combine the strengths of...master thesis 2022
- document
-
Kleinhans, R.J. (author), Falco, Enzo (author)Over time, urban planning scholars have studied ways to improve communication and collaboration between ‘experts’ and the ‘public’ in planning processes. Social media and the web 2.0 have strongly affected governments’ communication with citizens. The growth of public participation, Geographic Information Systems and geo-visualisation interfaces...book chapter 2022
- document
-
Draws, T.A. (author), Inel, O. (author), Tintarev, N. (author), Baden, Christian (author), Timmermans, Benjamin (author)Research in the area of human information interaction (HII) typically represents viewpoints on debated topics in a binary fashion, as either against or in favor of a given topic (e.g., the feminist movement). This simple taxonomy, however, greatly reduces the latent richness of viewpoints and thereby limits the potential of research and...conference paper 2022
- document
-
Samiotis, I.P. (author), Lofi, C. (author), Alaka, Shaad (author), Liem, C.C.S. (author), Bozzon, A. (author)In this demo we present Scriptoria, an online crowdsourcing system to tackle the complex transcription process of classical orchestral scores. The system’s requirements are based on experts’ feedback from classical orchestra members. The architecture enables an end- to-end transcription process (from PDF to MEI) using a scalable microtask design...conference paper 2022
- document
-
Kooijman, Bram (author)Previous research showed that perceived risk is an important psychological determinant of road user behaviour and accident prevalence. However, little knowledge exists about how objective in-scene features affect a driver’s perceived risk in interactions with pedestrians. This crowdsourcing study tries to fill this research gap. A total of 1082...master thesis 2021
- document
-
van Zuijlen, M.J.P. (author)The world around us is filled with materials. Our ability of visual material perception informs us how to navigate and interact with our environment. It tells us, for example, whether food is fresh, if a chair is strong enough to sit on, how much force to use to pick up a glass, etc. Painters have studied how to depict the world and the...doctoral thesis 2021
- document
-
Kalia, Neha (author)The manual process of collecting and labelling data required for machine learning tasks is labour-intensive, expensive, and time consuming. In the past, efforts have been made to crowdsource this data by either offering people monetary incentives, or by using a gamified approach where users contribute to databases as a side-effect of playing an...bachelor thesis 2021
- document
-
van den Haak, Daniel (author)Lane change decision-making is an important challenge for automated vehicles, urging the need for high performance algorithms that are able to handle complex traffic situations. Deep reinforcement learning (DRL), a machine learning method based on artificial neural networks, has recently become a popular choice for modelling the lane change...master thesis 2021
- document
-
Edixhoven, Tom (author), Qiu, S. (author), Kuiper, Lucie (author), Dikken, Olivier (author), Smitskamp, Gwennan (author), Gadiraju, Ujwal (author)In popular crowdsourcing marketplaces like Amazon Mechanical Turk, crowd workers complete tasks posted by requesters in return for monetary rewards. Task requesters are solely responsible for deciding whether to accept or reject submitted work. Rejecting work can directly affect the monetary reward of corresponding workers, and indirectly...conference paper 2021
- document
-
Nouri, Zahra (author), Gadiraju, Ujwal (author), Engels, Gregor (author), Wachsmuth, Henning (author)Designing tasks clearly to facilitate accurate task completion is a challenging endeavor for requesters on crowdsourcing platforms. Prior research shows that inexperienced requesters fail to write clear and complete task descriptions which directly leads to low quality submissions from workers. By complementing existing works that have aimed...conference paper 2021
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Birk, Max V. (author), Bozzon, A. (author)The future of crowd work has been identified to depend on worker satisfaction, but we lack a thorough understanding of how worker satisfaction can be increased in microtask crowdsourcing. Prior work has shown that one solution is to build tasks that are engaging. To facilitate engagement, two methods that have received attention in recent HCI...journal article 2021
- document
-
Sripada, Anirudh (author), Bazilinskyy, P. (author), de Winter, J.C.F. (author)It may be necessary to introduce new modes of communication between automated vehicles (AVs) and pedestrians. This research proposes using the AV’s lateral deviation within the lane to communicate if the AV will yield to the pedestrian. In an online experiment, animated video clips depicting an approaching AV were shown to participants. Each...journal article 2021
- document
-
Chen, Jieyu (author), Saunders, K.R. (author), Whan, Kirien (author)Wind observations collected at citizen weather stations (CWSs) could be an invaluable resource in climate and meteorology studies, yet these observations are underutilised because scientists do not have confidence in their quality. These wind speed observations have systematic biases, likely caused by improper instrumentation and station...journal article 2021
- document
-
Bazilinskyy, P. (author), Dodou, D. (author), de Winter, J.C.F. (author)Future automated vehicles may be equipped with external human-machine interfaces (eHMIs) capable of signaling to pedestrians whether or not they can cross the road. There is currently no consensus on the correct colors for eHMIs. Industry and academia have already proposed a variety of eHMI colors, including red and green, as well as colors...conference paper 2020
- document
-
Bazilinskyy, P. (author), Eisma, Y.B. (author), Dodou, D. (author), de Winter, J.C.F. (author)Objective: Research has shown that perceived risk is a vital variable in the understanding of road traffic safety. Having experience in a particular traffic environment can be expected to affect perceived risk. More specifically, drivers may readily recognize traffic hazards when driving in their own world region, resulting in high perceived...journal article 2020