- document
-
Rieger, A. (author), Draws, T.A. (author), Mattis, Nicolas (author), Maxwell, David (author), Elsweiler, David (author), Gadiraju, Ujwal (author), McKay, Dana (author), Bozzon, A. (author), Pera, M.S. (author)Web search has evolved into a platform people rely on for opinion formation on debated topics. Yet, pursuing this search intent can carry serious consequences for individuals and society and involves a high risk of biases. We argue that web search can and should empower users to form opinions responsibly and that the information retrieval...conference paper 2024
- document
-
Oppenlaender, Jonas (author), Abbas, T. (author), Gadiraju, Ujwal (author)Pilot studies are an essential cornerstone of the design of crowdsourcing campaigns, yet they are often only mentioned in passing in the scholarly literature. A lack of details surrounding pilot studies in crowdsourcing research hinders the replication of studies and the reproduction of findings, stalling potential scientific advances. We...journal article 2024
- document
-
Allen, G.M. (author), Beijen, M.F. (author), Maxwell, D.M. (author), Gadiraju, Ujwal (author)Time constraints are commonplace in our daily lives. While literature in recent years from the Information Retrieval (IR) community has increased our understanding of the effects of time constraints on search, practical effects on search outcomes have rarely been evaluated. Little is known about how different search interfaces influence search...conference paper 2023
- document
-
Moilanen, Joonas (author), van Berkel, Niels (author), Visuri, Aku (author), Gadiraju, Ujwal (author), van der Maden, W.L.A. (author), Hosio, Simo (author)Good mental health is imperative for one’s wellbeing. While clinical mental disorder treatments exist, self-care is an essential aspect of mental health. This paper explores the use and perceived trust of conversational agents, chatbots, in the context of crowdsourced self-care through a between-subjects study (N = 80). One group used a...journal article 2023
- document
-
He, G. (author), Buijsman, S.N.R. (author), Gadiraju, Ujwal (author)AI systems are increasingly being used to support human decision making. It is important that AI advice is followed appropriately. However, according to existing literature, users typically under-rely or over-rely on AI systems, and this leads to sub-optimal team performance. In this context, we investigate the role of stated system accuracy...journal article 2023
- document
-
Ma, Yao (author), Abbas, T. (author), Gadiraju, Ujwal (author)Crowd-powered conversational systems (CPCS) solicit the wisdom of crowds to quickly respond to on-demand users' needs. The very factors that make this a viable solution - -such as the availability of diverse crowd workers on-demand - - also lead to great challenges. The ever-changing pool of online workers powering conversations with...conference paper 2023
- document
-
Salimzadeh, S. (author), He, G. (author), Gadiraju, Ujwal (author)Recent advances in the performance of machine learning algorithms have led to the adoption of AI models in decision making contexts across various domains such as healthcare, finance, and education.Different research communities have attempted to optimize and evaluate human-AI team performance through empirical studies by increasing...conference paper 2023
- document
-
Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI SystemsHe, G. (author), Kuiper, L.A. (author), Gadiraju, Ujwal (author)The dazzling promises of AI systems to augment humans in various tasks hinge on whether humans can appropriately rely on them. Recent research has shown that appropriate reliance is the key to achieving complementary team performance in AI-assisted decision making. This paper addresses an under-explored problem of whether the Dunning-Kruger...conference paper 2023
- document
-
Jung, Ji-Youn (author), Murray-Rust, D.S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)When creating conversational agents, designers have to make decisions about the way the agents present themselves. In this position paper, we identify and synthesize ethical dilemmas that conversational interface designers and researchers face around gender of conversational agents. First, we identify three layers that cause tension in designing...conference paper 2023
- document
-
Balayn, A.M.A. (author), Yurrita Semperena, M. (author), Yang, J. (author), Gadiraju, Ujwal (author)Fairness toolkits are developed to support machine learning (ML) practitioners in using algorithmic fairness metrics and mitigation methods. Past studies have investigated practical challenges for toolkit usage, which are crucial to understanding how to support practitioners. However, the extent to which fairness toolkits impact practitioners’...conference paper 2023
- document
-
Boonprakong, Nattapat (author), He, G. (author), Gadiraju, Ujwal (author), Van Berkel, Niels (author), Wang, Danding (author), Chen, Si (author), Liu, Jiqun (author), Tag, Benjamin (author), Goncalves, Jorge (author), Dingler, Tilman (author)AI systems are increasingly incorporated into human decision-making. Yet, human decision-makers are often affected by their cognitive biases. In critical settings, such as medical diagnosis, criminal judgment, or information consumption, these cognitive biases hinder optimal decision outcomes, thereby resulting in dangerous decisions and...conference paper 2023
- document
-
Sharifi Noorian, S. (author), Qiu, S. (author), Sayin, Burcu (author), Balayn, A.M.A. (author), Gadiraju, Ujwal (author), Yang, J. (author), Bozzon, A. (author)High-quality data plays a vital role in developing reliable image classification models. Despite that, what makes an image difficult to classify remains an unstudied topic. This paper provides a first-of-its-kind, model-agnostic characterization of image atypicality based on human understanding. We consider the setting of image classification...conference paper 2023
- document
- Yang, J. (author), Bozzon, A. (author), Gadiraju, Ujwal (author), Lease, Matthew (author) contribution to periodical 2023
- document
-
Nouri, Zahra (author), Prakash, Nikhil (author), Gadiraju, Ujwal (author), Wachsmuth, Henning (author)Quality control is an, if not the, essential challenge in crowdsourcing. Unsatisfactory responses from crowd workers have been found to particularly result from ambiguous and incomplete task descriptions, often from inexperienced task requesters. However, creating clear task descriptions with sufficient information is a complex process for...conference paper 2023
- document
-
Gadiraju, Ujwal (author), Abbas, T. (author), Allen, G.M. (author)Conversational User Interfaces (CUIs) have been argued to have advantages over traditional GUIs due to having a more human-like interaction. The growing popularity of conversational agents has enabled humans to interact with machines more naturally. There is an increasing familiarity among people with conversational interactions mediated by...conference paper 2023
- document
-
Allen, G.M. (author), Hu, Andrea (author), Gadiraju, Ujwal (author)Crowdsourcing is a valuable tool to gather human input which enables the development of reliable artificial intelligence systems. Microtask platforms like Prolific and Amazon's Mechanical Turk have flourished by creating environments where crowd workers can provide such human input in a diverse and representative manner. Such marketplaces...conference paper 2023
- document
-
Samiotis, I.P. (author), Qiu, S. (author), Lofi, C. (author), Yang, J. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)Music content annotation campaigns are common on paid crowdsourcing platforms. Crowd workers are expected to annotate complex music artifacts, a task often demanding specialized skills and expertise, thus selecting the right participants is crucial for campaign success. However, there is a general lack of deeper understanding of the distribution...journal article 2022
- document
-
Salimzadeh, S. (author), Gadiraju, Ujwal (author), Hauff, C. (author), van Deursen, A. (author)Natural Language Interfaces to Databases (NLIDB), also known as Text-to-SQL models, enable users with different levels of knowledge in Structured Query Language (SQL) to access relational databases without any programming effort. By translating natural languages into SQL query, not only do NLIDBs minimize the burden of memorizing the schema...conference paper 2022
- document
-
Erlei, Alexander (author), Das, Richeek (author), Meub, Lukas (author), Anand, A. (author), Gadiraju, Ujwal (author)As algorithms are increasingly augmenting and substituting human decision-making, understanding how the introduction of computational agents changes the fundamentals of human behavior becomes vital. This pertains to not only users, but also those parties who face the consequences of an algorithmic decision. In a controlled experiment with 480...conference paper 2022
- document
-
Robbemond, Vincent (author), Inel, Oana (author), Gadiraju, Ujwal (author)Advances in artificial intelligence and machine learning have led to a steep rise in the adoption of AI to augment or support human decision-making across domains. There has been an increasing body of work addressing the benefits of model interpretability and explanations to help end-users or other stakeholders decipher the inner workings of...conference paper 2022