Circular Image

U.K. Gadiraju

82 records found

Plan-Then-Execute

An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistant

Since the explosion in popularity of ChatGPT, large language models (LLMs) have continued to impact our everyday lives. Equipped with external tools that are designed for a specific purpose (e.g., for flight booking or an alarm clock), LLM agents exercise an increasing capability ...

DECI

The 3rd Tutorial on Designing Effective Conversational Interfaces

Advances in generative AI and the widespread proliferation of LLM-based applications have created a number of opportunities for designing effective and intelligent human-AI interfaces. Conversational User Interfaces (CUIs) have enabled humans to interact with machines more natura ...

Towards Effective Human Intervention in Algorithmic Decision-Making

Understanding the Effect of Decision-Makers' Configuration on Decision-Subjects' Fairness Perceptions

Human intervention is claimed to safeguard decision-subjects’ rights in algorithmic decision-making and contribute to their fairness perceptions. However, how decision-subjects perceive hybrid decision-maker configurations (i.e., combining humans and algorithms) is unclear. We ad ...

Unpacking Trust Dynamics in the LLM Supply Chain

An Empirical Exploration to Foster Trustworthy LLM Production & Use

Research on trust in AI is limited to several trustors (e.g., end-users) and trustees (especially AI systems), and empirical explorations remain in laboratory settings, overlooking factors that impact trust relations in the real world. Here, we broaden the scope of research by ac ...
Recent advances in generative AI have precipitated a proliferation of novel writing assistants. These systems typically rely on multilingual large language models (LLMs), providing globalized workers the ability to revise or create diverse forms of content in different languages. ...

Is Conversational XAI All You Need?

Human-AI Decision Making With a Conversational XAI Assistant

Explainable artificial intelligence (XAI) methods are being proposed to help interpret and understand how AI systems reach specific predictions. Inspired by prior work on conversational user interfaces, we argue that augmenting existing XAI methods with conversational user interf ...

The State of Pilot Study Reporting in Crowdsourcing

A Reflection on Best Practices and Guidelines

Pilot studies are an essential cornerstone of the design of crowdsourcing campaigns, yet they are often only mentioned in passing in the scholarly literature. A lack of details surrounding pilot studies in crowdsourcing research hinders the replication of studies and the reproduc ...
The ability to make appropriate delegation decisions is an important prerequisite of effective human-AI collaboration. Recent work, however, has shown that people struggle to evaluate AI systems in the presence of forecasting errors, falling well short of relying on AI systems ap ...
When using web search engines to conduct inquiries on debated topics, searchers' interactions with search results are commonly affected by a combination of searcher and system biases. While prior work has mainly investigated these biases in isolation, there is a lack of a compreh ...

Akal Badi ya Bias

An Exploratory Study of Gender Bias in Hindi Language Technology

Existing research in measuring and mitigating gender bias predominantly centers on English, overlooking the intricate challenges posed by non-English languages and the Global South. This paper presents the first comprehensive study delving into the nuanced landscape of gender bia ...
Web search has evolved into a platform people rely on for opinion formation on debated topics. Yet, pursuing this search intent can carry serious consequences for individuals and society and involves a high risk of biases. We argue that web search can and should empower users to ...

Opening the Analogical Portal to Explainability

Can Analogies Help Laypeople in AI-assisted Decision Making?

Concepts are an important construct in semantics, based on which humans understand the world with various levels of abstraction. With the recent advances in explainable artificial intelligence (XAI), concept-level explanations are receiving an increasing amount of attention from ...

DECI

The 2ndTutorial on Designing Effective Conversational Interfaces

Conversational User Interfaces (CUIs) have been argued to have advantages over traditional GUIs due to having a more human-like interaction. The growing popularity of conversational agents has enabled humans to interact with machines more naturally. People are increasingly famili ...
With the integration of AI systems into our daily lives, human-AI collaboration has become increasingly prevalent. Prior work in this realm has primarily explored the effectiveness and performance of individual human and AI systems in collaborative tasks. While much of decision-m ...

Everything We Hear

Towards Tackling Misinformation in Podcasts

Advances in generative AI, the proliferation of large multimodal models (LMMs), and democratized open access to these technologies have direct implications for the production and diffusion of misinformation. In this prequel, we address tackling misinformation in the unique and in ...

Dealing with Uncertainty

Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision-Making

While existing literature has explored and revealed several insights pertaining to the role of human factors (e.g., prior experience, domain knowledge) and attributes of AI systems (e.g., accuracy, trustworthiness), there is a limited understanding around how the important task c ...

"decisionTime"

A Configurable Framework for Reproducible Human-AI Decision-Making Studies

Empirical studies have extensively investigated human decision-making processes in various domains where AI systems are incorporated. However, comparing and replicating these studies can be challenging due to different experimental configurations. Moreover, the existing contexts ...
Human intelligence continues to be essential in building ground-truth data, training sets, and for evaluating a plethora of systems. The democratized and distributed nature of online crowd work - an attractive and accessible feature that has led to the proliferation of the paradi ...

To Err Is AI!

Debugging as an Intervention to Facilitate Appropriate Reliance on AI Systems

Powerful predictive AI systems have demonstrated great potential in augmenting human decision making. Recent empirical work has argued that the vision for optimal human-AI collaboration requires ‘appropriate reliance’ on AI systems. However, accurately estimating the trustworthin ...