Building Appropriate Trust in AI: The Significance of Integrity-Centered Explanations

Building Appropriate Trust in AI: The Significance of Integrity-Centered Explanations

Mehrotra, S. (TU Delft Interactive Intelligence)
Centeio Jorge, C. (TU Delft Interactive Intelligence)
Jonker, C.M. (TU Delft Interactive Intelligence)
Tielman, M.L. (TU Delft Interactive Intelligence)

2023

Establishing an appropriate level of trust between people and AI systems is crucial to avoid the misuse, disuse, or abuse of AI. Understanding how AI systems can generate appropriate levels of trust among users is necessary to achieve this goal. This study focuses on the impact of displaying integrity, which is one of the factors that influence trust. The study analyzes how different integrity-based explanations provided by an AI agent affect a human’s appropriate level of trust in the agent. To explore this, we conducted a between-subject user study involving 160 participants who collaborated with an AI agent to estimate calories on a food plate, with the AI agent expressing its integrity in different ways through explanations. The preliminary results demonstrate that an AI agent that explicitly acknowledges honesty in its decision making process elicit higher subjective trust than those that are transparent about their decision-making process or fair about biases. These findings can aid in designing agent-based AI systems that foster appropriate trust from humans.

Integrity
Appropriate Trust
trust
Explanations

http://resolver.tudelft.nl/uuid:fb207630-37eb-4d2e-9ac0-0726b586fd24

https://doi.org/10.3233/FAIA230121

436-439

2nd International Conference on Hybrid Human Artificial Intelligence, 2023-06-26 → 2023-06-30, Munich, Germany

Institutional Repository

poster

© 2023 S. Mehrotra, C. Centeio Jorge, C.M. Jonker, M.L. Tielman