How should an AI trust its human teammates? Exploring possible cues of artificial trust

How should an AI trust its human teammates? Exploring possible cues of artificial trust

Centeio Jorge, C. (TU Delft Interactive Intelligence)
Jonker, C.M. (TU Delft Interactive Intelligence)
Tielman, M.L. (TU Delft Interactive Intelligence)

2024

In teams composed of humans, we use trust in others to make decisions, such as what to do next, who to help and who to ask for help. When a team member is artificial, they should also be able to assess whether a human teammate is trustworthy for a certain task. We see trustworthiness as the combination of (1) whether someone will do a task and (2) whether they can do it. With building beliefs in trustworthiness as an ultimate goal, we explore which internal factors (krypta) of the human may play a role (e.g., ability, benevolence, and integrity) in determining trustworthiness, according to existing literature. Furthermore, we investigate which observable metrics (manifesta) an agent may take into account as cues for the human teammate’s krypta in an online 2D grid-world experiment (n = 54). Results suggest that cues of ability, benevolence and integrity influence trustworthiness. However, we observed that trustworthiness is mainly influenced by human’s playing strategy and cost-benefit analysis, which deserves further investigation. This is a first step towards building informed beliefs of human trustworthiness in human-AI teamwork.

http://resolver.tudelft.nl/uuid:a3c3ff9c-45bb-428e-8511-07b84c9f8523

https://doi.org/10.1145/3635475

2160-6455

ACM Transactions on Interactive Intelligent Systems, 14 (1)

Institutional Repository

journal article

© 2024 C. Centeio Jorge, C.M. Jonker, M.L. Tielman