Assessing artificial trust in human-agent teams

Assessing artificial trust in human-agent teams: A conceptual model

Centeio Jorge, C. (TU Delft Interactive Intelligence)
Tielman, M.L. (TU Delft Interactive Intelligence)
Jonker, C.M. (TU Delft Interactive Intelligence; Universiteit Leiden)

2022

As intelligent agents are becoming human's teammates, not only do humans need to trust intelligent agents, but an intelligent agent should also be able to form artificial trust, i.e. a belief regarding human's trustworthiness. We see artificial trust as the beliefs of competence and willingness, and we study which internal factors (krypta) of the human may play a role when assessing artificial trust. Furthermore, we investigate which observable measures (manifesta) an agent may take into account as cues for the human teammate's krypta. This paper proposes a conceptual model of artificial trust for a specific task during human-agent teamwork. Our model proposes observable measures related to human trustworthiness (ability, benevolence, integrity) and strategy (perceived cost and benefit) as predictors for willingness and competence, based on literature and a preliminary user study.

trustworthiness
artificial trust
intelligent agents
human-agent collaboration
Human-agent interaction
trust
Trust metrics
Human-Agent Teaming
Human-agent teamwork

http://resolver.tudelft.nl/uuid:929223fe-27f9-4540-8a7b-f919ee9d8343

https://doi.org/10.1145/3514197.3549696

978-1-4503-9248-8

IVA 2022 - Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents

IVA 2022 - Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents

Institutional Repository

conference paper

© 2022 C. Centeio Jorge, M.L. Tielman, C.M. Jonker