Trust should correspond to Trustworthiness: a Formalization of Appropriate Mutual Trust in Human-Agent Teams

Trust should correspond to Trustworthiness: a Formalization of Appropriate Mutual Trust in Human-Agent Teams

Centeio Jorge, C. (TU Delft Interactive Intelligence)
Mehrotra, S. (TU Delft Interactive Intelligence)
Tielman, M.L. (TU Delft Interactive Intelligence)
Jonker, C.M. (TU Delft Interactive Intelligence)

Falcone, R. (editor)
Zhang, J. (editor)
Wang, D. (editor)

2021

In human-agent teams, how one teammate trusts another teammate should correspond to the latter's actual trustworthiness, creating what we would call appropriate mutual trust. Although this sounds obvious, the notion of appropriate mutual trust for human-agent teamwork lacks a formal definition. In this article, we propose a formalization which represents trust as a belief about trustworthiness. Then, we address mutual trust, and pose that agents can use beliefs about trustworthiness to represent how they trust their human teammates, as well as to reason about how their human teammates trust them. This gives us a formalization with nested beliefs about beliefs of trustworthiness. Next, we highlight that mutual trust should also be appropriate, where we define appropriate trust in an agent as the trust which corresponds directly to that agent's trustworthiness. Finally, we explore how agents can define their own trustworthiness, using the concepts of ability, benevolence and integrity. This formalization of appropriate mutual trust can form the base for developing agents which can promote such trust.

http://resolver.tudelft.nl/uuid:6c0b8d69-0a73-4cbd-a0fb-9d3489f06d9f

Proceedings of the 22nd International Workshop on Trust in Agent Societies (TRUST 2021): Co-located with the 20th International Conferences on Autonomous Agents and Multiagent Systems (AAMAS 2021), 3022

22nd International Trust Workshop 2021, 2021-05-03 → 2021-05-07, London

Institutional Repository

conference paper

© 2021 C. Centeio Jorge, S. Mehrotra, M.L. Tielman, C.M. Jonker