Agent Failure, Trust Repair, and Fluency in Human-AI Teams

Agent Failure, Trust Repair, and Fluency in Human-AI Teams: Impact of Opportunistic Interdependence Relationship on Trust Violation, Trust Repair, and on Collaboration Fluency in a Human-Agent Team

Tanahashi, Kanta (TU Delft Electrical Engineering, Mathematics and Computer Science)

Verhagen, R.S. (mentor)
Tielman, M.L. (mentor)
Gadiraju, Ujwal (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2023-06-25

Nowadays, Human Autonomy Teams (HATs) are incorporated in many fields, where humans and autonomous agents work collaboratively to combine their capabilities with the ultimate goal of performing tasks more efficiently. In such environments, it is imperative to sustain a high level of trust between the agents as collaboration is not possible without mutual trust. Naturally, this implies that recovering trust following trust violation is also a crucial aspect of HATs. Moreover, besides team performance, the fluency of collaboration is another important factor to consider when evaluating the success of the teams. This paper aims to investigate the effect of opportunistic (soft) interdependence between the agents on trust violation, trust repair, and on collaboration fluency when compared against a baseline (complete independence) condition. In this paper, interdependence relationships refer to how the agents complement/combine each other's competence. The experimental results were obtained through a user study, using questionnaires and logged objective metrics. Our research found that teams with opportunistic interdependence relationships were significantly affected by trust violations compared to the baseline condition. Furthermore, although not as significant as the effect of trust violation, they also experienced a significant trust recovery during the tasks. Finally, the results of analyzing both subjective and objective fluency metrics did not give any significant result that indicates the difference in the level of collaboration fluency between the two conditions.

trust
trust violation
trust repair
collaboration fluency
interdependence
Human Autonomy Teams

http://resolver.tudelft.nl/uuid:d6bf7e79-8768-4c02-9c74-cd1f63d16ac7

Student theses

bachelor thesis

© 2023 Kanta Tanahashi