Print Email Facebook Twitter Exploring the effect of automation failure on the human’s trustworthiness in human-agent teamwork Title Exploring the effect of automation failure on the human’s trustworthiness in human-agent teamwork Author Centeio Jorge, C. (TU Delft Interactive Intelligence) Bouman, Nikki H. (Student TU Delft) Jonker, C.M. (TU Delft Interactive Intelligence; Universiteit Leiden) Tielman, M.L. (TU Delft Interactive Intelligence) Date 2023 Abstract Introduction: Collaboration in teams composed of both humans and automation has an interdependent nature, which demands calibrated trust among all the team members. For building suitable autonomous teammates, we need to study how trust and trustworthiness function in such teams. In particular, automation occasionally fails to do its job, which leads to a decrease in a human’s trust. Research has found interesting effects of such a reduction of trust on the human’s trustworthiness, i.e., human characteristics that make them more or less reliable. This paper investigates how automation failure in a human-automation collaborative scenario affects the human’s trust in the automation, as well as a human’s trustworthiness towards the automation.Methods: We present a 2 × 2 mixed design experiment in which the participants perform a simulated task in a 2D grid-world, collaborating with an automation in a “moving-out” scenario. During the experiment, we measure the participants’ trustworthiness, trust, and liking regarding the automation, both subjectively and objectively.Results: Our results show that automation failure negatively affects the human’s trustworthiness, as well as their trust in and liking of the automation.Discussion: Learning the effects of automation failure in trust and trustworthiness can contribute to a better understanding of the nature and dynamics of trust in these teams and improving human-automation teamwork. Subject human-automation teamworkautomation failuremental modeltrusttrustworthinesshuman-agent collaboration To reference this document use: http://resolver.tudelft.nl/uuid:afac5bed-ef2d-4438-87a7-320d88973a1d DOI https://doi.org/10.3389/frobt.2023.1143723 ISSN 2296-9144 Source Frontiers In Robotics and AI, 10 Part of collection Institutional Repository Document type journal article Rights © 2023 C. Centeio Jorge, Nikki H. Bouman, C.M. Jonker, M.L. Tielman Files PDF frobt_10_1143723.pdf 25.65 MB Close viewer /islandora/object/uuid:afac5bed-ef2d-4438-87a7-320d88973a1d/datastream/OBJ/view