Exploring the effect of automation failure on the human’s trustworthiness in human-agent teamwork

Introduction: Collaboration in teams composed of both humans and automation has an interdependent nature, which demands calibrated trust among all the team members. For building suitable autonomous teammates, we need to study how trust and trustworthiness function in such teams. In particular, automation occasionally fails to do its job, which...

Artificial Trust as a Tool in Human-AI Teams

Mutual trust is considered a required coordinating mechanism for achieving effective teamwork in human teams. However, it is still a challenge to implement such mechanisms in teams composed by both humans and AI (human-AI teams), even though those are becoming increasingly prevalent. Agents in such teams should not only be trustworthy and...

Assessing artificial trust in human-agent teams: A conceptual model

As intelligent agents are becoming human's teammates, not only do humans need to trust intelligent agents, but an intelligent agent should also be able to form artificial trust, i.e. a belief regarding human's trustworthiness. We see artificial trust as the beliefs of competence and willingness, and we study which internal factors (krypta) of...

Ethics of Trust­-Inviting Digital Systems: Blockchain, Reputation­-Based Platforms, and COVID­19 Tracing Technologies

In the past decade, rapid shifting and evolving technological systems that take trust as part of the design objective (call such systems “trust-inviting systems”) have incredibly transformed the way we interact with others. Think of reputation-based platforms mediating interactions between strangers and other digital services provided by...

Can We Make Sense of the Notion of Trustworthy Technology?

In this paper we raise the question whether technological artifacts can properly speaking be trusted or said to be trustworthy. First, we set out some prevalent accounts of trust and trustworthiness and explain how they compare with the engineer’s notion of reliability. We distinguish between pure rational-choice accounts of trust, which do not...