How Much Decision Power Should (A)I Have?
Investigating Patients' Preferences Towards AI Autonomy in Healthcare Decision Making
Dajung Kim (TU Delft - Form and Experience)
N.J.H. Vegt (TU Delft - Form and Experience)
Valentijn Visch (TU Delft - Form and Experience)
Marina Bos-de Vos (TU Delft - DesIgning Value in Ecosystems)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Despite the growing potential of artificial intelligence (AI) in improving clinical decision making, patients' perspectives on the use of AI for their care decision making are underexplored. In this paper, we investigate patients' preferences towards the autonomy of AI in assisting healthcare decision making. We conducted interviews and an online survey using an interactive narrative and speculative AI prototypes to elicit participants' preferred choices of using AI in a pregnancy care context. The analysis of the interviews and in-story responses reveals that patients' preferences for AI autonomy vary per person and context, and may change over time. This finding suggests the need for involving patients in defining and reassessing the appropriate level of AI assistance for healthcare decision making. Departing from these varied preferences for AI autonomy, we discuss implications for incorporating patient-centeredness in designing AI-powered healthcare decision making.