Understanding Decision Subjects' Needs and Perceptions Towards Contestable AI Systems
M. Yurrita Semperena (TU Delft - Perceptual Intelligence)
A. Bozzon – Promotor (TU Delft - Sustainable Design Engineering)
SC Pont – Promotor (TU Delft - Perceptual Intelligence)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Contestability, i.e., a property that makes AI systems open to human intervention throughout their lifecycles, has been claimed to be essential for counteracting algorithmic harms. By enabling decision subjects to influence algorithmic outputs, contestable AI systems aim to safeguard decision subjects' rights to autonomy and dignity. Despite the interest and relevance of contestability in HCI, little is known about whether and how elements of contestable AI systems can empower decision subjects in algorithmic decision-making. In this dissertation, we aim to generate empirical insights into decision subjects' needs for and fairness perceptions towards contestable AI systems in decision-making. By focusing on decision subjects, this dissertation leads to a set of recommendations for organizations setting up algorithmic decision-making processes. These recommendations encourage organizations to account for the interests of those impacted by algorithmic decisions from the early stages of the design process.