Identifying Algorithmic Decision Subjects' Needs for Meaningful Contestability
M. Yurrita Semperena (Universiteit Utrecht, TU Delft - Perceptual Intelligence)
H. Verma (TU Delft - Human-Centred Artificial Intelligence)
A.M.A. Balayn (TU Delft - Organisation & Governance)
Kars Alfrink (TU Delft - Human-Centred Artificial Intelligence)
Ujwal Gadiraju (TU Delft - Web Information Systems)
A. Bozzon (TU Delft - Sustainable Design Engineering)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Contestability has been proposed as a key element in designing algorithmic decision-making processes that safeguard decision subjects' rights to dignity and autonomy. However, little is known about how contestability can be operationalized based on decision subjects' needs and preferences. We address this research gap by identifying decision subjects' information and procedural needs for enacting meaningful contestability. To this end, we chose an illegal holiday rental detection scenario as our case; a high-risk decision-making process in the public sector. We conducted 21 semi-structured interviews with citizens with experience renting their homes out and different levels of AI literacy. We found that decision subjects request interventions that facilitate (1) cooperation in sense-making, (2) support in contestation acts, and (3) appropriate responsibility attribution. Our results highlight the cooperative work behind contestability, and motivate future efforts to structure individual and collective action, to personalize explanations for contestability, and to open up sites of contestation in AI pipelines.
help_outline