Estimating Value Preferences in a Hybrid Participatory System
Luciano C. Cavalcante Siebert (TU Delft - Interactive Intelligence)
E. Liscio (TU Delft - Interactive Intelligence)
Pradeep Kumar Murukannaiah (TU Delft - Interactive Intelligence)
Lionel Kaptein (Student TU Delft)
Shannon Spruit (Populytics B.V)
Jeroen van den Hoven (TU Delft - Ethics & Philosophy of Technology)
Catholijn Jonker (TU Delft - Interactive Intelligence)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
We propose methods for an AI agent to estimate the value preferences of individuals in a hybrid participatory system, considering a setting where participants make choices and provide textual motivations for those choices. We focus on situations where there is a conflict between participants' choices and motivations, and operationalize the philosophical stance that 'valuing is deliberatively consequential.' That is, if a user's choice is based on a deliberation of value preferences, the value preferences can be observed in the motivation the user provides for the choice. Thus, we prioritize the value preferences estimated from motivations over the value preferences estimated from choices alone. We evaluate the proposed methods on a dataset of a large-scale survey on energy transition. The results show that explicitly addressing inconsistencies between choices and motivations improves the estimation of an individual's value preferences. The proposed methods can be integrated in a hybrid participatory system, where artificial agents ought to estimate humans' value preferences to pursue value alignment.
help_outline