Aggregating value systems for decision support
Roger X. Lera-Leri (Artificial Intelligence Research Institute, Spanish National Scientific Research Council)
E. Liscio (TU Delft - Interactive Intelligence)
Filippo Bistaffa (Artificial Intelligence Research Institute, Spanish National Scientific Research Council)
Catholijn Jonker (TU Delft - Interactive Intelligence)
Maite Sanchez (Universitat Politecnica de Catalunya)
Pradeep K. Murukannaiah (TU Delft - Interactive Intelligence)
A. Aguilar (Artificial Intelligence Research Institute, Spanish National Scientific Research Council)
F Salas-Molina (Universitat Politécnica de Valencia)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
We adopt an emerging and prominent vision of human-centred Artificial Intelligence that requires building trustworthy intelligent systems. Such systems should be capable of dealing with the challenges of an interconnected, globalised world by handling plurality and by abiding by human values. Within this vision, pluralistic value alignment is a core problem for AI– that is, the challenge of creating AI systems that align with a set of diverse individual value systems. So far, most literature on value alignment has considered alignment to a single value system. To address this research gap, we propose a novel method for estimating and aggregating multiple individual value systems. We rely on recent results in the social choice literature and formalise the value system aggregation problem as an optimisation problem. We then cast this problem as an ℓp-regression problem. Doing so provides a principled and general theoretical framework to model and solve the aggregation problem. Our aggregation method allows us to consider a range of ethical principles, from utilitarian (maximum utility) to egalitarian (maximum fairness). We illustrate the aggregation of value systems by considering real-world data from two case studies: the Participatory Value Evaluation process and the European Values Study. Our experimental evaluation shows how different consensus value systems can be obtained depending on the ethical principle of choice, leading to practical insights for a decision-maker on how to perform value system aggregation.