Print Email Facebook Twitter Aggregating value systems for decision support Title Aggregating value systems for decision support Author Lera-Leri, Roger X. (Artificial Intelligence Research Institute, Spanish National Scientific Research Council) Liscio, E. (TU Delft Interactive Intelligence) Bistaffa, Filippo (Artificial Intelligence Research Institute, Spanish National Scientific Research Council) Jonker, C.M. (TU Delft Interactive Intelligence) Lopez-Sanchez, Maite (Universitat Politecnica de Catalunya) Murukannaiah, P.K. (TU Delft Interactive Intelligence) Rodriguez-Aguilar, Juan A. (Artificial Intelligence Research Institute, Spanish National Scientific Research Council) Salas-Molina, Francisco (Universitat Politécnica de Valencia) Date 2024 Abstract We adopt an emerging and prominent vision of human-centred Artificial Intelligence that requires building trustworthy intelligent systems. Such systems should be capable of dealing with the challenges of an interconnected, globalised world by handling plurality and by abiding by human values. Within this vision, pluralistic value alignment is a core problem for AI– that is, the challenge of creating AI systems that align with a set of diverse individual value systems. So far, most literature on value alignment has considered alignment to a single value system. To address this research gap, we propose a novel method for estimating and aggregating multiple individual value systems. We rely on recent results in the social choice literature and formalise the value system aggregation problem as an optimisation problem. We then cast this problem as an ℓp-regression problem. Doing so provides a principled and general theoretical framework to model and solve the aggregation problem. Our aggregation method allows us to consider a range of ethical principles, from utilitarian (maximum utility) to egalitarian (maximum fairness). We illustrate the aggregation of value systems by considering real-world data from two case studies: the Participatory Value Evaluation process and the European Values Study. Our experimental evaluation shows how different consensus value systems can be obtained depending on the ethical principle of choice, leading to practical insights for a decision-maker on how to perform value system aggregation. Subject AI & ethicsOptimisationValue systems To reference this document use: http://resolver.tudelft.nl/uuid:1ce2fa75-5521-436c-b311-ff402a48ab1f DOI https://doi.org/10.1016/j.knosys.2024.111453 ISSN 0950-7051 Source Knowledge-Based Systems, 287 Part of collection Institutional Repository Document type journal article Rights © 2024 Roger X. Lera-Leri, E. Liscio, Filippo Bistaffa, C.M. Jonker, Maite Lopez-Sanchez, P.K. Murukannaiah, Juan A. Rodriguez-Aguilar, Francisco Salas-Molina Files PDF 1-s2.0-S0950705124000881-main.pdf 1.3 MB Close viewer /islandora/object/uuid:1ce2fa75-5521-436c-b311-ff402a48ab1f/datastream/OBJ/view