Evaluating explainable social choice-based aggregation strategies for group recommendation

Evaluating explainable social choice-based aggregation strategies for group recommendation

Barile, Francesco (Universiteit Maastricht)
Draws, T.A. (TU Delft Web Information Systems)
Inel, Oana (University of Zürich)
Rieger, A. (TU Delft Web Information Systems)
Najafian, S. (TU Delft Web Information Systems)
Ebrahimi Fard, Amir (Universiteit Maastricht)
Hada, Rishav (Universiteit Maastricht; Microsoft Research)
Tintarev, N. (Universiteit Maastricht)

2023

Social choice aggregation strategies have been proposed as an explainable way to generate recommendations to groups of users. However, it is not trivial to determine the best strategy to apply for a specific group. Previous work highlighted that the performance of a group recommender system is affected by the internal diversity of the group members’ preferences. However, few of them have empirically evaluated how the specific distribution of preferences in a group determines which strategy is the most effective. Furthermore, only a few studies evaluated the impact of providing explanations for the recommendations generated with social choice aggregation strategies, by evaluating explanations and aggregation strategies in a coupled way. To fill these gaps, we present two user studies (N=399 and N=288) examining the effectiveness of social choice aggregation strategies in terms of users’ fairness perception, consensus perception, and satisfaction. We study the impact of the level of (dis-)agreement within the group on the performance of these strategies. Furthermore, we investigate the added value of textual explanations of the underlying social choice aggregation strategy used to generate the recommendation. The results of both user studies show no benefits in using social choice-based explanations for group recommendations. However, we find significant differences in the effectiveness of the social choice-based aggregation strategies in both studies. Furthermore, the specific group configuration (i.e., various scenarios of internal diversity) seems to determine the most effective aggregation strategy. These results provide useful insights on how to select the appropriate aggregation strategy for a specific group based on the level of (dis-)agreement within the group members’ preferences.

Explainable recommender systems
Group recommender systems
Social choice functions
Social choice-based explanations

http://resolver.tudelft.nl/uuid:a0704267-bfd6-48d6-b551-98b9b8d3befb

https://doi.org/10.1007/s11257-023-09363-0

0924-1868

User Modeling and User-Adapted Interaction: the journal of personalization research, 34 (2024) (1), 1-58

Institutional Repository

journal article

© 2023 Francesco Barile, T.A. Draws, Oana Inel, A. Rieger, S. Najafian, Amir Ebrahimi Fard, Rishav Hada, N. Tintarev