Title
An Empirical Analysis of Diversity in Argument Summarization
Author
van der Meer, M.T. (Universiteit Leiden) 
Jonker, C.M. (TU Delft Interactive Intelligence)
Vossen, Piek (Vrije Universiteit Amsterdam)
Murukannaiah, P.K. (TU Delft Interactive Intelligence)
Contributor
Graham, Yvette (editor)
Purver, Matthew (editor)
Purver, Matthew (editor)
Date
2024
Abstract
Presenting high-level arguments is a crucial task for fostering participation in online societal discussions. Current argument summarization approaches miss an important facet of this task-capturing diversity-which is important for accommodating multiple perspectives. We introduce three aspects of diversity: those of opinions, annotators, and sources. We evaluate approaches to a popular argument summarization task called Key Point Analysis, which shows how these approaches struggle to (1) represent arguments shared by few people, (2) deal with data from various sources, and (3) align with subjectivity in human-provided annotations. We find that both general-purpose LLMs and dedicated KPA models exhibit this behavior, but have complementary strengths. Further, we observe that diversification of training data may ameliorate generalization. Addressing diversity in argument summarization requires a mix of strategies to deal with subjectivity.
To reference this document use:
http://resolver.tudelft.nl/uuid:397e3b92-9b3a-4e48-80d4-09ede1901dff
Publisher
Association for Computational Linguistics (ACL)
Embargo date
2024-09-30
ISBN
9798891760882
Source
EACL 2024 - 18th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference
Event
18th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2024, 2024-03-17 → 2024-03-22, St. Julian�s, Malta
Series
EACL 2024 - 18th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference, 1
Bibliographical note
Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.
Part of collection
Institutional Repository
Document type
conference paper
Rights
© 2024 M.T. van der Meer, C.M. Jonker, Piek Vossen, P.K. Murukannaiah