What does a Text Classifier Learn about Morality? An Explainable Method for Cross-Domain Comparison of Moral Rhetoric

Conference Paper (2023)
Author(s)

E. Liscio (TU Delft - Interactive Intelligence)

Oscar Araque (Universidad Politécnica de Madrid)

Lorenzo Gatti (University of Twente)

I.L. Constantinescu (ETH Zürich)

C.M. Jonker (TU Delft - Interactive Intelligence)

Kyriaki Kalimeri (ISI Foundation)

P.K. Murukannaiah (TU Delft - Interactive Intelligence)

Research Group
Interactive Intelligence
Copyright
© 2023 E. Liscio, Oscar Araque, Lorenzo Gatti, I.L. Constantinescu, C.M. Jonker, Kyriaki Kalimeri, P.K. Murukannaiah
DOI related publication
https://doi.org/10.18653/v1/2023.acl-long.789
More Info
expand_more
Publication Year
2023
Language
English
Copyright
© 2023 E. Liscio, Oscar Araque, Lorenzo Gatti, I.L. Constantinescu, C.M. Jonker, Kyriaki Kalimeri, P.K. Murukannaiah
Research Group
Interactive Intelligence
Pages (from-to)
14113–14132
ISBN (electronic)
9781959429722
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Moral rhetoric influences our judgement. Although social scientists recognize moral expression as domain specific, there are no systematic methods for analyzing whether a text classifier learns the domain-specific expression of moral language or not. We propose Tomea, a method to compare a supervised classifier's representation of moral rhetoric across domains. Tomea enables quantitative and qualitative comparisons of moral rhetoric via an interpretable exploration of similarities and differences across moral concepts and domains. We apply Tomea on moral narratives in thirty-five thousand tweets from seven domains. We extensively evaluate the method via a crowd study, a series of cross-domain moral classification comparisons, and a qualitative analysis of cross-domain moral expression.