“Butter lyrics over hominy grit”

Comparing audio and psychology-based text features in MIR tasks

Conference Paper (2020)
Author(s)

Jaehun Kim (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Andrew M. Demetriou (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Sandy Manolios (TU Delft - Electrical Engineering, Mathematics and Computer Science)

M. Stella Tavella (Musixmatch)

Cynthia C.S. Liem (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Research Group
Multimedia Computing
More Info
expand_more
Publication Year
2020
Language
English
Research Group
Multimedia Computing
Pages (from-to)
150-156
ISBN (electronic)
9780981353708
Event
21st International Society for Music Information Retrieval Conference, ISMIR 2020 (2020-10-11 - 2020-10-16), Virtual, Online, Canada
Downloads counter
256
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Psychology research has shown that song lyrics are a rich source of data, yet they are often overlooked in the field of MIR compared to audio. In this paper, we provide an initial assessment of the usefulness of features drawn from lyrics for various fields, such as MIR and Music Psychology. To do so, we assess the performance of lyric-based text features on 3 MIR tasks, in comparison to audio features. Specifically, we draw sets of text features from the field of Natural Language Processing and Psychology. Further, we estimate their effect on performance while statistically controlling for the effect of audio features, by using a hierarchical regression statistical model. Lyric-based features show a small but statistically significant effect, that anticipates further research. Implications and directions for future studies are discussed.