Measuring the accuracy of music genre classifier models using cross-collection evaluation

Measuring the accuracy of music genre classifier models using cross-collection evaluation

Salarian, Borna (TU Delft Electrical Engineering, Mathematics and Computer Science)

Liem, C.C.S. (mentor)
Kim, Jaehun (mentor)
Tielman, M.L. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2022-01-28

Working with trustworthy classifier models is important to the field of music information retrieval. However studies have shown some of the classifier models may not be as trustworthy as they appear. In this paper, we examine three of such classifiers available in the Essentia toolkit that have been evaluated using cross-validation, and measure the accuracy of these genre classifiers using cross-collection methods. We define a methodology inspired by other research in information retrieval to compare the output of the classifiers to an independent set of ground truth annotations that were the result of collaboration between the users of Last.fm. The classifiers were evaluated on 341 songs from the Muziekweb collection, and the results show that the classifiers performed worse than their cross-validation results.

Music Information Retrieval

http://resolver.tudelft.nl/uuid:f217414e-936c-4602-a56f-bbca8ed6fdab

Student theses

bachelor thesis

© 2022 Borna Salarian