Dealing with overconfidence and bias in low-cost evaluation of audio music similarity

The music information retrieval community has long recognized the need for better evaluation. Frameworks as comprehensive as in the field of text retrieval are missing. An important problem of evaluation for music retrieval is the high cost. This work continues on the proposed low-cost evaluation model. The low-cost model allows for cheap...

Understanding Context Effects in the Evaluation of Music Similarity

This work analyses context effect in the evaluation of music similarity performed by human annotators to better understand the impact of context effects in the current annotation protocol of Music Information Retrieval Evaluation eXchange (MIREX). Human annotators are known to be subjective when giving similarity judgements. The Audio Music...