Increasing trust in complex machine learning systems

Increasing trust in complex machine learning systems: Studies in the music domain

Kim, Jaehun (TU Delft Multimedia Computing)

Hanjalic, A. (promotor)
Liem, C.C.S. (copromotor)

Delft University of Technology

2021-05-19

Machine learning (ML) has become a core technology for many real-world applications. Modern ML models are applied to unprecedentedly complex and difficult challenges, including very large and subjective problems. For instance, applications towards multimedia understanding have been advanced substantially. Here, it is already prevalent that cultural/artistic objects such as music and videos are analyzed and served to users according to their preference, enabled throughML techniques.
One of the most recent breakthroughs in ML is Deep Learning (DL), which has been immensely adopted to tackle such complex problems. DL allows for higher learning capacity, making end-to-end learning possible, which reduces the need for substantial engineering effort, while achieving high effectiveness. At the same time, this also makes DL models more complex than conventional ML models. Reports in several domains indicate that such more complex ML models may have potentially critical hidden problems: various biases embedded in the training data can emerge in the prediction, extremely sensitive models can make unaccountable mistakes. Furthermore, the black-box nature of the DL models hinders the interpretation of the mechanisms behind them. Such unexpected drawbacks result in a significant impact on the trustworthiness of the systems in which the ML models are equipped as the core apparatus.
In this thesis, a series of studies investigates aspects of trustworthiness for complex ML applications, namely the reliability and explainability. Specifically, we focus on music as the primary domain of interest, considering its complexity and subjectivity. Due to this nature of music, ML models for music are necessarily complex for achieving meaningful effectiveness. As such, the reliability and explainability of music ML models are crucial in the field.

Trustworthy Machine Learning
Music Information Retrieval
Transfer Learning
Recommender Systems

https://doi.org/10.4233/uuid:01ba927d-28e7-4abd-8193-e4ebef3b8218

978-94-6366-418-9

Institutional Repository

doctoral thesis

© 2021 Jaehun Kim