Macaroni: Crawling and Enriching Metadata from Public Model Zoos

Macaroni: Crawling and Enriching Metadata from Public Model Zoos

Li, Z. (TU Delft Web Information Systems)
Hai, R. (TU Delft Web Information Systems)
Katsifodimos, A (TU Delft Web Information Systems)
Bozzon, A. (TU Delft Human-Centred Artificial Intelligence)

2023

Machine learning (ML) researchers and practitioners are building repositories of pre-trained models, called model zoos. These model zoos contain metadata that detail various properties of the ML models and datasets, which are useful for reporting, auditing, reproducibility, and interpretability. Unfortunately, the existing metadata representations come with limited expressivity and lack of standardization. Meanwhile, an interoperable method to store and query model zoo metadata is missing. These two gaps hinder model search, reuse, comparison, and composition. In this demo paper, we advocate for standardized ML model metadata representation, proposing Macaroni, a metadata search engine with toolkits that support practitioners to obtain and enrich that metadata.

http://resolver.tudelft.nl/uuid:69264137-4587-47a9-a557-942dd88effe3

https://doi.org/10.1007/978-3-031-34444-2_31

2023-12-25

International Conference on Web Engineering

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Institutional Repository

conference paper

© 2023 Z. Li, R. Hai, A Katsifodimos, A. Bozzon