Title
ReproducedPapers.org: Openly Teaching and Structuring Machine Learning Reproducibility
Author
Yildiz, B. (TU Delft Pattern Recognition and Bioinformatics) 
Hung, H.S. (TU Delft Pattern Recognition and Bioinformatics)
Krijthe, J.H. (TU Delft Pattern Recognition and Bioinformatics)
Liem, C.C.S. (TU Delft Multimedia Computing)
Loog, M. (TU Delft Pattern Recognition and Bioinformatics)
Migut, M.A. (TU Delft Computer Science & Engineering-Teaching Team)
Oliehoek, F.A. (TU Delft Interactive Intelligence)
Panichella, A. (TU Delft Software Engineering)
Pawełczak, Przemysław (TU Delft Embedded Systems)
Picek, S. (TU Delft Cyber Security)
de Weerdt, M.M. (TU Delft Algorithmics)
van Gemert, J.C. (TU Delft Pattern Recognition and Bioinformatics)
Contributor
Kerautret, Bertrand (editor)
Colom, Miguel (editor)
Krähenbühl, Adrien (editor)
Lopresti, Daniel (editor)
Monasse, Pascal (editor)
Talbot, Hugues (editor)
Date
2021
Abstract
We present ReproducedPapers.org : an open online repository for teaching and structuring machine learning reproducibility. We evaluate doing a reproduction project among students and the added value of an online reproduction repository among AI researchers. We use anonymous self-assessment surveys and obtained 144 responses. Results suggest that students who do a reproduction project place more value on scientific reproductions and become more critical thinkers. Students and AI researchers agree that our online reproduction repository is valuable.
Subject
Machine learning
Online repository
Reproducibility
To reference this document use:
http://resolver.tudelft.nl/uuid:2dcec1b3-db86-4b44-af1f-f287cf424b2c
DOI
https://doi.org/10.1007/978-3-030-76423-4_1
Publisher
Springer
Embargo date
2021-12-01
ISBN
9783030764227
Source
Reproducible Research in Pattern Recognition - 3rd International Workshop, RRPR 2021, Revised Selected Papers
Event
3rd International Workshop on Reproducible Research in Pattern Recognition, RRPR 2021, 2021-01-11, Virtual, Online
Series
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 0302-9743, 12636 LNCS
Bibliographical note
Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.
Part of collection
Institutional Repository
Document type
conference paper
Rights
© 2021 B. Yildiz, H.S. Hung, J.H. Krijthe, C.C.S. Liem, M. Loog, M.A. Migut, F.A. Oliehoek, A. Panichella, Przemysław Pawełczak, S. Picek, M.M. de Weerdt, J.C. van Gemert