ReproducedPapers.org
Openly Teaching and Structuring Machine Learning Reproducibility
Burak Yildiz (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Hayley Hung (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Jesse H. Krijthe (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Cynthia C.S. Liem (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Marco Loog (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Gosia Migut (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Frans A. Oliehoek (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Annibale Panichella (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Przemysław Pawełczak (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Stjepan Picek (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Mathijs de Weerdt (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Jan van Gemert (TU Delft - Electrical Engineering, Mathematics and Computer Science)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
We present ReproducedPapers.org : an open online repository for teaching and structuring machine learning reproducibility. We evaluate doing a reproduction project among students and the added value of an online reproduction repository among AI researchers. We use anonymous self-assessment surveys and obtained 144 responses. Results suggest that students who do a reproduction project place more value on scientific reproductions and become more critical thinkers. Students and AI researchers agree that our online reproduction repository is valuable.