Dockerising terrier for the open-source IR replicability challenge

Dockerising terrier for the open-source IR replicability challenge

Barbosa Câmara, A. (TU Delft Web Information Systems)
MacDonald, Craig (University of Glasgow)

Clancy, Ryan (editor)
Ferro, Nicola (editor)
Hauff, Claudia (editor)
Lin, Jimmy (editor)
Sakai, Tetsuya (editor)
Wu, Ze Zhong (editor)

2019

Reproducibility and replicability are key concepts in science, and it is therefore important for information retrieval (IR) platforms to aid in reproducing and replicating experiments. In this paper, we describe the creation of a Docker container for Terrier within the framework of the OSIRRC 2019 challenge, which allows typical runs to be reproduced on TREC Test Collections such as Robust04, GOV2, Core2018. In doing so, it is hoped that the produced Docker image can be of aid to other (re)producing baseline experiments on these test collections. Initiatives like OSIRRC are key in advancing these key concepts in the IR area. By making not only the source code available, but also the exact same environment and standardising inputs and outputs, it is possible to easily compare approaches and thereby improve the quality of the research for Information Retrieval.

http://resolver.tudelft.nl/uuid:a14bfb4f-f4d5-4ab0-aae3-3d950e64085c

CEUR-WS.org

OSIRRC 2019 The Open-Source IR Replicability Challenge: Proceedings of the Open-Source IR Replicability Challenge (OSIRRC 2019) co-located with 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019)

2019 Open-Source IR Replicability Challenge, OSIRRC 2019, 2019-07-25, Paris, France

CEUR Workshop Proceedings, 1613-0073, 2409

Institutional Repository

conference paper

© 2019 A. Barbosa Câmara, Craig MacDonald