Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education

Journal Article (2023)
Author(s)

Christine Bauer (Paris Lodron University Salzburg)

Ben Carterette (University of Delaware)

Nicola Ferro (University of Padua)

Norbert Fuhr (Universität Duisburg-Essen)

Joeran Beel (University of Siegen)

Timo Breuer (Technische Hochschule Köln)

Charles L. A. Clarke (University of Waterloo)

Laura Dietz (University of New Hampshire)

Julián Urbano (TU Delft - Multimedia Computing)

undefined More Authors (External organisation)

DOI related publication
https://doi.org/10.1145/3636341.3636351 Final published version
More Info
expand_more
Publication Year
2023
Language
English
Journal title
ACM SIGIR Forum
Issue number
1
Volume number
57
Pages (from-to)
1-28
Downloads counter
318
Collections
Institutional Repository
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

This report documents the program and the outcomes of Dagstuhl Seminar 23031 "Frontiers of Information Access Experimentation for Research and Education", which brought together 38 participants from 12 countries. The seminar addressed technology-enhanced information access (information retrieval, recommender systems, natural language processing) and specifically focused on developing more responsible experimental practices leading to more valid results, both for research as well as for scientific education.The seminar featured a series of long and short talks delivered by participants, who helped in setting a common ground and in letting emerge topics of interest to be explored as the main output of the seminar. This led to the definition of five groups which investigated challenges, opportunities, and next steps in the following areas: reality check, i.e. conducting real-world studies, human-machine-collaborative relevance judgment frameworks, overcoming methodological challenges in information retrieval and recommender systems through awareness and education, results-blind reviewing, and guidance for authors.Date: 15--20 January 2023.Website: https://www.dagstuhl.de/23031.