CLEF NewsREEL 2016

Comparing Multi-Dimensional Offline and Online Evaluation of News Recommender Systems

Conference paper (2016)

Authors

B. Kille Technical University of Berlin
A. Lommatzsch Technical University of Berlin
Frank Hopfgartner University of Glasgow
J. Seiler Plista GmbH
D. Malagoli ContentWise R&D
A. Sereny ContentWise R&D
T Brodt Plista GmbH
Recommender systems News Living lab Multi-dimensional evaluation Stream-based recommender
More Info
expand_more

Published Date

2016

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Running in its third year at CLEF, NewsREEL challenged participantsto develop news recommendation algorithms and have them benchmarked inan online (Task 1) and offline setting (Task 2), respectively. This paper providesan overview of the NewsREEL scenario, outlines this year’s campaign, presentsresults of both tasks, and discusses the approaches of participating teams. Moreover,it overviews ideas on living lab evaluation that have been presented as partof a “New Ideas” track at the conference in Portugal. Presented results illustratepotentials for multi-dimensional evaluation of recommendation algorithms ina living lab and simulation based evaluation setting.