Library
Repository Home account_circle Login

Overview of the CLEF-2025 CheckThat! Lab

Subjectivity, Fact-Checking, Claim Normalization, and Retrieval

Conference Paper (2026)
Author(s)

Firoj Alam (Hamad Bin Khlifa University)

Julia Maria Struß (University of Applied Sciences Potsdam)

Tanmoy Chakraborty (Indian Institute of Technology Delhi)

Stefan Dietze (Heinrich Heine University, GESIS - Leibniz Institute for the Social Sciences)

Salim Hafid (Université de Montpellier)

Katerina Korre (Hamad Bin Khlifa University)

Arianna Muti (Università Bocconi)

Preslav Nakov (Mohamed Bin Zayed University of Artificial Intelligence)

V. Venktesh (TU Delft - Electrical Engineering, Mathematics and Computer Science)

undefined More Authors

Research Group
Web Information Systems
DOI related publication
https://doi.org/10.1007/978-3-032-04354-2_13 Final published version
More Info
expand_more
Publication Year
2026
Language
English
Research Group
Web Information Systems
Bibliographical Note
Green Open Access added to TU Delft Institutional Repository as part of the Taverne amendment. More information about this copyright law amendment can be found at https://www.openaccess.nl. Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.
Pages (from-to)
199-223
Publisher
Springer
ISBN (print)
9783032043535
Event
16th International Conference of the Cross-Language Evaluation Forum for European Languages, CLEF 2025 (2025-09-09 - 2025-09-12), Madrid, Spain
Downloads counter
93
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

This paper presents the eighth edition of the CheckThat! lab, part of the 2025 Conference and Labs of the Evaluation Forum (CLEF). As in previous editions of CheckThat!, the lab offers tasks from the core of the verification pipeline, including check-worthiness, identifying previously fact-checked claims, supporting evidence retrieval, and claim verification as well as auxiliary tasks addressing different facets of individual steps of the pipeline: Task 1 is on identification of subjectivity (a follow-up of the CheckThat! 2024 edition), which is related to the check-worthiness task, Task 2 is on claim normalization, Task 3 addresses fact-checking numerical claims, and Task 4 focuses on scientific web discourse processing. These challenging classification and retrieval problems are offered in different mono-, multi- and crosslingual settings covering more than 20 languages. This year, CheckThat! was one of the most popular labs at CLEF-2025 in terms of team registrations: 177 teams registered, almost half of them actually participating (a total of 83 teams) and 54 submitted system description papers.

Files

978-3-032-04354-2_13.pdf
(pdf | 1.25 Mb)
- Embargo expired in 03-03-2026
Taverne