The CLEF-2025 CheckThat! Lab
Subjectivity, Fact-Checking, Claim Normalization, and Retrieval
Firoj Alam (Qatar Computing Research Institute)
Julia Maria Struß (University of Bologna)
Tanmoy Chakraborty (Indian Institute of Technology Delhi)
Stefan Dietze (Universität Düsseldorf, GESIS - Leibniz Institute for the Social Sciences)
Salim Hafid (University of Montpellier)
Katerina Korre (Qatar Computing Research Institute)
Arianna Muti (Bocconi University, Milan)
Preslav Nakov (Mohamed Bin Zayed University of Artificial Intelligence)
V. Venktesh (TU Delft - Web Information Systems)
undefined More Authors (External organisation)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
The CheckThat! lab aims to advance the development of innovative technologies designed to identify and to counteract online disinformation and manipulation efforts across various languages and platforms. The first five editions of the CheckThat! lab focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. Since the 2023 edition, the lab has broadened the focus and addressed new problems on auxiliary tasks supporting research and decision-making during the verification process. In the 2025 edition of the lab, we consider tasks at the core of the verification pipeline again as well as auxiliary tasks: Task 1 is on identification of subjectivity (a follow up of the CheckThat! 2024 edition), Task 2 is on claim normalization, Task 3 addresses fact-checking numerical claims, and Task 4 focuses on scientific web discourse processing. These tasks represent challenging classification and retrieval problems at the document and at the span level, including multilingual settings.