English

The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval

Computation and Language 2025-03-20 v1 Artificial Intelligence

Abstract

The CheckThat! lab aims to advance the development of innovative technologies designed to identify and counteract online disinformation and manipulation efforts across various languages and platforms. The first five editions focused on key tasks in the information verification pipeline, including check-worthiness, evidence retrieval and pairing, and verification. Since the 2023 edition, the lab has expanded its scope to address auxiliary tasks that support research and decision-making in verification. In the 2025 edition, the lab revisits core verification tasks while also considering auxiliary challenges. Task 1 focuses on the identification of subjectivity (a follow-up from CheckThat! 2024), Task 2 addresses claim normalization, Task 3 targets fact-checking numerical claims, and Task 4 explores scientific web discourse processing. These tasks present challenging classification and retrieval problems at both the document and span levels, including multilingual settings.

Keywords

Cite

@article{arxiv.2503.14828,
  title  = {The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval},
  author = {Firoj Alam and Julia Maria Struß and Tanmoy Chakraborty and Stefan Dietze and Salim Hafid and Katerina Korre and Arianna Muti and Preslav Nakov and Federico Ruggeri and Sebastian Schellhammer and Vinay Setty and Megha Sundriyal and Konstantin Todorov and Venktesh V},
  journal= {arXiv preprint arXiv:2503.14828},
  year   = {2025}
}

Comments

misinformation, factuality, fact-checking, fact-checkers, check-worthiness, Social Media Platforms

R2 v1 2026-06-28T22:26:07.610Z