ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims
Abstract
Automatically verifying climate-related claims against scientific literature is a challenging task, complicated by the specialised nature of scholarly evidence and the diversity of rhetorical strategies underlying climate disinformation. ClimateCheck 2026 is the second iteration of a shared task addressing this challenge, expanding on the 2025 edition with tripled training data and a new disinformation narrative classification task. Running from January to February 2026 on the CodaBench platform, the competition attracted 20 registered participants and 8 leaderboard submissions, with systems combining dense retrieval pipelines, cross-encoder ensembles, and large language models with structured hierarchical reasoning. In addition to standard evaluation metrics (Recall@K and Binary Preference), we adapt an automated framework to assess retrieval quality under incomplete annotations, exposing systematic biases in how conventional metrics rank systems. A cross-task analysis further reveals that not all climate disinformation is equally verifiable, potentially implicating how future fact-checking systems should be designed.
Keywords
Cite
@article{arxiv.2603.26449,
title = {ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims},
author = {Raia Abu Ahmad and Max Upravitelev and Aida Usmanova and Veronika Solopova and Georg Rehm},
journal= {arXiv preprint arXiv:2603.26449},
year = {2026}
}
Comments
Accepted at NSLP@LREC 2026