English
Related papers

Related papers: The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-C…

200 papers

Meta-evaluation studies of system performances in controlled offline evaluation campaigns, like TREC and CLEF, show a need for innovation in evaluating IR-systems. The field of academic search is no exception to this. This might be related…

Information Retrieval · Computer Science 2023-10-09 Philipp Schaer , Johann Schaible , Leyla Jael Castro

Large Language Models (LLMs) are beginning to reshape how media professionals verify information, yet automated support for detecting check-worthy claims a key step in the fact-checking process remains limited. We introduce the…

Computation and Language · Computer Science 2026-02-19 Martin Hyben , Sebastian Kula , Jan Cegin , Jakub Simko , Ivan Srba , Robert Moro

We present an overview of the SCIDOCA 2025 Shared Task, which focuses on citation discovery and prediction in scientific documents. The task is divided into three subtasks: (1) Citation Discovery, where systems must identify relevant…

Digital Libraries · Computer Science 2025-09-30 An Dao , Vu Tran , Le-Minh Nguyen , Yuji Matsumoto

Existing real-world datasets for multimodal fact-checking have multiple limitations: they contain few instances, focus on only one or two languages and tasks, suffer from evidence leakage, or rely on external sets of news articles for…

Computation and Language · Computer Science 2026-01-13 Jiahui Geng , Jonathan Tonglet , Iryna Gurevych

This paper describes our efforts in tackling Task 5 of SemEval-2020. The task involved detecting a class of textual expressions known as counterfactuals and separating them into their constituent elements. Counterfactual statements describe…

Computation and Language · Computer Science 2020-07-22 Anirudh Anil Ojha , Rohin Garg , Shashank Gupta , Ashutosh Modi

This paper presents our approach to the SemEval-2025 Task~6 (PromiseEval), which focuses on verifying promises in corporate ESG (Environmental, Social, and Governance) reports. We explore three model architectures to address the four…

Computation and Language · Computer Science 2025-05-30 Nawar Turk , Eeham Khan , Leila Kosseim

Automatic fact-checking aims to support professional fact-checkers by offering tools that can help speed up manual fact-checking. Yet, existing frameworks fail to address the key step of producing output suitable for broader dissemination…

Fact-checking is necessary to address the increasing volume of misinformation. Traditional fact-checking relies on manual analysis to verify claims, but it is slow and resource-intensive. This study establishes baseline comparisons for…

Computation and Language · Computer Science 2025-02-14 Premtim Sahitaj , Iffat Maab , Junichi Yamagishi , Jawan Kolanowski , Sebastian Möller , Vera Schmitt

Our society is facing rampant misinformation harming public health and trust. To address the societal challenge, we introduce FACT-GPT, a system leveraging Large Language Models (LLMs) to automate the claim matching stage of fact-checking.…

Computation and Language · Computer Science 2024-02-09 Eun Cheol Choi , Emilio Ferrara

Lexical Semantic Change detection, i.e., the task of identifying words that change meaning over time, is a very active research area, with applications in NLP, lexicography, and linguistics. Evaluation is currently the most pressing problem…

Computation and Language · Computer Science 2020-09-01 Dominik Schlechtweg , Barbara McGillivray , Simon Hengchen , Haim Dubossarsky , Nina Tahmasebi

Fact-checking is the task of verifying the factuality of a given claim by examining the available evidence. High-quality evidence plays a vital role in enhancing fact-checking systems and facilitating the generation of explanations that are…

Computation and Language · Computer Science 2024-03-27 Yirong Zeng , Xiao Ding , Yi Zhao , Xiangyu Li , Jie Zhang , Chao Yao , Ting Liu , Bing Qin

Evidence retrieval is a core part of automatic fact-checking. Prior work makes simplifying assumptions in retrieval that depart from real-world use cases: either no access to evidence, access to evidence curated by a human fact-checker, or…

Computation and Language · Computer Science 2024-06-18 Jifan Chen , Grace Kim , Aniruddh Sriram , Greg Durrett , Eunsol Choi

This work describes the adaptation of a pretrained sequence-to-sequence model to the task of scientific claim verification in the biomedical domain. We propose VERT5ERINI that exploits T5 for abstract retrieval, sentence selection and label…

Computation and Language · Computer Science 2020-10-23 Ronak Pradeep , Xueguang Ma , Rodrigo Nogueira , Jimmy Lin

Fact-checking numerical claims is critical as the presence of numbers provide mirage of veracity despite being fake potentially causing catastrophic impacts on society. The prior works in automatic fact verification do not primarily focus…

Information Retrieval · Computer Science 2025-10-28 V Venktesh , Deepali Prabhu , Avishek Anand

This paper describes the participation of the QMUL-SDS team for Task 1 of the CLEF 2020 CheckThat! shared task. The purpose of this task is to determine the check-worthiness of tweets about COVID-19 to identify and prioritise tweets that…

Computation and Language · Computer Science 2020-09-01 Rabab Alkhalifa , Theodore Yoong , Elena Kochkina , Arkaitz Zubiaga , Maria Liakata

Fake information poses one of the major threats for society in the 21st century. Identifying misinformation has become a key challenge due to the amount of fake news that is published daily. Yet, no approach is established that addresses…

Information Retrieval · Computer Science 2021-03-30 Vishwani Gupta , Katharina Beckh , Sven Giesselbach , Dennis Wegener , Tim Wirtz

With the increasing number of clinical trial reports generated every day, it is becoming hard to keep up with novel discoveries that inform evidence-based healthcare recommendations. To help automate this process and assist medical experts,…

Computation and Language · Computer Science 2023-05-03 Juraj Vladika , Florian Matthes

Real-world fact verification task aims to verify the factuality of a claim by retrieving evidence from the source document. The quality of the retrieved evidence plays an important role in claim verification. Ideally, the retrieved evidence…

Computation and Language · Computer Science 2023-05-08 Xuming Hu , Zhaochen Hong , Zhijiang Guo , Lijie Wen , Philip S. Yu

Misinformation spreading in mainstream and social media has been misleading users in different ways. Manual detection and verification efforts by journalists and fact-checkers can no longer cope with the great scale and quick spread of…

Computation and Language · Computer Science 2023-05-08 Maram Hasanain , Ahmed Oumar El-Shangiti , Rabindra Nath Nandi , Preslav Nakov , Firoj Alam

We present the results and the main findings of the NLP4IF-2021 shared tasks. Task 1 focused on fighting the COVID-19 infodemic in social media, and it was offered in Arabic, Bulgarian, and English. Given a tweet, it asked to predict…

Computation and Language · Computer Science 2021-09-28 Shaden Shaar , Firoj Alam , Giovanni Da San Martino , Alex Nikolov , Wajdi Zaghouani , Preslav Nakov , Anna Feldman