English
Related papers

Related papers: MultiFC: A Real-World Multi-Domain Dataset for Evi…

200 papers

We study the fact checking problem, which aims to identify the veracity of a given claim. Specifically, we focus on the task of Fact Extraction and VERification (FEVER) and its accompanied dataset. The task consists of the subtasks of…

Computation and Language · Computer Science 2021-11-22 Giannis Bekoulis , Christina Papagiannopoulou , Nikos Deligiannis

Automated fact-checking is a crucial task that supports a responsible information ecosystem. While recent research has progressed from text-only to multimodal fact-checking, a prevailing assumption is that incorporating visual evidence…

Computation and Language · Computer Science 2026-05-14 Jaeyoon Jung , Yejun Yoon , Kunwoo Park

Fact verification has attracted a lot of attention in the machine learning and natural language processing communities, as it is one of the key methods for detecting misinformation. Existing large-scale benchmarks for this task have focused…

Evaluating scientific arguments requires assessing the strict consistency between a claim and its underlying multimodal evidence. However, existing benchmarks lack the scale, domain diversity, and visual complexity needed to evaluate this…

Computation and Language · Computer Science 2026-04-21 Abolfazl Ansari , Delvin Ce Zhang , Zhuoyang Zou , Wenpeng Yin , Dongwon Lee

Automated Fact-Checking (AFC) relies on claim extraction as a first step, yet existing methods largely overlook the multimodal nature of today's misinformation. Social media posts often combine short, informal text with images such as…

Computation and Language · Computer Science 2026-04-21 Joycelyn Teo , Rui Cao , Zhenyun Deng , Zifeng Ding , Michael Sejr Schlichtkrull , Andreas Vlachos

As online false information continues to grow, automated fact-checking has gained an increasing amount of attention in recent years. Researchers in the field of Natural Language Processing (NLP) have contributed to the task by building…

Computation and Language · Computer Science 2021-09-24 Xia Zeng , Amani S. Abumansour , Arkaitz Zubiaga

Fact-checking plays a crucial role in combating misinformation. Existing methods using large language models (LLMs) for claim decomposition face two key limitations: (1) insufficient decomposition, introducing unnecessary complexity to the…

Computation and Language · Computer Science 2025-03-11 Yani Huang , Richong Zhang , Zhijie Nie , Junfan Chen , Xuefeng Zhang

The topic of summarization evaluation has recently attracted a surge of attention due to the rapid development of abstractive summarization systems. However, the formulation of the task is rather ambiguous, neither the linguistic nor the…

Computation and Language · Computer Science 2022-11-01 Yanzhu Guo , Chloé Clavel , Moussa Kamal Eddine , Michalis Vazirgiannis

There is unison is the scientific community about human induced climate change. Despite this, we see the web awash with claims around climate change scepticism, thus driving the need for fact checking them but at the same time providing an…

Computation and Language · Computer Science 2021-08-02 Shraey Bhatia , Jey Han Lau , Timothy Baldwin

Fact-checking in financial domain is under explored, and there is a shortage of quality dataset in this domain. In this paper, we propose Fin-Fact, a benchmark dataset for multimodal fact-checking within the financial domain. Notably, it…

Artificial Intelligence · Computer Science 2024-05-03 Aman Rangapur , Haoran Wang , Ling Jian , Kai Shu

Large Language Models tend to struggle when dealing with specialized domains. While all aspects of evaluation hold importance, factuality is the most critical one. Similarly, reliable fact-checking tools and data sources are essential for…

Computation and Language · Computer Science 2025-09-03 Anum Afzal , Juraj Vladika , Florian Matthes

With the widespread consumption of AI-generated content, there has been an increased focus on developing automated tools to verify the factual accuracy of such content. However, prior research and tools developed for fact verification treat…

Computation and Language · Computer Science 2025-03-20 Varich Boonsanong , Vidhisha Balachandran , Xiaochuang Han , Shangbin Feng , Lucy Lu Wang , Yulia Tsvetkov

This paper describes our participant system for the multi-modal fact verification (Factify) challenge at AAAI 2022. Despite the recent advance in text based verification techniques and large pre-trained multimodal models cross vision and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jie Gao , Hella-Franziska Hoffmann , Stylianos Oikonomou , David Kiskovski , Anil Bandhakavi

In this paper we present the ClaimBuster dataset of 23,533 statements extracted from all U.S. general election presidential debates and annotated by human coders. The ClaimBuster dataset can be leveraged in building computational methods to…

Computation and Language · Computer Science 2020-05-01 Fatma Arslan , Naeemul Hassan , Chengkai Li , Mark Tremayne

In this paper we introduce a new publicly available dataset for verification against textual sources, FEVER: Fact Extraction and VERification. It consists of 185,445 claims generated by altering sentences extracted from Wikipedia and…

Computation and Language · Computer Science 2018-12-19 James Thorne , Andreas Vlachos , Christos Christodoulopoulos , Arpit Mittal

We present an overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims, with focus on Task 1: Check-Worthiness. The task asks to predict which claims in a political debate should be…

We introduce 'FactCheck Editor', an advanced text editor designed to automate fact-checking and correct factual inaccuracies. Given the widespread issue of misinformation, often a result of unintentional mistakes by content creators, our…

Computation and Language · Computer Science 2024-05-01 Vinay Setty

Automated fact checking systems have been proposed that quickly provide veracity prediction at scale to mitigate the negative influence of fake news on people and on public opinion. However, most studies focus on veracity classifiers of…

Computation and Language · Computer Science 2022-06-15 Shih-Chieh Dai , Yi-Li Hsu , Aiping Xiong , Lun-Wei Ku

False information has a significant negative influence on individuals as well as on the whole society. Especially in the current COVID-19 era, we witness an unprecedented growth of medical misinformation. To help tackle this problem with…

Computation and Language · Computer Science 2022-04-27 Ivan Srba , Branislav Pecher , Matus Tomlein , Robert Moro , Elena Stefancova , Jakub Simko , Maria Bielikova

Evaluating the factuality of long-form generations from Large Language Models (LLMs) remains challenging due to efficiency bottlenecks and reliability concerns. Prior efforts attempt this by decomposing text into claims, searching for…

Computation and Language · Computer Science 2025-11-06 Yingjia Wan , Haochen Tan , Xiao Zhu , Xinyu Zhou , Zhiwei Li , Qingsong Lv , Changxuan Sun , Jiaqi Zeng , Yi Xu , Jianqiao Lu , Yinhong Liu , Zhijiang Guo