English
Related papers

Related papers: DEFAME: Dynamic Evidence-based FAct-checking with …

200 papers

This paper describes VILLAIN, a multimodal fact-checking system that verifies image-text claims through prompt-based multi-agent collaboration. For the AVerImaTeC shared task, VILLAIN employs vision-language model agents across multiple…

Computation and Language · Computer Science 2026-02-23 Jaeyoon Jung , Yejun Yoon , Kunwoo Park

Automated fact-checking aims to assess the truthfulness of textual claims based on relevant evidence. However, verifying complex claims that require multi-hop reasoning remains a significant challenge. We propose GraphCheck, a novel…

Computation and Language · Computer Science 2025-11-10 Hyewon Jeon , Jay-Yoon Lee

Evidence retrieval is a core part of automatic fact-checking. Prior work makes simplifying assumptions in retrieval that depart from real-world use cases: either no access to evidence, access to evidence curated by a human fact-checker, or…

Computation and Language · Computer Science 2024-06-18 Jifan Chen , Grace Kim , Aniruddh Sriram , Greg Durrett , Eunsol Choi

LLM-based approaches have recently achieved impressive results in zero-shot stance detection. However, they still struggle in complex real-world scenarios, where stance understanding requires dynamic background knowledge, target definitions…

Computation and Language · Computer Science 2025-12-05 Yuanshuo Zhang , Aohua Li , Bo Chen , Jingbo Sun , Xiaobing Zhao

With the widespread consumption of AI-generated content, there has been an increased focus on developing automated tools to verify the factual accuracy of such content. However, prior research and tools developed for fact verification treat…

Computation and Language · Computer Science 2025-03-20 Varich Boonsanong , Vidhisha Balachandran , Xiaochuang Han , Shangbin Feng , Lucy Lu Wang , Yulia Tsvetkov

In this work, we introduce X-FACT: the largest publicly available multilingual dataset for factual verification of naturally existing real-world claims. The dataset contains short statements in 25 languages and is labeled for veracity by…

Computation and Language · Computer Science 2021-06-18 Ashim Gupta , Vivek Srikumar

The proliferation of misinformation in digital platforms reveals the limitations of traditional detection methods, which mostly rely on static classification and fail to capture the intricate process of real-world fact-checking. Despite…

Computation and Language · Computer Science 2025-08-27 Chen Han , Wenzhen Zheng , Xijin Tang

Separating disinformation from fact on the web has long challenged both the search and the reasoning powers of humans. We show that the reasoning power of large language models (LLMs) and the retrieval power of modern search engines can be…

Computation and Language · Computer Science 2024-11-11 Christopher Malon

Online disinformation poses an escalating threat to society, driven increasingly by the rapid spread of misleading content across both multimedia and multilingual platforms. While automated fact-checking methods have advanced in recent…

Computation and Language · Computer Science 2026-01-19 Rafael Martins Frade , Rrubaa Panchendrarajan , Arkaitz Zubiaga

Fact-checking in financial domain is under explored, and there is a shortage of quality dataset in this domain. In this paper, we propose Fin-Fact, a benchmark dataset for multimodal fact-checking within the financial domain. Notably, it…

Artificial Intelligence · Computer Science 2024-05-03 Aman Rangapur , Haoran Wang , Ling Jian , Kai Shu

The proliferation of synthetic images generated by advanced AI models poses significant challenges in identifying and understanding manipulated visual content. Current fake image detection methods predominantly rely on binary classification…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Ritabrata Chakraborty , Rajatsubhra Chakraborty , Ali Khaleghi Rahimian , Thomas MacDougall

Detecting fake news in large datasets is challenging due to its diversity and complexity, with traditional approaches often focusing on textual features while underutilizing semantic and emotional elements. Current methods also rely heavily…

Computation and Language · Computer Science 2024-10-22 Xiaoman Xu , Xiangrun Li , Taihang Wang , Ye Jiang

Identifying fake news is a very difficult task, especially when considering the multiple modes of conveying information through text, image, video and/or audio. We attempted to tackle the problem of automated misinformation/disinformation…

Multimedia · Computer Science 2022-03-16 Abhishek Dhankar , Osmar R. Zaïane , Francois Bolduc

Fact-checking plays a crucial role in combating misinformation. Existing methods using large language models (LLMs) for claim decomposition face two key limitations: (1) insufficient decomposition, introducing unnecessary complexity to the…

Computation and Language · Computer Science 2025-03-11 Yani Huang , Richong Zhang , Zhijie Nie , Junfan Chen , Xuefeng Zhang

The Fact Extraction and VERification (FEVER) shared task was launched to support the development of systems able to verify claims by extracting supporting or refuting facts from raw text. The shared task organizers provide a large-scale…

Information Retrieval · Computer Science 2019-05-10 Andreas Hanselowski , Hao Zhang , Zile Li , Daniil Sorokin , Benjamin Schiller , Claudia Schulz , Iryna Gurevych

The growing scale of online misinformation urgently demands Automated Fact-Checking (AFC). Existing benchmarks for evaluating AFC systems, however, are largely limited in terms of task scope, modalities, domain, language diversity, realism,…

Information Retrieval · Computer Science 2026-05-01 Mark Rothermel , Marcus Kornmann , Marcus Rohrbach , Anna Rohrbach

We contribute the largest publicly available dataset of naturally occurring factual claims for the purpose of automatic claim verification. It is collected from 26 fact checking websites in English, paired with textual sources and rich…

Computation and Language · Computer Science 2019-10-22 Isabelle Augenstein , Christina Lioma , Dongsheng Wang , Lucas Chaves Lima , Casper Hansen , Christian Hansen , Jakob Grue Simonsen

Fact verification plays a vital role in combating misinformation by assessing the veracity of claims through evidence retrieval and reasoning. However, traditional methods struggle with complex claims requiring multi-hop reasoning over…

Artificial Intelligence · Computer Science 2025-06-10 Liwen Zheng , Chaozhuo Li , Zheng Liu , Feiran Huang , Haoran Jia , Zaisheng Ye , Xi Zhang

Are frontier AI systems becoming more capable? Certainly. Yet such progress is not an unalloyed blessing but rather a Trojan horse: behind their performance leaps lie more insidious and destructive safety risks, namely deception. Unlike…

Artificial Intelligence · Computer Science 2026-05-28 Sitong Fang , Shiyi Hou , Kaile Wang , Boyuan Chen , Donghai Hong , Jiayi Zhou , Josef Dai , Yaodong Yang , Jiaming Ji

The rapid progress of multimodal large language models (MLLMs) calls for more reliable evaluation protocols. Existing static benchmarks suffer from the potential risk of data contamination and saturation, leading to inflated or misleading…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Junzhe Zhang , Huixuan Zhang , Xiaojun Wan