English
Related papers

Related papers: End-to-End Multimodal Fact-Checking and Explanatio…

200 papers

Existing datasets for automated fact-checking have substantial limitations, such as relying on artificial claims, lacking annotations for evidence and intermediate reasoning, or including evidence published after the claim. In this paper we…

Computation and Language · Computer Science 2023-11-09 Michael Schlichtkrull , Zhijiang Guo , Andreas Vlachos

Multimodal counterfactual reasoning is a vital yet challenging ability for AI systems. It involves predicting the outcomes of hypothetical circumstances based on vision and language inputs, which enables AI models to learn from failures and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Te-Lin Wu , Zi-Yi Dou , Qingyuan Hu , Yu Hou , Nischal Reddy Chandra , Marjorie Freedman , Ralph M. Weischedel , Nanyun Peng

False information has a significant negative influence on individuals as well as on the whole society. Especially in the current COVID-19 era, we witness an unprecedented growth of medical misinformation. To help tackle this problem with…

Computation and Language · Computer Science 2022-04-27 Ivan Srba , Branislav Pecher , Matus Tomlein , Robert Moro , Elena Stefancova , Jakub Simko , Maria Bielikova

Despite the rapid progress in multihop question-answering (QA), models still have trouble explaining why an answer is correct, with limited explanation training data available to learn from. To address this, we introduce three explanation…

Computation and Language · Computer Science 2020-10-08 Harsh Jhamtani , Peter Clark

Misinformation on the web increasingly appears in multimodal forms, combining text, images, and OCR-rendered content in ways that amplify harm to public trust and vulnerable communities. While prior fact-checking systems often rely on…

Computation and Language · Computer Science 2026-01-14 Aditya Kishore , Gaurav Kumar , Jasabanta Patro

Large Language Models (LLMs) augmented with retrieval mechanisms have demonstrated significant potential in fact-checking tasks by integrating external knowledge. However, their reliability decreases when confronted with conflicting…

Computation and Language · Computer Science 2025-05-26 Ziyu Ge , Yuhao Wu , Daniel Wai Kit Chin , Roy Ka-Wei Lee , Rui Cao

The proliferation of disinformation demands reliable and scalable fact-checking solutions. We present Dynamic Evidence-based FAct-checking with Multimodal Experts (DEFAME), a modular, zero-shot MLLM pipeline for open-domain, text-image…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Tobias Braun , Mark Rothermel , Marcus Rohrbach , Anna Rohrbach

To inhibit the spread of rumorous information and its severe consequences, traditional fact checking aims at retrieving relevant evidence to verify the veracity of a given claim. Fact checking methods typically use knowledge graphs (KGs) as…

Artificial Intelligence · Computer Science 2024-07-30 Shuai Wang , Penghui Wei , Qingchao Kong , Wenji Mao

Recent work has proposed multi-hop models and datasets for studying complex natural language reasoning. One notable task requiring multi-hop reasoning is fact checking, where a set of connected evidence pieces leads to the final verdict of…

Computation and Language · Computer Science 2021-06-02 Wojciech Ostrowski , Arnav Arora , Pepa Atanasova , Isabelle Augenstein

Evidence plays a crucial role in automated fact-checking. When verifying real-world claims, existing fact-checking systems either assume the evidence sentences are given or use the search snippets returned by the search engine. Such methods…

Computation and Language · Computer Science 2024-01-30 Xuming Hu , Junzhe Chen , Zhijiang Guo , Philip S. Yu

In the context of fact-checking, claims are often repeated across various platforms and in different languages, which can benefit from a process that reduces this redundancy. While retrieving previously fact-checked claims has been…

Computation and Language · Computer Science 2025-03-31 Rrubaa Panchendrarajan , Rubén Míguez , Arkaitz Zubiaga

Fighting misinformation is a challenging, yet crucial, task. Despite the growing number of experts being involved in manual fact-checking, this activity is time-consuming and cannot keep up with the ever-increasing amount of Fake News…

Computation and Language · Computer Science 2023-08-30 Daniel Russo , Serra Sinem Tekiroglu , Marco Guerini

Fact-checking real-world claims often requires complex, multi-step reasoning due to the absence of direct evidence to support or refute them. However, existing fact-checking systems often lack transparency in their decision-making, making…

Computation and Language · Computer Science 2023-10-12 Liangming Pan , Xinyuan Lu , Min-Yen Kan , Preslav Nakov

Automated fact-checking systems verify claims against evidence to predict their veracity. In real-world scenarios, the retrieved evidence may not unambiguously support or refute the claim and yield conflicting but valid interpretations.…

Computation and Language · Computer Science 2023-12-15 Max Glockner , Ieva Staliūnaitė , James Thorne , Gisela Vallejo , Andreas Vlachos , Iryna Gurevych

Robust automatic fact-checking systems have the potential to combat online misinformation at scale. However, most existing research primarily focuses on English. In this paper, we introduce MultiSynFact, the first large-scale multilingual…

Computation and Language · Computer Science 2025-02-24 Yi-Ling Chung , Aurora Cobo , Pablo Serna

The rapid spread of misinformation in the digital era poses significant challenges to public discourse, necessitating robust and scalable fact-checking solutions. Traditional human-led fact-checking methods, while credible, struggle with…

Artificial Intelligence · Computer Science 2025-06-24 Tam Trinh , Manh Nguyen , Truong-Son Hy

We introduce a high-quality dataset that contains 3,397 samples comprising (i) multiple choice questions, (ii) answers (including distractors), and (iii) their source documents, from the educational domain. Each question is phrased in two…

Computation and Language · Computer Science 2022-10-13 Amir Hadifar , Semere Kiros Bitew , Johannes Deleu , Chris Develder , Thomas Demeester

We introduce 'FactCheck Editor', an advanced text editor designed to automate fact-checking and correct factual inaccuracies. Given the widespread issue of misinformation, often a result of unintentional mistakes by content creators, our…

Computation and Language · Computer Science 2024-05-01 Vinay Setty

Unsupported and unfalsifiable claims we encounter in our daily lives can influence our view of the world. Characterizing, summarizing, and -- more generally -- making sense of such claims, however, can be challenging. In this work, we focus…

Computation and Language · Computer Science 2023-09-20 Peter Ebert Christensen , Srishti Yadav , Serge Belongie

Multimodal Large Language Models are primarily trained and evaluated on aligned image-text pairs, which leaves their ability to detect and resolve real-world inconsistencies largely unexplored. In open-domain applications visual and textual…