English
Related papers

Related papers: DEFAME: Dynamic Evidence-based FAct-checking with …

200 papers

For the ACMMM25 challenge, we present a practical engineering approach to multimedia news source verification, utilizing Large Language Models (LLMs) like GPT-4o as the backbone of our pipeline. Our method processes images and videos…

With the rapid advancement of generative models, the realism of AI-generated images has significantly improved, posing critical challenges for verifying digital content authenticity. Current deepfake detection methods often depend on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Jiarui Wang , Huiyu Duan , Juntong Wang , Ziheng Jia , Woo Yi Yang , Xiaorong Zhu , Yu Zhao , Jiaying Qian , Yuke Xing , Guangtao Zhai , Xiongkuo Min

The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for misinformation detection and fact checking. Recent advances on large language models (LLMs) have…

Computation and Language · Computer Science 2024-07-22 Sahar Tahmasebi , Eric Müller-Budack , Ralph Ewerth

The rapid spread of fake news across multimedia platforms presents serious challenges to information credibility. In this paper, we propose a Debunk-and-Infer framework for Fake News Detection(DIFND) that leverages debunking knowledge to…

Computation and Language · Computer Science 2025-06-30 Kaiying Yan , Moyang Liu , Yukun Liu , Ruibo Fu , Zhengqi Wen , Jianhua Tao , Xuefei Liu

Fact verification (FV) aims to assess the veracity of a claim based on relevant evidence. The traditional approach for automated FV includes a three-part pipeline relying on short evidence snippets and encoder-only inference models. More…

Computation and Language · Computer Science 2025-02-21 Juraj Vladika , Ivana Hacajová , Florian Matthes

Universal fact-checking systems for real-world claims face significant challenges in gathering valid and sufficient real-time evidence and making reasoned decisions. In this work, we introduce the Open-domain Explainable Fact-checking…

Computation and Language · Computer Science 2023-12-12 Xin Tan , Bowei Zou , Ai Ti Aw

We propose end-to-end multimodal fact-checking and explanation generation, where the input is a claim and a large collection of web sources, including articles, images, videos, and tweets, and the goal is to assess the truthfulness of the…

Computation and Language · Computer Science 2023-07-10 Barry Menglong Yao , Aditya Shah , Lichao Sun , Jin-Hee Cho , Lifu Huang

Multimedia content has become ubiquitous on social media platforms, leading to the rise of multimodal misinformation (MM) and the urgent need for effective strategies to detect and prevent its spread. In recent years, the challenge of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Stefanos-Iordanis Papadopoulos , Christos Koutlis , Symeon Papadopoulos , Panagiotis C. Petrantonakis

Textual claims are often accompanied by images to enhance their credibility and spread on social media, but this also raises concerns about the spread of misinformation. Existing datasets for automated verification of image-text claims…

Computation and Language · Computer Science 2025-10-08 Rui Cao , Zifeng Ding , Zhijiang Guo , Michael Schlichtkrull , Andreas Vlachos

Combating disinformation is one of the burning societal crises -- about 67% of the American population believes that disinformation produces a lot of uncertainty, and 10% of them knowingly propagate disinformation. Evidence shows that…

Existing real-world datasets for multimodal fact-checking have multiple limitations: they contain few instances, focus on only one or two languages and tasks, suffer from evidence leakage, or rely on external sets of news articles for…

Computation and Language · Computer Science 2026-01-13 Jiahui Geng , Jonathan Tonglet , Iryna Gurevych

Multimodal deception detection aims to identify deceptive behavior by analyzing audiovisual cues for forensics and security. In these high-stakes settings, investigators need verifiable evidence connecting audiovisual cues to final…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jiajian Huang , Dongliang Zhu , Zitong YU , Hui Ma , Jiayu Zhang , Chunmei Zhu , Xiaochun Cao

The proliferation of multimedia content on social media platforms has dramatically transformed how information is consumed and disseminated. While this shift enables real-time coverage of global events, it also facilitates the rapid spread…

The increased use of large language models (LLMs) across a variety of real-world applications calls for mechanisms to verify the factual accuracy of their outputs. Difficulties lie in assessing the factuality of free-form responses in open…

Computation and Language · Computer Science 2025-10-30 Yuxia Wang , Minghan Wang , Hasan Iqbal , Georgi Georgiev , Jiahui Geng , Preslav Nakov

Fact-checking real-world claims often requires reviewing multiple multimodal documents to assess a claim's truthfulness, which is a highly laborious and time-consuming task. In this paper, we present a summarization model designed to…

Artificial Intelligence · Computer Science 2024-09-23 Ting-Chih Chen , Chia-Wei Tang , Chris Thomas

Online misinformation is often multimodal in nature, i.e., it is caused by misleading associations between texts and accompanying images. To support the fact-checking process, researchers have been recently developing automatic multimodal…

The proliferation of deepfake technologies poses urgent challenges and serious risks to digital integrity, particularly within critical sectors such as forensics, journalism, and the legal system. While existing detection systems have made…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Shahroz Tariq , Simon S. Woo , Priyanka Singh , Irena Irmalasari , Saakshi Gupta , Dev Gupta

The proliferation of sophisticated AI-generated deepfakes poses critical challenges for digital media authentication and societal security. While existing detection methods perform well within specific generative domains, they exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Naseem Khan , Tuan Nguyen , Amine Bermak , Issa Khalil

Verifying the truthfulness of claims usually requires joint multi-modal reasoning over both textual and visual evidence, such as analyzing both textual caption and chart image for claim verification. In addition, to make the reasoning…

Computation and Language · Computer Science 2026-02-11 Delvin Ce Zhang , Suhan Cui , Zhelin Chu , Xianren Zhang , Dongwon Lee

The rise of disinformation on social media, especially through the strategic manipulation or repurposing of images, paired with provocative text, presents a complex challenge for traditional fact-checking methods. In this paper, we…

Multimedia · Computer Science 2025-04-11 Arka Ujjal Dey , Artemis Llabrés , Ernest Valveny , Dimosthenis Karatzas