English
Related papers

Related papers: Evidence-Grounded Multimodal Misinformation Detect…

200 papers

Misinformation has become a major challenge in the era of increasing digital information, requiring the development of effective detection methods. We have investigated a novel approach to Out-Of-Context detection (OOCD) that uses synthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Fatma Shalabi , Huy H. Nguyen , Hichem Felouat , Ching-Chun Chang , Isao Echizen

Multimodal Misinformation Detection (MMD) refers to the task of detecting social media posts involving misinformation, where the post often contains text and image modalities. However, by observing the MMD posts, we hold that the text…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Bing Wang , Ximing Li , Yanjun Wang , Changchun Li , Lin Yuanbo Wu , Buyu Wang , Shengsheng Wang

Despite the recent attention to DeepFakes, one of the most prevalent ways to mislead audiences on social media is the use of unaltered images in a new but false context. To address these challenges and support fact-checkers, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Shivangi Aneja , Chris Bregler , Matthias Nießner

Detecting multimodal misinformation, especially in the form of image-text pairs, is crucial. Obtaining large-scale, high-quality real-world fact-checking datasets for training detectors is costly, leading researchers to use synthetic…

Computation and Language · Computer Science 2024-10-01 Fengzhu Zeng , Wenqian Li , Wei Gao , Yan Pang

Explainable fake news detection aims to assess the veracity of news claims while providing human-friendly explanations. Existing methods incorporating investigative journalism are often inefficient and struggle with breaking news. Recent…

Computation and Language · Computer Science 2026-04-09 Bo Wang , Jing Ma , Hongzhan Lin , Zhiwei Yang , Ruichao Yang , Yuan Tian , Yi Chang

With the expansion of social media and the increasing dissemination of multimedia content, the spread of misinformation has become a major concern. This necessitates effective strategies for multimodal misinformation detection (MMD) that…

The proliferation of disinformation, particularly in multimodal contexts combining text and images, presents a significant challenge across digital platforms. This study investigates the potential of large multimodal models (LMMs) in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Yasmina Kheddache , Marc Lalonde

Even when factually correct, social-media news previews (image-headline pairs) can induce interpretation drift: by selectively omitting crucial context, they lead readers to form judgments that diverge from what the full article supports.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Fanxiao Li , Jiaying Wu , Tingchao Fu , Dayang Li , Herun Wan , Wei Zhou , Min-Yen Kan

Out-of-context (OOC) detection is a challenging task involving identifying images and texts that are irrelevant to the context in which they are presented. Large vision-language models (LVLMs) are effective at various tasks, including image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Fatma Shalabi , Hichem Felouat , Huy H. Nguyen , Isao Echizen

Recent advancements in multimodal out-of-context (OOC) misinformation detection have made remarkable progress in checking the consistencies between different modalities for supporting or refuting image-text pairs. However, existing OOC…

Computation and Language · Computer Science 2025-11-19 Junjie Wu , Yumeng Fu , Nan Yu , Guohong Fu

The rapid growth of social media has resulted in an explosion of online news content, leading to a significant increase in the spread of misleading or false information. While machine learning techniques have been widely applied to detect…

Computation and Language · Computer Science 2024-12-10 Hao Chen , Hui Guo , Baochen Hu , Shu Hu , Jinrong Hu , Siwei Lyu , Xi Wu , Xin Wang

Climate disinformation has become a major challenge in today digital world, especially with the rise of misleading images and videos shared widely on social media. These false claims are often convincing and difficult to detect, which can…

Artificial Intelligence · Computer Science 2026-01-23 Marzieh Adeli Shamsabad , Hamed Ghodrati

The most effective misinformation campaigns are multimodal, often combining text with images and videos taken out of context -- or fabricating them entirely -- to support a given narrative. Contemporary methods for detecting misinformation,…

Computation and Language · Computer Science 2025-02-17 Tomas Peterka , Matyas Bohacek

Online misinformation is a prevalent societal issue, with adversaries relying on tools ranging from cheap fakes to sophisticated deep fakes. We are motivated by the threat scenario where an image is used out of context to support a certain…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Grace Luo , Trevor Darrell , Anna Rohrbach

The web has become a crucial source of information, but it is also used to spread disinformation, often conveyed through multiple modalities like images and text. The identification of inconsistent cross-modal information, in particular…

Computation and Language · Computer Science 2025-02-03 Sahar Tahmasebi , David Ernst , Eric Müller-Budack , Ralph Ewerth

Multimodal misinformation on online social platforms is becoming a critical concern due to increasing credibility and easier dissemination brought by multimedia content, compared to traditional text-only information. While existing…

Multimedia · Computer Science 2024-09-17 Hui Liu , Wenya Wang , Haoliang Li

The rapid spread of information through mobile devices and media has led to the widespread of false or deceptive news, causing significant concerns in society. Among different types of misinformation, image repurposing, also known as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Huanhuan Ma , Jinghao Zhang , Qiang Liu , Shu Wu , Liang Wang

The prevalence and perniciousness of fake news has been a critical issue on the Internet, which stimulates the development of automatic fake news detection in turn. In this paper, we focus on the evidence-based fake news detection, where…

Computation and Language · Computer Science 2022-02-09 Weizhi Xu , Junfei Wu , Qiang Liu , Shu Wu , Liang Wang

Detecting out-of-context media, such as "mis-captioned" images on Twitter, is a relevant problem, especially in domains of high public significance. In this work we aim to develop defenses against such misinformation for the topics of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Giscard Biamby , Grace Luo , Trevor Darrell , Anna Rohrbach

The rapid spread of online misinformation has led to increasingly complex detection models, including large language models and hybrid architectures. However, their computational cost and deployment limitations raise concerns about…

Computation and Language · Computer Science 2026-04-10 Soveatin Kuntur , Maciej Krzywda , Anna Wróblewska , Marcin Paprzycki , Maria Ganzha , Szymon Łukasik , Amir H. Gandomi