English
Related papers

Related papers: MMFakeBench: A Mixed-Source Multimodal Misinformat…

200 papers

The rapid advancement of multimodal large language models (MLLMs) has significantly enhanced performance across benchmarks. However, data contamination-unintentional memorization of benchmark data during model training-poses critical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Dingjie Song , Sicheng Lai , Mingxuan Wang , Shunian Chen , Lichao Sun , Benyou Wang

The rapid growth of social media has resulted in an explosion of online news content, leading to a significant increase in the spread of misleading or false information. While machine learning techniques have been widely applied to detect…

Computation and Language · Computer Science 2024-12-10 Hao Chen , Hui Guo , Baochen Hu , Shu Hu , Jinrong Hu , Siwei Lyu , Xi Wu , Xin Wang

The rapid spread of fake news across multimedia platforms presents serious challenges to information credibility. In this paper, we propose a Debunk-and-Infer framework for Fake News Detection(DIFND) that leverages debunking knowledge to…

Computation and Language · Computer Science 2025-06-30 Kaiying Yan , Moyang Liu , Yukun Liu , Ruibo Fu , Zhengqi Wen , Jianhua Tao , Xuefei Liu

Nowadays, misinformation articles, especially multimodal ones, are widely spread on social media platforms and cause serious negative effects. To control their propagation, Multimodal Misinformation Detection (MMD) becomes an active topic…

Computation and Language · Computer Science 2025-07-09 Bing Wang , Ximing Li , Mengzhe Ye , Changchun Li , Bo Fu , Jianfeng Qu , Lin Yuanbo Wu

Built on the power of LLMs, numerous multimodal large language models (MLLMs) have recently achieved remarkable performance on various vision-language tasks. However, most existing MLLMs and benchmarks primarily focus on single-image input…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Haowei Liu , Xi Zhang , Haiyang Xu , Yaya Shi , Chaoya Jiang , Ming Yan , Ji Zhang , Fei Huang , Chunfeng Yuan , Bing Li , Weiming Hu

With the rise of easily accessible tools for generating and manipulating multimedia content, realistic synthetic alterations to digital media have become a widespread threat, often involving manipulations across multiple modalities…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Daniele Cardullo , Simone Teglia , Irene Amerini

Multimodal large language models (MLLMs) have demonstrated strong capabilities in vision-related tasks, capitalizing on their visual semantic comprehension and reasoning capabilities. However, their ability to detect subtle visual spoofing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Yichen Shi , Yuhao Gao , Yingxin Lai , Hongyang Wang , Jun Feng , Lei He , Jun Wan , Changsheng Chen , Zitong Yu , Xiaochun Cao

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

Computation and Language · Computer Science 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych

The rise of multimodal misinformation on social platforms poses significant challenges for individuals and societies. Its increased credibility and broader impact compared to textual misinformation make detection complex, requiring robust…

Computation and Language · Computer Science 2024-06-24 Keyang Xuan , Li Yi , Fan Yang , Ruochen Wu , Yi R. Fung , Heng Ji

The landscape of social media content has evolved significantly, extending from text to multimodal formats. This evolution presents a significant challenge in combating misinformation. Previous research has primarily focused on single…

Multimedia · Computer Science 2024-09-04 Zhe Fu , Kanlun Wang , Wangjiaxuan Xin , Lina Zhou , Shi Chen , Yaorong Ge , Daniel Janies , Dongsong Zhang

Large Multimodal Models(LMMs) face notable challenges when encountering multimodal knowledge conflicts, particularly under retrieval-augmented generation(RAG) frameworks where the contextual information from external sources may contradict…

Automatic detection of multimodal misinformation has gained a widespread attention recently. However, the potential of powerful Large Language Models (LLMs) for multimodal misinformation detection remains underexplored. Besides, how to…

Computation and Language · Computer Science 2024-04-09 Longzheng Wang , Xiaohan Xu , Lei Zhang , Jiarui Lu , Yongxiu Xu , Hongbo Xu , Minghao Tang , Chuang Zhang

The widespread prevalence of misinformation poses significant societal concerns. Out-of-context misinformation, where authentic images are paired with false text, is particularly deceptive and easily misleads audiences. Most existing…

Artificial Intelligence · Computer Science 2025-02-04 Giovanni Pio Delvecchio , Huy Hong Nguyen , Isao Echizen

The proliferation of misinformation on social media has raised significant societal concerns, necessitating robust detection mechanisms. Large Language Models such as GPT-4 and LLaMA2 have been envisioned as possible tools for detecting…

Computation and Language · Computer Science 2025-03-04 Tianyi Huang , Jingyuan Yi , Peiyang Yu , Xiaochuan Xu

The security concerns surrounding Large Language Models (LLMs) have been extensively explored, yet the safety of Multimodal Large Language Models (MLLMs) remains understudied. In this paper, we observe that Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xin Liu , Yichen Zhu , Jindong Gu , Yunshi Lan , Chao Yang , Yu Qiao

Multimodal large language models (MLLMs) have substantially advanced video misinformation detection through unified multimodal reasoning, but they often rely on fixed-depth inference and place excessive trust in internally generated…

Artificial Intelligence · Computer Science 2026-02-27 Zehao Li , Hongwei Yu , Hao Jiang , Qiang Sheng , Yilong Xu , Baolong Bi , Yang Li , Zhenlong Yuan , Yujun Cai , Zhaoqi Wang

Misleading visualizations, which manipulate chart representations to support specific claims, can distort perception and lead to incorrect conclusions. Despite decades of research, they remain a widespread issue, posing risks to public…

Computation and Language · Computer Science 2025-09-23 Zixin Chen , Sicheng Song , Kashun Shum , Yanna Lin , Rui Sheng , Weiqi Wang , Huamin Qu

Multimodal large language models (MLLMs) are prone to non-factual or outdated knowledge issues, which can manifest as misreading and misrecognition errors due to the complexity of multimodal knowledge. Previous benchmarks have not…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Junzhe Zhang , Huixuan Zhang , Xunjian Yin , Baizhou Huang , Xu Zhang , Xinyu Hu , Xiaojun Wan

Given the growing influx of misinformation across news and social media, there is a critical need for systems that can provide effective real-time verification of news claims. Large language or multimodal model based verification has been…

Computation and Language · Computer Science 2024-07-02 Jaeyoung Lee , Ximing Lu , Jack Hessel , Faeze Brahman , Youngjae Yu , Yonatan Bisk , Yejin Choi , Saadia Gabriel

The rapid progress of Large Language Models (LLMs) has spurred growing interest in Multi-modal LLMs (MLLMs) and motivated the development of benchmarks to evaluate their perceptual and comprehension abilities. Existing benchmarks, however,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Purui Bai , Tao Wu , Jiayang Sun , Xinyue Liu , Huaibo Huang , Ran He