English
Related papers

Related papers: SNIFFER: Multimodal Large Language Model for Expla…

200 papers

The increasing realism of multimodal content has made misinformation more subtle and harder to detect, especially in news media where images are frequently paired with bilingual (e.g., Chinese-English) subtitles. Such content often includes…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Yiwei He , Zhenglin Huang , Haiquan Wen , Tianxiao Li , Yi Dong , Hao Fei , Baoyuan Wu , Guangliang Cheng

While large generative artificial intelligence (GenAI) models have achieved significant success, they also raise growing concerns about online information security due to their potential misuse for generating deceptive content.…

Multimedia · Computer Science 2025-01-27 Zehong Yan , Peng Qi , Wynne Hsu , Mong Li Lee

One of the most challenging forms of misinformation involves pairing images with misleading text to create false narratives. Existing AI-driven detection systems often require domain-specific finetuning, limiting generalizability, and offer…

Artificial Intelligence · Computer Science 2025-10-07 Kumud Lakara , Georgia Channing , Christian Rupprecht , Juil Sock , Philip Torr , John Collomosse , Christian Schroeder de Witt

Multimodal large language models (MLLMs) have recently achieved state-of-the-art performance on tasks ranging from visual question answering to video understanding. However, existing studies have concentrated mainly on visual-textual…

Machine Learning · Computer Science 2025-09-04 Yunkai Dang , Mengxi Gao , Yibo Yan , Xin Zou , Yanggan Gu , Jungang Li , Jingyu Wang , Peijie Jiang , Aiwei Liu , Jia Liu , Xuming Hu

The rapid spread of fake news across multimedia platforms presents serious challenges to information credibility. In this paper, we propose a Debunk-and-Infer framework for Fake News Detection(DIFND) that leverages debunking knowledge to…

Computation and Language · Computer Science 2025-06-30 Kaiying Yan , Moyang Liu , Yukun Liu , Ruibo Fu , Zhengqi Wen , Jianhua Tao , Xuefei Liu

The Multimodal Large Language Models (MLLMs) are continually pre-trained on a mixture of image-text caption data and interleaved document data, while the high-quality data filtering towards image-text interleaved document data is…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Weizhi Wang , Rongmei Lin , Shiyang Li , Colin Lockard , Ritesh Sarkhel , Sanket Lokegaonkar , Jingbo Shang , Xifeng Yan , Nasser Zalmout , Xian Li

The rapid spread of misinformation in mobile and wireless networks presents critical security challenges. This study introduces a training-free, retrieval-based multimodal fact verification system that leverages pretrained vision-language…

Multimedia · Computer Science 2025-06-27 Van-Hoang Phan , Long-Khanh Pham , Dang Vu , Anh-Duy Tran , Minh-Son Dao

Multimodal Misinformation Recognition has become an urgent task with the emergence of huge multimodal fake content on social media platforms. Previous studies mainly focus on complex feature extraction and fusion to learn discriminative…

Multimedia · Computer Science 2025-10-15 Hengyang Zhou , Yiwei Wei , Jian Yang , Zhenyu Zhang

The rapid spread of misinformation on online platforms undermines trust among individuals and hinders informed decision making. This paper shows an explainable and computationally efficient pipeline to detect misinformation using…

Computation and Language · Computer Science 2025-10-23 Jainee Patel , Chintan Bhatt , Himani Trivedi , Thanh Thi Nguyen

Large Language Models (LLMs) have shown remarkable capabilities in knowledge-intensive tasks, while they remain vulnerable when encountering misinformation. Existing studies have explored the role of LLMs in combating misinformation, but…

Computation and Language · Computer Science 2025-05-29 Miao Peng , Nuo Chen , Jianheng Tang , Jia Li

Recent advances in multimodal large language models (MLLMs) have enabled image-based question-answering capabilities. However, a key limitation is the use of CLIP as the visual encoder; while it can capture coarse global information, it…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Vatsal Agarwal , Matthew Gwilliam , Gefen Kohavi , Eshan Verma , Daniel Ulbricht , Abhinav Shrivastava

The most effective misinformation campaigns are multimodal, often combining text with images and videos taken out of context -- or fabricating them entirely -- to support a given narrative. Contemporary methods for detecting misinformation,…

Computation and Language · Computer Science 2025-02-17 Tomas Peterka , Matyas Bohacek

Out-of-Distribution (OOD) detection is a critical task that has garnered significant attention. The emergence of CLIP has spurred extensive research into zero-shot OOD detection, often employing a training-free approach. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Haoran Xu , Yanlin Liu , Zizhao Tong , Jiaze Li , Kexue Fu , Yuyang Zhang , Longxiang Gao , Shuaiguang Li , Xingyu Li , Yanran Xu , Changwei Wang

With the constant spread of misinformation on social media networks, a need has arisen to continuously assess the veracity of digital content. This need has inspired numerous research efforts on the development of misinformation detection…

Computation and Language · Computer Science 2023-12-08 Amica De Jager , Vukosi Marivate , Abioudun Modupe

Large Vision-Language Models (LVLMs) excel at captioning, visual question answering, and robotics by combining vision and language, yet they often miss obvious objects or hallucinate nonexistent ones in atypical scenes. We examine these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Zhaoyang Li , Zhan Ling , Yuchen Zhou , Litian Gong , Erdem Bıyık , Hao Su

Multimodal fake news detection is crucial for mitigating adversarial misinformation. Existing methods, relying on static fusion or LLMs, face computational redundancy and hallucination risks due to weak visual foundations. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Weilin Zhou , Zonghao Ying , Chunlei Meng , Jiahui Liu , Hengyang Zhou , Quanchen Zou , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang

Short video platforms have become important channels for news dissemination, offering a highly engaging and immediate way for users to access current events and share information. However, these platforms have also emerged as significant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Weihao Zhong , Yinhao Xiao , Minghui Xu , Xiuzhen Cheng

Although vision models such as Contrastive Language-Image Pre-Training (CLIP) show impressive generalization performance, their zero-shot robustness is still limited under Out-of-Distribution (OOD) scenarios without fine-tuning. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Zhuo Huang , Chang Liu , Yinpeng Dong , Hang Su , Shibao Zheng , Tongliang Liu

Detecting multimodal misinformation, especially in the form of image-text pairs, is crucial. Obtaining large-scale, high-quality real-world fact-checking datasets for training detectors is costly, leading researchers to use synthetic…

Computation and Language · Computer Science 2024-10-01 Fengzhu Zeng , Wenqian Li , Wei Gao , Yan Pang

Multimodal misinformation, such as miscaptioned images, where captions misrepresent an image's origin, context, or meaning, poses a growing challenge in the digital age. Due to the scarcity of large-scale annotated datasets for multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Stefanos-Iordanis Papadopoulos , Christos Koutlis , Symeon Papadopoulos , Panagiotis C. Petrantonakis