English
Related papers

Related papers: Multimodal Misinformation Detection by Learning fr…

200 papers

Multimodal news contains a wealth of information and is easily affected by deepfake modeling attacks. To combat the latest image and text generation methods, we present a new Multimodal Fake News Detection dataset (MFND) containing 11…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Ye Zhu , Yunan Wang , Zitong Yu

Climate disinformation has become a major challenge in today digital world, especially with the rise of misleading images and videos shared widely on social media. These false claims are often convincing and difficult to detect, which can…

Artificial Intelligence · Computer Science 2026-01-23 Marzieh Adeli Shamsabad , Hamed Ghodrati

With the rapid advancement of Artificial Intelligence Generated Content (AIGC) technologies, synthetic images have become increasingly prevalent in everyday life, posing new challenges for authenticity assessment and detection. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Siwei Wen , Junyan Ye , Peilin Feng , Hengrui Kang , Zichen Wen , Yize Chen , Jiang Wu , Wenjun Wu , Conghui He , Weijia Li

The proliferation of multimodal misinformation poses growing threats to public discourse and societal trust. While Large Vision-Language Models (LVLMs) have enabled recent progress in multimodal misinformation detection (MMD), the rise of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Fanxiao Li , Jiaying Wu , Tingchao Fu , Yunyun Dong , Bingbing Song , Wei Zhou

The spread of fake news has emerged as a critical challenge, undermining trust and posing threats to society. In the era of Large Language Models (LLMs), the capability to generate believable fake content has intensified these concerns. In…

Computation and Language · Computer Science 2023-09-19 Jinyan Su , Terry Yue Zhuo , Jonibek Mansurov , Di Wang , Preslav Nakov

Misinformation detection models often rely on superficial cues (i.e., \emph{shortcuts}) that correlate with misinformation in training data but fail to generalize to the diverse and evolving nature of real-world misinformation. This issue…

Computation and Language · Computer Science 2025-06-04 Herun Wan , Jiaying Wu , Minnan Luo , Zhi Zeng , Zhixiong Su

Preventing the spread of misinformation is challenging. The detection of misleading content presents a significant hurdle due to its extreme linguistic and domain variability. Content-based models have managed to identify deceptive language…

Computation and Language · Computer Science 2024-01-30 Flavio Merenda , José Manuel Gómez-Pérez

The Multimodal Large Language Models (MLLMs) are continually pre-trained on a mixture of image-text caption data and interleaved document data, while the high-quality data filtering towards image-text interleaved document data is…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Weizhi Wang , Rongmei Lin , Shiyang Li , Colin Lockard , Ritesh Sarkhel , Sanket Lokegaonkar , Jingbo Shang , Xifeng Yan , Nasser Zalmout , Xian Li

In multimodal misinformation, deception usually arises not just from pixel-level manipulations in an image, but from the semantic and contextual claim jointly expressed by the image-text pair. Yet most deepfake detectors, engineered to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 A S M Sharifuzzaman Sagar , Mohammed Bennamoun , Farid Boussaid , Naeha Sharif , Lian Xu , Shaaban Sahmoud , Ali Kishk

This study evaluates the effectiveness of Vision Language Models (VLMs) in representing and utilizing multimodal content for fact-checking. To be more specific, we investigate whether incorporating multimodal content improves performance…

Computation and Language · Computer Science 2024-12-09 Recep Firat Cekinel , Pinar Karagoz , Cagri Coltekin

With the rapid development of deep learning techniques, the generation and counterfeiting of multimedia material are becoming increasingly straightforward to perform. At the same time, sharing fake content on the web has become so simple…

Multimedia · Computer Science 2022-09-19 Davide Salvi , Brian Hosler , Paolo Bestagini , Matthew C. Stamm , Stefano Tubaro

The pervasive influence of misinformation has far-reaching and detrimental effects on both individuals and society. The COVID-19 pandemic has witnessed an alarming surge in the dissemination of medical misinformation. However, existing…

Social and Information Networks · Computer Science 2023-06-16 Yanshen Sun , Jianfeng He , Shuo Lei , Limeng Cui , Chang-Tien Lu

Multimodal out-of-context (OOC) misinformation is misinformation that repurposes real images with unrelated or misleading captions. Detecting such misinformation is challenging because it requires resolving the context of the claim before…

Machine Learning · Computer Science 2025-05-27 Sharad Duwal , Mir Nafis Sharear Shopnil , Abhishek Tyagi , Adiba Mahbub Proma

In today's visually dominated social media landscape, predicting the perceived credibility of visual content and understanding what drives human judgment are crucial for countering misinformation. However, these tasks are challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Yilang Peng , Sijia Qian , Yingdan Lu , Cuihua Shen

In recent years, detecting fake multimodal content on social media has drawn increasing attention. Two major forms of deception dominate: human-crafted misinformation (e.g., rumors and misleading posts) and AI-generated content produced by…

Artificial Intelligence · Computer Science 2025-10-17 Haiyang Li , Yaxiong Wang , Shengeng Tang , Lianwei Wu , Lechao Cheng , Zhun Zhong

Social media is accompanied by an increasing proportion of content that provides fake information or misleading content, known as information disorder. In this paper, we study the problem of multimodal fake news detection on a largescale…

Information Retrieval · Computer Science 2021-06-01 Armin Kirchknopf , Djordje Slijepcevic , Matthias Zeppelzauer

Utility companies increasingly rely on drone imagery for post-event and routine inspection, but training accurate defect-type classifiers remains difficult because defect examples are rare and inspection datasets are often limited or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Xuesong Wang , Caisheng Wang

Large Multimodal Models (LMMs), or Vision-Language Models (VLMs), have shown impressive capabilities in a wide range of visual tasks. However, they often struggle with fine-grained visual reasoning, failing to identify domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Yucheng Shi , Quanzheng Li , Jin Sun , Xiang Li , Ninghao Liu

With recent advances in speech synthesis, synthetic data is becoming a viable alternative to real data for training speech recognition models. However, machine learning with synthetic data is not trivial due to the gap between the synthetic…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-25 Ting-Yao Hu , Mohammadreza Armandpour , Ashish Shrivastava , Jen-Hao Rick Chang , Hema Koppula , Oncel Tuzel

Large language models (LLMs) have enabled a range of applications in zero-shot and few-shot learning settings, including the generation of synthetic datasets for training and testing. However, to reliably use these synthetic datasets, it is…

Computation and Language · Computer Science 2024-09-19 Gaurav Maheshwari , Dmitry Ivanov , Kevin El Haddad