English
Related papers

Related papers: A New Dataset and Benchmark for Grounding Multimod…

200 papers

The proliferation of multimodal misinformation poses growing threats to public discourse and societal trust. While Large Vision-Language Models (LVLMs) have enabled recent progress in multimodal misinformation detection (MMD), the rise of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Fanxiao Li , Jiaying Wu , Tingchao Fu , Yunyun Dong , Bingbing Song , Wei Zhou

Given the growing influx of misinformation across news and social media, there is a critical need for systems that can provide effective real-time verification of news claims. Large language or multimodal model based verification has been…

Computation and Language · Computer Science 2024-07-02 Jaeyoung Lee , Ximing Lu , Jack Hessel , Faeze Brahman , Youngjae Yu , Yonatan Bisk , Yejin Choi , Saadia Gabriel

Misinformation undermines individual knowledge and affects broader societal narratives. Despite growing interest in the research community in multi-modal misinformation detection, existing methods exhibit limitations in capturing semantic…

Computation and Language · Computer Science 2024-10-22 Swarang Joshi , Siddharth Mavani , Joel Alex , Arnav Negi , Rahul Mishra , Ponnurangam Kumaraguru

Social platforms, while facilitating access to information, have also become saturated with a plethora of fake news, resulting in negative consequences. Automatic multimodal fake news detection is a worthwhile pursuit. Existing multimodal…

Computation and Language · Computer Science 2024-12-20 Hao Guo , Zihan Ma , Zhi Zeng , Minnan Luo , Weixin Zeng , Jiuyang Tang , Xiang Zhao

Multimodal Misinformation Recognition has become an urgent task with the emergence of huge multimodal fake content on social media platforms. Previous studies mainly focus on complex feature extraction and fusion to learn discriminative…

Multimedia · Computer Science 2025-10-15 Hengyang Zhou , Yiwei Wei , Jian Yang , Zhenyu Zhang

The rise of micro-videos has reshaped how misinformation spreads, amplifying its speed, reach, and impact on public trust. Existing benchmarks typically focus on a single deception type, overlooking the diversity of real-world cases that…

Social and Information Networks · Computer Science 2026-03-27 Zhi Zeng , Yifei Yang , Jiaying Wu , Xulang Zhang , Xiangzheng Kong , Herun Wan , Zihan Ma , Minnan Luo

Multimodal out-of-context (OOC) misinformation is misinformation that repurposes real images with unrelated or misleading captions. Detecting such misinformation is challenging because it requires resolving the context of the claim before…

Machine Learning · Computer Science 2025-05-27 Sharad Duwal , Mir Nafis Sharear Shopnil , Abhishek Tyagi , Adiba Mahbub Proma

Fake news detection remains a challenging problem due to the complex interplay between textual misinformation, manipulated images, and external knowledge reasoning. While existing approaches have achieved notable results in verifying…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Tuan-Vinh La , Minh-Hieu Nguyen , Minh-Son Dao

The recent success in language generation capabilities of large language models (LLMs), such as GPT, Bard, Llama etc., can potentially lead to concerns about their possible misuse in inducing mass agitation and communal hatred via…

Computation and Language · Computer Science 2024-01-10 Shrey Satapara , Parth Mehta , Debasis Ganguly , Sandip Modha

Multimodal large language models (MLLMs) have substantially advanced video misinformation detection through unified multimodal reasoning, but they often rely on fixed-depth inference and place excessive trust in internally generated…

Artificial Intelligence · Computer Science 2026-02-27 Zehao Li , Hongwei Yu , Hao Jiang , Qiang Sheng , Yilong Xu , Baolong Bi , Yang Li , Zhenlong Yuan , Yujun Cai , Zhaoqi Wang

The web has become a crucial source of information, but it is also used to spread disinformation, often conveyed through multiple modalities like images and text. The identification of inconsistent cross-modal information, in particular…

Computation and Language · Computer Science 2025-02-03 Sahar Tahmasebi , David Ernst , Eric Müller-Budack , Ralph Ewerth

The rapid spread of multimodal misinformation on social media has raised growing concerns, while research on video misinformation detection remains limited due to the lack of large-scale, diverse datasets. Existing methods often overfit to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Fanrui Zhang , Dian Li , Qiang Zhang , Jun Chen , Gang Liu , Junxiong Lin , Jiahong Yan , Jiawei Liu , Zheng-Jun Zha

The proliferation of misinformation on social media has raised significant societal concerns, necessitating robust detection mechanisms. Large Language Models such as GPT-4 and LLaMA2 have been envisioned as possible tools for detecting…

Computation and Language · Computer Science 2025-03-04 Tianyi Huang , Jingyuan Yi , Peiyang Yu , Xiaochuan Xu

Short-video platforms have become major channels for misinformation, where deceptive claims frequently leverage visual experiments and social cues. While Multimodal Large Language Models (MLLMs) have demonstrated impressive reasoning…

Computation and Language · Computer Science 2026-05-19 Jen-tse Huang , Chang Chen , Shiyang Lai , Wenxuan Wang , Michelle R. Kaufman , Mark Dredze

News media, especially video news media, have penetrated into every aspect of daily life, which also brings the risk of fake news. Therefore, multimodal fake news detection has recently garnered increased attention. However, the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yihao Wang , Lizhi Chen , Zhong Qian , Peifeng Li

Misinformation on the web increasingly appears in multimodal forms, combining text, images, and OCR-rendered content in ways that amplify harm to public trust and vulnerable communities. While prior fact-checking systems often rely on…

Computation and Language · Computer Science 2026-01-14 Aditya Kishore , Gaurav Kumar , Jasabanta Patro

Misinformation and disinformation demand fact checking that goes beyond simple evidence-based reasoning. Existing benchmarks fall short: they are largely single modality (text-only), span short time horizons, use shallow evidence, cover…

Social and Information Networks · Computer Science 2025-10-30 Wenyan Xu , Dawei Xiang , Tianqi Ding , Weihai Lu

Online disinformation poses an escalating threat to society, driven increasingly by the rapid spread of misleading content across both multimedia and multilingual platforms. While automated fact-checking methods have advanced in recent…

Computation and Language · Computer Science 2026-01-19 Rafael Martins Frade , Rrubaa Panchendrarajan , Arkaitz Zubiaga

Numerous multimodal misinformation benchmarks exhibit bias toward specific modalities, allowing detectors to make predictions based solely on one modality. While previous research has quantified bias at the dataset level or manually…

Artificial Intelligence · Computer Science 2025-11-11 Hehai Lin , Hui Liu , Shilei Cao , Jing Li , Haoliang Li , Wenya Wang

Multimodal deepfakes are proliferating on social media and threaten authenticity, information integrity, and digital forensics. Existing benchmarks are constrained by their single-modality scope, simplified manipulations, or unrealistic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Tianxiao Li , Zhenglin Huang , Haiquan Wen , Yiwei He , Xinze Li , Bingyu Zhu , Wuhui Duan , Congang Chen , Zeyu Fu , Yi Dong , Baoyuan Wu , Jason Li , Guangliang Cheng