English
Related papers

Related papers: Detecting and Grounding Multi-Modal Media Manipula…

200 papers

Multimodal deepfakes are proliferating on social media and threaten authenticity, information integrity, and digital forensics. Existing benchmarks are constrained by their single-modality scope, simplified manipulations, or unrealistic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Tianxiao Li , Zhenglin Huang , Haiquan Wen , Yiwei He , Xinze Li , Bingyu Zhu , Wuhui Duan , Congang Chen , Zeyu Fu , Yi Dong , Baoyuan Wu , Jason Li , Guangliang Cheng

In the contemporary digital landscape, multi-modal media manipulation has emerged as a significant societal threat, impacting the reliability and integrity of information dissemination. Current detection methodologies in this domain often…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Hang Wu , Ke Sun , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Current multimodal misinformation detection (MMD) methods often assume a single source and type of forgery for each sample, which is insufficient for real-world scenarios where multiple forgery sources coexist. The lack of a benchmark for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Xuannan Liu , Zekun Li , Peipei Li , Huaibo Huang , Shuhan Xia , Xing Cui , Linzhi Huang , Weihong Deng , Zhaofeng He

Social media in present times has a significant and growing influence. Fake news being spread on these platforms have a disruptive and damaging impact on our lives. Furthermore, as multimedia content improves the visibility of posts more…

Multimedia · Computer Science 2024-06-13 Mudit Dhawan , Shakshi Sharma , Aditya Kadam , Rajesh Sharma , Ponnurangam Kumaraguru

The misuse of advanced generative AI models has resulted in the widespread proliferation of falsified data, particularly forged human-centric audiovisual content, which poses substantial societal risks (e.g., financial fraud and social…

Cryptography and Security · Computer Science 2025-10-28 Kangran Zhao , Yupeng Chen , Xiaoyu Zhang , Yize Chen , Weinan Guan , Baicheng Chen , Chengzhe Sun , Soumyya Kanti Datta , Qingshan Liu , Siwei Lyu , Baoyuan Wu

Artificial intelligence (AI) in media has advanced rapidly over the last decade. The introduction of Generative Adversarial Networks (GANs) improved the quality of photorealistic image generation. Diffusion models later brought a new era of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Redwan Hussain , Mizanur Rahman , Prithwiraj Bhattacharjee

Deepfake media is becoming widespread nowadays because of the easily available tools and mobile apps which can generate realistic looking deepfake videos/images without requiring any technical knowledge. With further advances in this field…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Sohail Ahmed Khan , Duc-Tien Dang-Nguyen

Deepfakes are AI-synthesized multimedia data that may be abused for spreading misinformation. Deepfake generation involves both visual and audio manipulation. To detect audio-visual deepfakes, previous studies commonly employ two relatively…

Sound · Computer Science 2025-06-10 Kuiyuan Zhang , Wenjie Pei , Rushi Lan , Yifang Guo , Zhongyun Hua

Multimodal deepfakes involving audiovisual manipulations are a growing threat because they are difficult to detect with the naked eye or using unimodal deep learningbased forgery detection methods. Audiovisual forensic models, while more…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Sahibzada Adil Shahzad , Ammarah Hashmi , Yan-Tsung Peng , Yu Tsao , Hsin-Min Wang

Fake news often involves multimedia information such as text and image to mislead readers, proliferating and expanding its influence. Most existing fake news detection methods apply the co-attention mechanism to fuse multimodal features…

Information Retrieval · Computer Science 2023-04-13 Linmei Hu , Ziwang Zhao , Weijian Qi , Xuemeng Song , Liqiang Nie

AI-generated synthetic media, also called Deepfakes, have significantly influenced so many domains, from entertainment to cybersecurity. Generative Adversarial Networks (GANs) and Diffusion Models (DMs) are the main frameworks used to…

Nowadays, misinformation is widely spreading over various social media platforms and causes extremely negative impacts on society. To combat this issue, automatically identifying misinformation, especially those containing multimodal…

Computation and Language · Computer Science 2024-07-30 Bing Wang , Shengsheng Wang , Changchun Li , Renchu Guan , Ximing Li

The dissemination of fake news on social networks has drawn public need for effective and efficient fake news detection methods. Generally, fake news on social networks is multi-modal and has various connections with other entities such as…

Social and Information Networks · Computer Science 2022-05-09 Tianle Li , Yushi Sun , Shang-ling Hsu , Yanjia Li , Raymond Chi-Wing Wong

Numerous studies have been proposed to detect fake news focusing on multi-modalities based on machine and/or deep learning. However, studies focusing on graph-based structures using geometric deep learning are lacking. To address this…

Artificial Intelligence · Computer Science 2024-11-19 Jun-hao , Xu

Multimodal manipulation detection aims to simultaneously identify forged image--text pairs and localize tampered regions, yet existing methods typically rely on memorizing isolated artifacts and struggle with imperceptible manipulation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Jun Zhou , Bingwen Hu , Yaxiong Wang , Zhedong Zheng , Yongzhen Wang , Yuchen Zhang , Ping Liu

The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for fake news detection. However, state-of-the-art approaches are usually trained on datasets of smaller…

Computation and Language · Computer Science 2023-05-31 Sahar Tahmasebi , Sherzod Hakimov , Ralph Ewerth , Eric Müller-Budack

In the digital age, the emergence of deepfakes and synthetic media presents a significant threat to societal and political integrity. Deepfakes based on multi-modal manipulation, such as audio-visual, are more realistic and pose a greater…

Sound · Computer Science 2024-08-08 Vinaya Sree Katamneni , Ajita Rattani

The proliferation of misinformation on social media has raised significant societal concerns, necessitating robust detection mechanisms. Large Language Models such as GPT-4 and LLaMA2 have been envisioned as possible tools for detecting…

Computation and Language · Computer Science 2025-03-04 Tianyi Huang , Jingyuan Yi , Peiyang Yu , Xiaochuan Xu

The proliferation of AI-generated media poses significant challenges to information authenticity and social trust, making reliable detection methods highly demanded. Methods for detecting AI-generated media have evolved rapidly, paralleling…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Yueying Zou , Peipei Li , Zekun Li , Huaibo Huang , Xing Cui , Xuannan Liu , Chenghanyu Zhang , Ran He

Multimodal deception detection aims to identify deceptive behavior by analyzing audiovisual cues for forensics and security. In these high-stakes settings, investigators need verifiable evidence connecting audiovisual cues to final…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jiajian Huang , Dongliang Zhu , Zitong YU , Hui Ma , Jiayu Zhang , Chunmei Zhu , Xiaochun Cao