English
Related papers

Related papers: Multiscale Adaptive Conflict-Balancing Model For M…

200 papers

We propose detection of deepfake videos based on the dissimilarity between the audio and visual modalities, termed as the Modality Dissonance Score (MDS). We hypothesize that manipulation of either modality will lead to dis-harmony between…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Komal Chugh , Parul Gupta , Abhinav Dhall , Ramanathan Subramanian

Deepfakes are AI-generated media in which an image or video has been digitally modified. The advancements made in deepfake technology have led to privacy and security issues. Most deepfake detection techniques rely on the detection of a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Sneha Muppalla , Shan Jia , Siwei Lyu

The proliferation of sophisticated AI-generated deepfakes poses critical challenges for digital media authentication and societal security. While existing detection methods perform well within specific generative domains, they exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Naseem Khan , Tuan Nguyen , Amine Bermak , Issa Khalil

Weakly supervised violence detection refers to the technique of training models to identify violent segments in videos using only video-level labels. Among these approaches, multimodal violence detection, which integrates modalities such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Wenping Jin , Li Zhu , Jing Sun

The rapid evolution of generative adversarial networks (GANs) and diffusion models has made synthetic media increasingly realistic, raising societal concerns around misinformation, identity fraud, and digital trust. Existing deepfake…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Sales Aribe

Multimodal fake news detection often involves modelling heterogeneous data sources, such as vision and language. Existing detection methods typically rely on fusion effectiveness and cross-modal consistency to model the content,…

Machine Learning · Computer Science 2025-03-04 Lingzhi Shen , Yunfei Long , Xiaohao Cai , Imran Razzak , Guanming Chen , Kang Liu , Shoaib Jameel

Deepfake has recently raised a plethora of societal concerns over its possible security threats and dissemination of fake information. Much research on deepfake detection has been undertaken. However, detecting low quality as well as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Binh M. Le , Simon S. Woo

Multimodal news contains a wealth of information and is easily affected by deepfake modeling attacks. To combat the latest image and text generation methods, we present a new Multimodal Fake News Detection dataset (MFND) containing 11…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Ye Zhu , Yunan Wang , Zitong Yu

The proliferation of multi-modal fake news on social media poses a significant threat to public trust and social stability. Traditional detection methods, primarily text-based, often fall short due to the deceptive interplay between…

Cryptography and Security · Computer Science 2025-08-11 Junhao He , Tianyu Liu , Jingyuan Zhao , Benjamin Turner

Three key challenges hinder the development of current deepfake video detection: (1) Temporal features can be complex and diverse: how can we identify general temporal artifacts to enhance model generalization? (2) Spatiotemporal models…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Zhiyuan Yan , Yandan Zhao , Shen Chen , Mingyi Guo , Xinghe Fu , Taiping Yao , Shouhong Ding , Li Yuan

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Ivan Kukanov , Jun Wah Ng

Robust deepfake detection models must be capable of generalizing to ever-evolving manipulation techniques beyond training data. A promising strategy is to augment the training data with online synthesized fake images containing broadly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Ming-Hui Liu , Harry Cheng , Xin Luo , Xin-Shun Xu

The rapid growth of social media has resulted in an explosion of online news content, leading to a significant increase in the spread of misleading or false information. While machine learning techniques have been widely applied to detect…

Computation and Language · Computer Science 2024-12-10 Hao Chen , Hui Guo , Baochen Hu , Shu Hu , Jinrong Hu , Siwei Lyu , Xi Wu , Xin Wang

Multimodal learning enhances the performance of various machine learning tasks by leveraging complementary information across different modalities. However, existing methods often learn multimodal representations that retain substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Tong Zhang , Shu Shen , C. L. Philip Chen

Fake news detection has received increasing attention from researchers in recent years, especially multi-modal fake news detection containing both text and images. However, many previous works have fed two modal features, text and image,…

Multimedia · Computer Science 2024-07-02 Hongzhen Lv , Wenzhong Yang , Fuyuan Wei , Jiaren Peng , Haokun Geng

In deepfake detection, the varying degrees of compression employed by social media platforms pose significant challenges for model generalization and reliability. Although existing methods have progressed from single-modal to multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Ching-Yi Lai , Chih-Yu Jian , Pei-Cheng Chuang , Chia-Ming Lee , Chih-Chung Hsu , Chiou-Ting Hsu , Chia-Wen Lin

Deception detection is a critical task in real-world applications such as security screening, fraud prevention, and credibility assessment. While deep learning methods have shown promise in surpassing human-level performance, their…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Xun Lin , Xiaobao Guo , Taorui Wang , Yingjie Ma , Jiajian Huang , Jiayu Zhang , Junzhe Cao , Zitong Yu

The growing threat posed by deepfake videos, capable of manipulating realities and disseminating misinformation, drives the urgent need for effective detection methods. This work investigates and compares different approaches for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Matheus Martins Batista

The rapid evolution of generative AI has increased the threat of realistic audio-visual deepfakes, demanding robust detection methods. Existing solutions primarily address unimodal (audio or visual) forgeries but struggle with multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Jian Wang , Baoyuan Wu , Li Liu , Qingshan Liu

Multimodal learning aims to imitate human beings to acquire complementary information from multiple modalities for various downstream tasks. However, traditional aggregation-based multimodal fusion methods ignore the inter-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Heqing Zou , Meng Shen , Chen Chen , Yuchen Hu , Deepu Rajan , Eng Siong Chng