English
Related papers

Related papers: Rethinking Vision-Language Model in Face Forensics…

200 papers

Existing deepfake detection techniques struggle to keep-up with the ever-evolving novel, unseen forgeries methods. This limitation stems from their reliance on statistical artifacts learned during training, which are often tied to specific…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Guangyu Shen , Zhihua Li , Xiang Xu , Tianchen Zhao , Zheng Zhang , Dongsheng An , Zhuowen Tu , Yifan Xing , Qin Zhang

As generative artificial intelligence evolves, deepfake attacks have escalated from single-modality manipulations to complex, multimodal threats. Existing forensic techniques face a severe generalization bottleneck: by relying excessively…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Jingtong Dou , Chuancheng Shi , Jian Wang , Fei Shen , Zhiyong Wang , Tat-Seng Chua

In multimodal misinformation, deception usually arises not just from pixel-level manipulations in an image, but from the semantic and contextual claim jointly expressed by the image-text pair. Yet most deepfake detectors, engineered to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 A S M Sharifuzzaman Sagar , Mohammed Bennamoun , Farid Boussaid , Naeha Sharif , Lian Xu , Shaaban Sahmoud , Ali Kishk

Multimodal large language models (MLLMs) offer a promising path toward interpretable deepfake detection by generating textual explanations. However, the reasoning process of current MLLM-based methods combines evidence generation and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xinghan Li , Junhao Xu , Jingjing Chen

Multimodal deepfake detection (MDD) aims to uncover manipulations across visual, textual, and auditory modalities, thereby reinforcing the reliability of modern information systems. Although large vision-language models (LVLMs) exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Yuxin Liu , Fei Wang , Kun Li , Yiqi Nie , Junjie Chen , Yanyan Wei , Zhangling Duan , Zhaohong Jia

With various facial manipulation techniques arising, face forgery detection has drawn growing attention due to security concerns. Previous works always formulate face forgery detection as a classification problem based on cross-entropy…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Ke Sun , Taiping Yao , Shen Chen , Shouhong Ding , Jilin L , Rongrong Ji

The increasing realism of AI-generated images has raised serious concerns about misinformation and privacy violations, highlighting the urgent need for accurate and interpretable detection methods. While existing approaches have made…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Tai-Ming Huang , Wei-Tung Lin , Kai-Lung Hua , Wen-Huang Cheng , Junichi Yamagishi , Jun-Cheng Chen

Rapid progress in deep learning is continuously making it easier and cheaper to generate video forgeries. Hence, it becomes very important to have a reliable way of detecting these forgeries. This paper describes such an approach for…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Nika Dogonadze , Jana Obernosterer , Ji Hou

Deepfake videos, produced through advanced artificial intelligence methods now a days, pose a new challenge to the truthfulness of the digital media. As Deepfake becomes more convincing day by day, detecting them requires advanced methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mahmudul Hasan , Sadia Ruhama , Sabrina Tajnim Sithi , Chowdhury Mohammad Mutamir Samit , Oindrila Saha

The combination of highly realistic voice cloning, along with visually compelling avatar, face-swap, or lip-sync deepfake video generation, makes it relatively easy to create a video of anyone saying anything. Today, such deepfake…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Justin D. Norman , Hany Farid

Recent studies on deepfake detection have achieved promising results when training and testing faces are from the same dataset. However, their results severely degrade when confronted with forged samples that the model has not yet seen…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Tiewen Chen , Shanmin Yang , Shu Hu , Zhenghan Fang , Ying Fu , Xi Wu , Xin Wang

Deepfake technology poses a significant threat to security and social trust. Although existing detection methods have shown high performance in identifying forgeries within datasets that use the same deepfake techniques for both training…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Shanmin Yang , Hui Guo , Shu Hu , Bin Zhu , Ying Fu , Siwei Lyu , Xi Wu , Xin Wang

Recent advances in image generation have led to the widespread availability of highly realistic synthetic media, increasing the difficulty of reliable deepfake detection. A key challenge is generalization, as detectors trained on a narrow…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yichen Jiang , Mohammed Talha Alam , Sohail Ahmed Khan , Duc-Tien Dang-Nguyen , Fakhri Karray

This paper presents a method to automatically and efficiently detect face tampering in videos, and particularly focuses on two recent techniques used to generate hyper-realistic forged videos: Deepfake and Face2Face. Traditional image…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Darius Afchar , Vincent Nozick , Junichi Yamagishi , Isao Echizen

The growing reliance of society on social media for authentic information has done nothing but increase over the past years. This has only raised the potential consequences of the spread of misinformation. One of the growing methods in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Jacob Mallet , Natalie Krueger , Mounika Vanamala , Rushit Dave

Transformer-based models have shown strong performance in speech deepfake detection, largely due to the effectiveness of the multi-head self-attention (MHSA) mechanism. MHSA provides frame-level attention scores, which are particularly…

Sound · Computer Science 2026-02-05 Tuan Dat Phuong , Duc-Tuan Truong , Long-Vu Hoang , Trang Nguyen Thi Thu

Audio-visual deepfake detection (AVD) is increasingly important as modern generators can fabricate convincing speech and video. Most current multimodal detectors are small, task-specific models: they work well on curated tests but scale…

Sound · Computer Science 2026-03-02 Songjun Cao , Yuqi Li , Yunpeng Luo , Jianjun Yin , Long Ma

Existing face forgery detection methods usually treat face forgery detection as a binary classification problem and adopt deep convolution neural networks to learn discriminative features. The ideal discriminative features should be only…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Wanyi Zhuang , Qi Chu , Haojie Yuan , Changtao Miao , Bin Liu , Nenghai Yu

Existing deepfake detection research has primarily focused on scenarios where the manipulated subject is actively speaking, i.e., generating fabricated content by altering the speaker's appearance or voice. However, in realistic interaction…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Miao Liu , Fangda Wei , Jing Wang , Xinyuan Qian

With the rapid development of facial manipulation techniques, face forgery detection has received considerable attention in digital media forensics due to security concerns. Most existing methods formulate face forgery detection as a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Shen Chen , Taiping Yao , Yang Chen , Shouhong Ding , Jilin Li , Rongrong Ji