English
Related papers

Related papers: A Multi-Stream Fusion Approach with One-Class Lear…

200 papers

AI-created face-swap videos, commonly known as Deepfakes, have attracted wide attention as powerful impersonation attacks. Existing research on Deepfakes mostly focuses on binary detection to distinguish between real and fake videos.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Shan Jia , Xin Li , Siwei Lyu

Audio-visual deepfakes have reached a level of realism that makes perceptual detection unreliable, threatening media integrity and biometric security. While multimodal detection has shown promise, most approaches are binary classification…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Wasim Ahmad , Wei Zhang , Xuerui Mao

With the rapid development of artificial intelligence technology, the application of deepfake technology in the audio field has gradually increased, resulting in a wide range of security risks. Especially in the financial and social…

Sound · Computer Science 2024-12-13 Yangguang Feng

Human brain is continuously inundated with the multisensory information and their complex interactions coming from the outside world at any given moment. Such information is automatically analyzed by binding or segregating in our brain.…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Arda Senocak , Junsik Kim , Tae-Hyun Oh , Hyeonggon Ryu , Dingzeyu Li , In So Kweon

Automated deception detection is crucial for assisting humans in accurately assessing truthfulness and identifying deceptive behavior. Conventional contact-based techniques, like polygraph devices, rely on physiological signals to determine…

Deep generative models have recently achieved impressive results for many real-world applications, successfully generating high-resolution and diverse samples from complex datasets. Due to this improvement, fake digital contents have…

Machine Learning · Computer Science 2020-03-05 Ricard Durall , Margret Keuper , Franz-Josef Pfreundt , Janis Keuper

The real world is dynamic, yet most image fusion methods process static frames independently, ignoring temporal correlations in videos and leading to flickering and temporal inconsistency. To address this, we propose Unified Video Fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Zixiang Zhao , Haowen Bai , Bingxin Ke , Yukun Cui , Lilun Deng , Yulun Zhang , Kai Zhang , Konrad Schindler

We present the first large-scale open-set benchmark for multilingual audio-video deepfake detection. Our dataset comprises over 250 hours of real and fake videos across eight languages, with 60% of data being generated. For each language,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Florinel-Alin Croitoru , Vlad Hondru , Marius Popescu , Radu Tudor Ionescu , Fahad Shahbaz Khan , Mubarak Shah

Recent multimodal deepfake detection methods designed for generalization conjecture that single-stage supervised training struggles to generalize across unseen manipulations and datasets. However, such approaches that target generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Ashutosh Anshul , Shreyas Gopal , Deepu Rajan , Eng Siong Chng

This paper describes the deepfake audio detection system submitted to the Audio Deep Synthesis Detection (ADD) Challenge Track 3.2 and gives an analysis of score fusion. The proposed system is a score-level fusion of several light…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-14 Yuxiang Zhang , Jingze Lu , Xingming Wang , Zhuo Li , Runqiu Xiao , Wenchao Wang , Ming Li , Pengyuan Zhang

Deepfake audio poses a rising threat in communication platforms, necessitating real-time detection for audio stream integrity. Unlike traditional non-real-time approaches, this study assesses the viability of employing static deepfake audio…

With the recent advancements in generative modeling, the realism of deepfake content has been increasing at a steady pace, even reaching the point where people often fail to detect manipulated media content online, thus being deceived into…

The rapid evolution of speech synthesis and voice conversion has raised substantial concerns due to the potential misuse of such technology, prompting a pressing need for effective audio deepfake detection mechanisms. Existing detection…

Sound · Computer Science 2023-12-18 Xiaohui Zhang , Jiangyan Yi , Chenglong Wang , Chuyuan Zhang , Siding Zeng , Jianhua Tao

Deepfakes are the result of digital manipulation to forge realistic yet fake imagery. With the astonishing advances in deep generative models, fake images or videos are nowadays obtained using variational autoencoders (VAEs) or Generative…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Davide Coccomini , Nicola Messina , Claudio Gennaro , Fabrizio Falchi

In recent years, the explosive advancement of deepfake technology has posed a critical and escalating threat to public security: diffusion-based digital human generation. Unlike traditional face manipulation methods, such models can…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Jiaxin Liu , Jia Wang , Saihui Hou , Min Ren , Huijia Wu , Long Ma , Renwang Pei , Zhaofeng He

Realistic fake videos are a potential tool for spreading harmful misinformation given our increasing online presence and information intake. This paper presents a multimodal learning-based method for detection of real and fake videos. The…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Kalin Stefanov , Bhawna Paliwal , Abhinav Dhall

Deepfake detectors face growing challenges in generalization as new image synthesis techniques emerge. In particular, deepfakes generated by diffusion models are highly photorealistic and often evade detectors trained on GAN-based…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Hongyuan Qi , Wenjin Hou , Hehe Fan , Jun Xiao

This paper aims to interpret how deepfake detection models learn artifact features of images when just supervised by binary labels. To this end, three hypotheses from the perspective of image matching are proposed as follows. 1. Deepfake…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Shichao Dong , Jin Wang , Jiajun Liang , Haoqiang Fan , Renhe Ji

All current benchmarks for multimodal deepfake detection manipulate entire frames using various generation techniques, resulting in oversaturated detection accuracies exceeding 94% at the video-level classification. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Juho Jung , Sangyoun Lee , Jooeon Kang , Yunjin Na

Deepfake speech detection presents a growing challenge as generative audio technologies continue to advance. We propose a hybrid training framework that advances detection performance through novel augmentation strategies. First, we…

Sound · Computer Science 2025-11-14 Inbal Rimon , Oren Gal , Haim Permuter