English
Related papers

Related papers: Divide and Conquer: Multimodal Video Deepfake Dete…

200 papers

Significant advancements made in the generation of deepfakes have caused security and privacy issues. Attackers can easily impersonate a person's identity in an image by replacing his face with the target person's face. Moreover, a new…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Hasam Khalid , Minha Kim , Shahroz Tariq , Simon S. Woo

The increasing use of synthetic media, particularly deepfakes, is an emerging challenge for digital content verification. Although recent studies use both audio and visual information, most integrate these cues within a single model, which…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Sayeem Been Zaman , Wasimul Karim , Arefin Ittesafun Abian , Reem E. Mohamed , Md Rafiqul Islam , Asif Karim , Sami Azam

Advances in computer vision and deep learning have blurred the line between deepfakes and authentic media, undermining multimedia credibility through audio-visual forgery. Current multimodal detection methods remain limited by unbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zihan Xiong , Xiaohua Wu , Lei Chen , Fangqi Lou

Existing methods on audio-visual deepfake detection mainly focus on high-level features for modeling inconsistencies between audio and visual data. As a result, these approaches usually overlook finer audio-visual artifacts, which are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Ivan Kukanov , Jun Wah Ng

The field of visual and audio generation is burgeoning with new state-of-the-art methods. This rapid proliferation of new techniques underscores the need for robust solutions for detecting synthetic content in videos. In particular, when…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Nicholas Klein , Hemlata Tak , James Fullwood , Krishna Regmi , Leonidas Spinoulas , Ganesh Sivaraman , Tianxiang Chen , Elie Khoury

Audio-visual temporal deepfake localization under the content-driven partial manipulation remains a highly challenging task. In this scenario, the deepfake regions are usually only spanning a few frames, with the majority of the rest…

This paper focuses to detect the fake news on the short video platforms. While significant research efforts have been devoted to this task with notable progress in recent years, current detection accuracy remains suboptimal due to the rapid…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Junxi Wang , Jize liu , Na Zhang , Yaxiong Wang

Deep Learning has been successfully applied in diverse fields, and its impact on deepfake detection is no exception. Deepfakes are fake yet realistic synthetic content that can be used deceitfully for political impersonation, phishing,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Ammarah Hashmi , Sahibzada Adil Shahzad , Chia-Wen Lin , Yu Tsao , Hsin-Min Wang

With the rising prevalence of deepfakes, there is a growing interest in developing generalizable detection methods for various types of deepfakes. While effective in their specific modalities, traditional detection methods fall short in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Cai Yu , Shan Jia , Xiaomeng Fu , Jin Liu , Jiahe Tian , Jiao Dai , Xi Wang , Siwei Lyu , Jizhong Han

Deepfake videos present an increasing threat to society with potentially negative impact on criminal justice, democracy, and personal safety and privacy. Meanwhile, detecting deepfakes, at scale, remains a very challenging task that often…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Mulin Tian , Mahyar Khayatkhoei , Joe Mathai , Wael AbdAlmageed

Audio-visual deepfakes have reached a level of realism that makes perceptual detection unreliable, threatening media integrity and biometric security. While multimodal detection has shown promise, most approaches are binary classification…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Wasim Ahmad , Wei Zhang , Xuerui Mao

Deepfake is a widely used technology employed in recent years to create pernicious content such as fake news, movies, and rumors by altering and substituting facial information from various sources. Given the ongoing evolution of deepfakes…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ruchika Sharma , Rudresh Dwivedi

We present a learning-based method for detecting real and fake deepfake multimedia content. To maximize information for learning, we extract and analyze the similarity between the two audio and visual modalities from within the same video.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Trisha Mittal , Uttaran Bhattacharya , Rohan Chandra , Aniket Bera , Dinesh Manocha

Advances in Generative AI have made video-level deepfake detection increasingly challenging, exposing the limitations of current detection techniques. In this paper, we present HOLA, our solution to the Video-Level Deepfake Detection track…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Xuecheng Wu , Danlei Huang , Heli Sun , Xinyi Yin , Yifan Wang , Hao Wang , Jia Zhang , Fei Wang , Peihao Guo , Suyu Xing , Junxiao Xue , Liang He

In this paper, we present a deep learning based multimodal system for classifying daily life videos. To train the system, we propose a two-phase training strategy. In the first training phase (Phase I), we extract the audio and visual…

Sound · Computer Science 2023-05-03 Lam Pham , Trang Le , Cam Le , Dat Ngo , Weissenfeld Axel , Alexander Schindler

This paper introduces our system designed for Track 2, which focuses on locating manipulated regions, in the second Audio Deepfake Detection Challenge (ADD 2023). Our approach involves the utilization of multiple detection systems to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-22 Zexin Cai , Weiqing Wang , Yikang Wang , Ming Li

With the rapid development of speech synthesis and voice conversion technologies, Audio Deepfake has become a serious threat to the Automatic Speaker Verification (ASV) system. Numerous countermeasures are proposed to detect this type of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-11 Yinlin Guo , Haofan Huang , Xi Chen , He Zhao , Yuehai Wang

It is now well established from a variety of studies that there is a significant benefit from combining video and audio data in detecting active speakers. However, either of the modalities can potentially mislead audiovisual fusion by…

Deepfake technology utilizes deep learning based face manipulation techniques to seamlessly replace faces in videos creating highly realistic but artificially generated content. Although this technology has beneficial applications in media…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Siddiqui Muhammad Yasir , Hyun Kim