English
Related papers

Related papers: ERF-BA-TFD+: A Multimodal Model for Audio-Visual D…

200 papers

DeepFake based digital facial forgery is threatening the public media security, especially when lip manipulation has been used in talking face generation, the difficulty of fake video detection is further improved. By only changing lip…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Ganglai Wang , Peng Zhang , Lei Xie , Wei Huang , Yufei Zha , Yanning Zhang

With recent advances in speech synthesis including text-to-speech (TTS) and voice conversion (VC) systems enabling the generation of ultra-realistic audio deepfakes, there is growing concern about their potential misuse. However, most…

Sound · Computer Science 2024-04-24 Zuheng Kang , Yayun He , Botao Zhao , Xiaoyang Qu , Junqing Peng , Jing Xiao , Jianzong Wang

Audio deepfakes represent a growing threat to digital security and trust, leveraging advanced generative models to produce synthetic speech that closely mimics real human voices. Detecting such manipulations is especially challenging under…

Sound · Computer Science 2025-05-01 Andrea Di Pierno , Luca Guarnera , Dario Allegra , Sebastiano Battiato

The increasing realism and accessibility of deepfakes have raised critical concerns about media authenticity and information integrity. Despite recent advances, deepfake detection models often struggle to generalize beyond their training…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Stelios Mylonas , Symeon Papadopoulos

In this paper, we propose a deep learning based system for the task of deepfake audio detection. In particular, the draw input audio is first transformed into various spectrograms using three transformation methods of Short-time Fourier…

Sound · Computer Science 2024-07-03 Lam Pham , Phat Lam , Truong Nguyen , Huyen Nguyen , Alexander Schindler

The rapid advancement of deepfake and face swap technologies has raised significant concerns in digital security, particularly in identity verification and onboarding processes. Conventional detection methods often struggle to generalize…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Alejandro Hinke-Navarro , Mario Nieto-Hidalgo , Juan M. Espin , Juan E. Tapia

Recent Deepfake Video Detection (DFD) studies have demonstrated that pre-trained Vision-Language Models (VLMs) such as CLIP exhibit strong generalization capabilities in detecting artifacts across different identities. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Jiawen Zhu , Yunqi Miao , Xueyi Zhang , Jiankang Deng , Guansong Pang

The detection and localization of deepfake content, particularly when small fake segments are seamlessly mixed with real videos, remains a significant challenge in the field of digital media security. Based on the recently released…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Zhixi Cai , Abhinav Dhall , Shreya Ghosh , Munawar Hayat , Dimitrios Kollias , Kalin Stefanov , Usman Tariq

The rapid evolution of generative AI has increased the threat of realistic audio-visual deepfakes, demanding robust detection methods. Existing solutions primarily address unimodal (audio or visual) forgeries but struggle with multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Jian Wang , Baoyuan Wu , Li Liu , Qingshan Liu

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Ivan Kukanov , Jun Wah Ng

Face forgery by deepfake is widely spread over the internet and this raises severe societal concerns. In this paper, we propose a novel video transformer with incremental learning for detecting deepfake videos. To better align the input…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Sohail A. Khan , Hang Dai

The growing prominence of the field of audio deepfake detection is driven by its wide range of applications, notably in protecting the public from potential fraud and other malicious activities, prompting the need for greater attention and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-12 Jiangyan Yi , Chu Yuan Zhang , Jianhua Tao , Chenglong Wang , Xinrui Yan , Yong Ren , Hao Gu , Junzuo Zhou

As AI-generated content (AIGC) thrives, deepfakes have expanded from single-modality falsification to cross-modal fake content creation, where either audio or visual components can be manipulated. While using two unimodal detectors can…

Multimedia · Computer Science 2024-10-28 Cai Yu , Peng Chen , Jiahe Tian , Jin Liu , Jiao Dai , Xi Wang , Yesheng Chai , Shan Jia , Siwei Lyu , Jizhong Han

Recent advancements in deep learning generative models have raised concerns as they can create highly convincing counterfeit images and videos. This poses a threat to people's integrity and can lead to social instability. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Leandro A. Passos , Danilo Jodas , Kelton A. P. da Costa , Luis A. Souza Júnior , Douglas Rodrigues , Javier Del Ser , David Camacho , João Paulo Papa

Recent advances in AIGC have exacerbated the misuse of malicious deepfake content, making the development of reliable deepfake detection methods an essential means to address this challenge. Although existing deepfake detection models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Changtao Miao , Yi Zhang , Weize Gao , Zhiya Tan , Weiwei Feng , Man Luo , Jianshu Li , Ajian Liu , Yunfeng Diao , Qi Chu , Tao Gong , Zhe Li , Weibin Yao , Joey Tianyi Zhou

Audio deepfake detection has become increasingly challenging due to rapid advances in speech synthesis and voice conversion technologies, particularly under channel distortions, replay attacks, and real-world recording conditions. This…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-13 K. A. Shahriar

Deepfakes are realistic face manipulations that can pose serious threats to security, privacy, and trust. Existing methods mostly treat this task as binary classification, which uses digital labels or mask signals to train the detection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Ke Sun , Shen Chen , Taiping Yao , Haozhe Yang , Xiaoshuai Sun , Shouhong Ding , Rongrong Ji

Recent progress in audio generation models has made it possible to create highly realistic and immersive soundscapes, which are now widely used in film and virtual-reality-related applications. However, these audio generators also raise…

Sound · Computer Science 2026-01-01 Han Yin , Yang Xiao , Rohan Kumar Das , Jisheng Bai , Ting Dang

The rapid advancement of AI-generated multimodal video-audio content has raised significant concerns regarding information security and content authenticity. Existing synthetic video datasets predominantly focus on the visual modality…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Mengxue Hu , Yunfeng Diao , Changtao Miao , Zhiqing Guo , Jianshu Li , Zhe Li , Joey Tianyi Zhou

The rapid progress in deep generative models has led to the creation of incredibly realistic synthetic images that are becoming increasingly difficult to distinguish from real-world data. The widespread use of Variational Models, Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Anant Mehta , Bryant McArthur , Nagarjuna Kolloju , Zhengzhong Tu