English
Related papers

Related papers: ERF-BA-TFD+: A Multimodal Model for Audio-Visual D…

200 papers

The rise of advanced large language models such as GPT-4, GPT-4o, and the Claude family has made fake audio detection increasingly challenging. Traditional fine-tuning methods struggle to keep pace with the evolving landscape of synthetic…

Sound · Computer Science 2024-08-14 Xiaohui Zhang , Jiangyan Yi , Jianhua Tao

Advances in computer vision and deep learning have blurred the line between deepfakes and authentic media, undermining multimedia credibility through audio-visual forgery. Current multimodal detection methods remain limited by unbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zihan Xiong , Xiaohua Wu , Lei Chen , Fangqi Lou

With the recent advancements in generative modeling, the realism of deepfake content has been increasing at a steady pace, even reaching the point where people often fail to detect manipulated media content online, thus being deceived into…

With the rapid development of artificial intelligence technology, the application of deepfake technology in the audio field has gradually increased, resulting in a wide range of security risks. Especially in the financial and social…

Sound · Computer Science 2024-12-13 Yangguang Feng

The misuse of advanced generative AI models has resulted in the widespread proliferation of falsified data, particularly forged human-centric audiovisual content, which poses substantial societal risks (e.g., financial fraud and social…

Cryptography and Security · Computer Science 2025-10-28 Kangran Zhao , Yupeng Chen , Xiaoyu Zhang , Yize Chen , Weinan Guan , Baicheng Chen , Chengzhe Sun , Soumyya Kanti Datta , Qingshan Liu , Siwei Lyu , Baoyuan Wu

This paper proposes an audio-visual deepfake detection approach that aims to capture fine-grained temporal inconsistencies between audio and visual modalities. To achieve this, both architectural and data synthesis strategies are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

The rapid advancement of deep generative models has significantly improved the realism of synthetic media, presenting both opportunities and security challenges. While deepfake technology has valuable applications in entertainment and…

Machine Learning · Computer Science 2025-06-09 Arnesh Batra , Anushk Kumar , Jashn Khemani , Arush Gumber , Arhan Jain , Somil Gupta

There have been emerging a number of benchmarks and techniques for the detection of deepfakes. However, very few works study the detection of incrementally appearing deepfakes in the real-world scenarios. To simulate the wild scenes, this…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Chuqiao Li , Zhiwu Huang , Danda Pani Paudel , Yabin Wang , Mohamad Shahbazi , Xiaopeng Hong , Luc Van Gool

Generative AI advances rapidly, allowing the creation of very realistic manipulated video and audio. This progress presents a significant security and ethical threat, as malicious users can exploit DeepFake techniques to spread…

Multimedia · Computer Science 2025-06-09 Marcel Klemt , Carlotta Segna , Anna Rohrbach

Partially spoofed audio detection is a challenging task, lying in the need to accurately locate the authenticity of audio at the frame level. To address this issue, we propose a fine-grained partially spoofed audio detection method, namely…

Sound · Computer Science 2023-11-22 Yuankun Xie , Haonan Cheng , Yutian Wang , Long Ye

Due to the development of facial manipulation techniques in recent years deepfake detection in video stream became an important problem for face biometrics, brand monitoring or online video conferencing solutions. In case of a biometric…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Kirill Vyshegorodtsev , Dmitry Kudiyarov , Alexander Balashov , Alexander Kuzmin

With the rising prevalence of deepfakes, there is a growing interest in developing generalizable detection methods for various types of deepfakes. While effective in their specific modalities, traditional detection methods fall short in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Cai Yu , Shan Jia , Xiaomeng Fu , Jin Liu , Jiahe Tian , Jiao Dai , Xi Wang , Siwei Lyu , Jizhong Han

Three key challenges hinder the development of current deepfake video detection: (1) Temporal features can be complex and diverse: how can we identify general temporal artifacts to enhance model generalization? (2) Spatiotemporal models…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Zhiyuan Yan , Yandan Zhao , Shen Chen , Mingyi Guo , Xinghe Fu , Taiping Yao , Shouhong Ding , Li Yuan

Current Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in understanding multimodal data, but their potential remains underexplored for deepfake detection due to the misalignment of their knowledge and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Peipeng Yu , Jianwei Fei , Hui Gao , Xuan Feng , Zhihua Xia , Chip Hong Chang

Deepfake detection refers to detecting artificially generated or edited faces in images or videos, which plays an essential role in visual information security. Despite promising progress in recent years, Deepfake detection remains a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Chunlei Peng , Huiqing Guo , Decheng Liu , Nannan Wang , Ruimin Hu , Xinbo Gao

In recent years, deepfakes (DFs) have been utilized for malicious purposes, such as individual impersonation, misinformation spreading, and artists style imitation, raising questions about ethical and security concerns. In this survey, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Hong-Hanh Nguyen-Le , Van-Tuan Tran , Dinh-Thuc Nguyen , Nhien-An Le-Khac

The widespread application of AIGC contents has brought not only unprecedented opportunities, but also potential security concerns, e.g., audio-visual deepfakes. Therefore, it is of great importance to develop an effective and generalizable…

Multimedia · Computer Science 2025-11-25 Fan Nie , Jiangqun Ni , Jian Zhang , Bin Zhang , Weizhe Zhang , Bin Li

The proliferation of audio deepfakes poses a growing threat to trust in digital communications. While detection methods have advanced, attributing audio deepfakes to their source models remains an underexplored yet crucial challenge. In…

Sound · Computer Science 2025-10-13 Andrea Di Pierno , Luca Guarnera , Dario Allegra , Sebastiano Battiato

With the rapid development of speech synthesis and voice conversion technologies, Audio Deepfake has become a serious threat to the Automatic Speaker Verification (ASV) system. Numerous countermeasures are proposed to detect this type of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-11 Yinlin Guo , Haofan Huang , Xi Chen , He Zhao , Yuehai Wang

All current benchmarks for multimodal deepfake detection manipulate entire frames using various generation techniques, resulting in oversaturated detection accuracies exceeding 94% at the video-level classification. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Juho Jung , Sangyoun Lee , Jooeon Kang , Yunjin Na