English
Related papers

Related papers: TranssionADD: A multi-frame reinforcement based se…

200 papers

Deepfake detection is a critical task in identifying manipulated multimedia content. In real-world scenarios, deepfake content can manifest across multiple modalities, including audio and video. To address this challenge, we present…

Artificial Intelligence · Computer Science 2025-12-04 Xin Zhang , Jiaming Chu , Jian Zhao , Yuchu Jiang , Xu Yang , Lei Jin , Chi Zhang , Xuelong Li

This paper presents a system for detecting fake audio-visual content (i.e., video deepfake), developed for Track 2 of the DDL Challenge. The proposed system employs a two-stage framework, comprising unimodal detection and multimodal score…

Multimedia · Computer Science 2026-02-03 Qingcao Li , Miao He , Liang Yi , Qing Wen , Yitao Zhang , Hongshuo Jin , Peng Cheng , Zhongjie Ba , Li Lu , Kui Ren

With the rise in manipulated media, deepfake detection has become an imperative task for preserving the authenticity of digital content. In this paper, we present a novel multi-modal audio-video framework designed to concurrently process…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Aaditya Kharel , Manas Paranjape , Aniket Bera

This paper describes our submitted systems to the 2022 ADD challenge withing the tracks 1 and 2. Our approach is based on the combination of a pre-trained wav2vec2 feature extractor and a downstream classifier to detect spoofed audio. This…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-04 Juan M. Martín-Doñas , Aitor Álvarez

Audio tagging aims to perform multi-label classification on audio chunks and it is a newly proposed task in the Detection and Classification of Acoustic Scenes and Events 2016 (DCASE 2016) challenge. This task encourages research efforts to…

Sound · Computer Science 2017-03-20 Yong Xu , Qiuqiang Kong , Qiang Huang , Wenwu Wang , Mark D. Plumbley

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Ivan Kukanov , Jun Wah Ng

The present paper proposes a waveform boundary detection system for audio spoofing attacks containing partially manipulated segments. Partially spoofed/fake audio, where part of the utterance is replaced, either with synthetic or natural…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Zexin Cai , Weiqing Wang , Ming Li

The rise of highly convincing synthetic speech poses a growing threat to audio communications. Although existing Audio Deepfake Detection (ADD) methods have demonstrated good performance under clean conditions, their effectiveness drops…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-05 Haohan Shi , Xiyu Shi , Safak Dogan , Tianjin Huang , Yunxiao Zhang

The rapid advancement of generative adversarial networks (GANs) and diffusion models has enabled the creation of highly realistic deepfake content, posing significant threats to digital trust across audio-visual domains. While unimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Chende Zheng , Ruiqi Suo , Zhoulin Ji , Jingyi Deng , Fangbin Yi , Chenhao Lin , Chao Shen

The past few years have witnessed the significant advances of speech synthesis and voice conversion technologies. However, such technologies can undermine the robustness of broadly implemented biometric identification models and can be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-16 Haibin Wu , Heng-Cheng Kuo , Naijun Zheng , Kuo-Hsuan Hung , Hung-Yi Lee , Yu Tsao , Hsin-Min Wang , Helen Meng

Recently, partial audio forgery has emerged as a new form of audio manipulation. Attackers selectively modify partial but semantically critical frames while preserving the overall perceptual authenticity, making such forgeries particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Shuhan Xia , Xuannan Liu , Xing Cui , Peipei Li

With rapid advances in audio-visual generative models, reliable forgery detection becomes increasingly critical. Existing methods for audio-visual deepfake detection typically rely on cross-modal inconsistencies. In singing, rhythmic…

Artificial Intelligence · Computer Science 2026-05-28 Ke Liu , Jiwei Wei , Wenyu Zhang , Shuchang Zhou , Ruikun Chai , Yutao Dai , Chaoning Zhang , Yang Yang

The rapid progress of deep speech synthesis models has posed significant threats to society such as malicious manipulation of content. This has led to an increase in studies aimed at detecting so-called deepfake audio. However, existing…

Sound · Computer Science 2024-11-19 Xinrui Yan , Jiangyan Yi , Jianhua Tao , Jie Chen

This paper describes a submission to the Environment-Aware Speech and Sound Deepfake Detection Challenge (ESDD2) 2026, which addresses component-level deepfake detection using the CompSpoofV2 dataset, where speech and environmental sounds…

Sound · Computer Science 2026-05-06 Khalid Zaman , Qixuan Huang , Muhammad Uzair , Masashi Unoki

Recent advances in audio generation led to an increasing number of deepfakes, making the general public more vulnerable to financial scams, identity theft, and misinformation. Audio deepfake detectors promise to alleviate this issue, with…

Deepfakes are synthetic media generated using deep generative algorithms and have posed a severe societal and political threat. Apart from facial manipulation and synthetic voice, recently, a novel kind of deepfakes has emerged with either…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Vinaya Sree Katamneni , Ajita Rattani

In the digital age, the emergence of deepfakes and synthetic media presents a significant threat to societal and political integrity. Deepfakes based on multi-modal manipulation, such as audio-visual, are more realistic and pose a greater…

Sound · Computer Science 2024-08-08 Vinaya Sree Katamneni , Ajita Rattani

Audio deepfakes pose significant threats, including impersonation, fraud, and reputation damage. To address these risks, audio deepfake detection (ADD) techniques have been developed, demonstrating success on benchmarks like ASVspoof2019.…

Sound · Computer Science 2025-01-22 Muhammad Umar Farooq , Awais Khan , Kutub Uddin , Khalid Mahmood Malik

The rapid advances in text-to-speech (TTS) technologies have made audio deepfakes increasingly realistic and accessible, raising significant security and trust concerns. While existing research has largely focused on detecting…

Sound · Computer Science 2026-02-03 Alabi Ahmed , Vandana Janeja , Sanjay Purushotham

Spoofed audio, i.e. audio that is manipulated or AI-generated deepfake audio, is difficult to detect when only using acoustic features. Some recent innovative work involving AI-spoofed audio detection models augmented with phonetic and…

Sound · Computer Science 2024-10-22 Zahra Khanjani , Christine Mallinson , James Foulds , Vandana P Janeja