English
Related papers

Related papers: Does Current Deepfake Audio Detection Model Effect…

200 papers

Existing Audio Deepfake Detection (ADD) systems often struggle to generalise effectively due to the significantly degraded audio quality caused by audio codec compression and channel transmission effects in real-world communication…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-12 Haohan Shi , Xiyu Shi , Safak Dogan , Saif Alzubi , Tianjin Huang , Yunxiao Zhang

The increasing prevalence of audio deepfakes poses significant security threats, necessitating robust detection methods. While existing detection systems exhibit promise, their robustness against malicious audio manipulations remains…

Cryptography and Security · Computer Science 2024-04-25 Haolin Wu , Jing Chen , Ruiying Du , Cong Wu , Kun He , Xingcan Shang , Hao Ren , Guowen Xu

Audio anti-spoofing for automatic speaker verification aims to safeguard users' identities from spoofing attacks. Although state-of-the-art spoofing countermeasure(CM) models perform well on specific datasets, they lack generalization when…

Sound · Computer Science 2023-06-02 Hye-jin Shim , Jee-weon Jung , Tomi Kinnunen

Partially manipulating a sentence can greatly change its meaning. Recent work shows that countermeasures (CMs) trained on partially spoofed audio can effectively detect such spoofing. However, the current understanding of the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Tianchi Liu , Lin Zhang , Rohan Kumar Das , Yi Ma , Ruijie Tao , Haizhou Li

DeepFakes, which refer to AI-generated media content, have become an increasing concern due to their use as a means for disinformation. Detecting DeepFakes is currently solved with programmed machine learning algorithms. In this work, we…

Artificial Intelligence · Computer Science 2024-06-12 Shan Jia , Reilin Lyu , Kangran Zhao , Yize Chen , Zhiyuan Yan , Yan Ju , Chuanbo Hu , Xin Li , Baoyuan Wu , Siwei Lyu

While the technologies empowering malicious audio deepfakes have dramatically evolved in recent years due to generative AI advances, the same cannot be said of global research into spoofing (deepfake) countermeasures. This paper highlights…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-16 Héctor Delgado , Giorgio Ramondetti , Emanuele Dalmasso , Gennady Karvitsky , Daniele Colibro , Haydar Talib

With the rapid development of speech synthesis and voice conversion technologies, Audio Deepfake has become a serious threat to the Automatic Speaker Verification (ASV) system. Numerous countermeasures are proposed to detect this type of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-11 Yinlin Guo , Haofan Huang , Xi Chen , He Zhao , Yuehai Wang

The rapid advancement of Audio Large Language Models (ALMs), driven by Neural Audio Codecs (NACs), has led to the emergence of highly realistic speech deepfakes, commonly referred to as CodecFakes (CFs). Consequently, CF detection has…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-23 Girish , Mohd Mujtaba Akhtar , Orchid Chetia Phukan , Arun Balaji Buduru

Audio Language Models (ALM) have emerged as the dominant paradigm for speech and music generation by representing audio as sequences of discrete tokens. Yet, unlike text tokens, which are invertible, audio tokens are extracted from lossy…

Sound · Computer Science 2026-01-14 Simon Rouard , Manu Orsini , Axel Roebel , Neil Zeghidour , Alexandre Défossez

The rapid proliferation of AI-manipulated or generated audio deepfakes poses serious challenges to media integrity and election security. Current AI-driven detection solutions lack explainability and underperform in real-world settings. In…

Machine Learning · Computer Science 2024-10-11 Georgia Channing , Juil Sock , Ronald Clark , Philip Torr , Christian Schroeder de Witt

With the advancement of audio generation, generative models can produce highly realistic audios. However, the proliferation of deepfake general audio can pose negative consequences. Therefore, we propose a new task, deepfake general audio…

Sound · Computer Science 2024-06-13 Zeyu Xie , Baihan Li , Xuenan Xu , Zheng Liang , Kai Yu , Mengyue Wu

Multimodal deepfakes involving audiovisual manipulations are a growing threat because they are difficult to detect with the naked eye or using unimodal deep learningbased forgery detection methods. Audiovisual forensic models, while more…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Sahibzada Adil Shahzad , Ammarah Hashmi , Yan-Tsung Peng , Yu Tsao , Hsin-Min Wang

Thanks to recent advances in deep learning, sophisticated generation tools exist, nowadays, that produce extremely realistic synthetic speech. However, malicious uses of such tools are possible and likely, posing a serious threat to our…

Sound · Computer Science 2022-09-29 Alessandro Pianese , Davide Cozzolino , Giovanni Poggi , Luisa Verdoliva

The rapid advancement of spoofing algorithms necessitates the development of robust detection methods capable of accurately identifying emerging fake audio. Traditional approaches, such as finetuning on new datasets containing these novel…

Sound · Computer Science 2023-06-16 Xiaohui Zhang , Jiangyan Yi , Jianhua Tao , Chenlong Wang , Le Xu , Ruibo Fu

Audio-Language Models (ALMs), trained on paired audio-text data, are designed to process, understand, and reason about audio-centric multimodal content. Unlike traditional supervised approaches that use predefined labels, ALMs leverage…

Sound · Computer Science 2026-03-13 Yi Su , Jisheng Bai , Qisheng Xu , Kele Xu , Yong Dou

Modern audio deepfake detectors built on foundation models and large training datasets achieve promising detection performance. However, they struggle with zero-day attacks, where the audio samples are generated by novel synthesis methods…

Sound · Computer Science 2026-01-12 Xuechen Liu , Xin Wang , Junichi Yamagishi

The detection and localization of highly realistic deepfake audio-visual content are challenging even for the most advanced state-of-the-art methods. While most of the research efforts in this domain are focused on detecting high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zhixi Cai , Shreya Ghosh , Aman Pankaj Adatia , Munawar Hayat , Abhinav Dhall , Tom Gedeon , Kalin Stefanov

Previous fake speech datasets were constructed from a defender's perspective to develop countermeasure (CM) systems without considering diverse motivations of attackers. To better align with real-life scenarios, we created…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-07 Hieu-Thi Luong , Haoyang Li , Lin Zhang , Kong Aik Lee , Eng Siong Chng

Adversarial audio attacks pose a significant threat to the growing use of large audio-language models (LALMs) in voice-based human-machine interactions. While existing research focused on model-specific adversarial methods, real-world…

Sound · Computer Science 2025-06-09 Wanqi Yang , Yanda Li , Meng Fang , Yunchao Wei , Ling Chen

This paper conducts a comprehensive layer-wise analysis of self-supervised learning (SSL) models for audio deepfake detection across diverse contexts, including multilingual datasets (English, Chinese, Spanish), partial, song, and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-10 Yassine El Kheir , Youness Samih , Suraj Maharjan , Tim Polzehl , Sebastian Möller