English
Related papers

Related papers: Generalizable Audio Deepfake Detection via Latent …

200 papers

Spoofing-robust speaker verification (SASV) combines the tasks of speaker and spoof detection to authenticate speakers under adversarial settings. Many SASV systems rely on fusion of speaker and spoof cues at embedding, score or decision…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-31 Oğuzhan Kurnaz , Jagabandhu Mishra , Tomi H. Kinnunen , Cemal Hanilçi

Generalizability, the capacity of a robust model to perform effectively on unseen data, is crucial for audio deepfake detection due to the rapid evolution of text-to-speech (TTS) and voice conversion (VC) technologies. A promising approach…

Sound · Computer Science 2025-04-16 Botao Zhao , Zuheng Kang , Yayun He , Xiaoyang Qu , Junqing Peng , Jing Xiao , Jianzong Wang

Deepfake audio poses a rising threat in communication platforms, necessitating real-time detection for audio stream integrity. Unlike traditional non-real-time approaches, this study assesses the viability of employing static deepfake audio…

Research in the past several years has boosted the performance of automatic speaker verification systems and countermeasure systems to deliver low Equal Error Rates (EERs) on each system. However, research on joint optimization of both…

Sound · Computer Science 2022-03-28 Zhongwei Teng , Quchen Fu , Jules White , Maria E. Powell , Douglas C. Schmidt

Speech deepfake detection (SDD) systems perform well on standard benchmarks datasets but often fail to generalize to expressive and emotional spoofing attacks. Many methods rely on spoof-heavy training data, learning dataset-specific…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-16 Aurosweta Mahapatra , Ismail Rasim Ulgen , Kong Aik Lee , Nicholas Andrews , Berrak Sisman

Recent techniques for speech deepfake detection often rely on pre-trained self-supervised models. These systems, initially developed for Automatic Speech Recognition (ASR), have proved their ability to offer a meaningful representation of…

Self-supervised learning (SSL)-based speech models are extensively used for full-stack speech processing. However, it has been observed that improving SSL-based speech representations using unlabeled speech for content-related tasks is…

Computation and Language · Computer Science 2024-06-14 Amit Meghanani , Thomas Hain

Existing approaches for replay and synthetic speech detection still lack generalizability to unseen spoofing attacks. This work proposes to leverage a novel model structure, so-called Res2Net, to improve the anti-spoofing countermeasure's…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Xu Li , Na Li , Chao Weng , Xunying Liu , Dan Su , Dong Yu , Helen Meng

The availability of highly convincing audio deepfake generators highlights the need for designing robust audio deepfake detectors. Existing works often rely solely on real and fake data available in the training set, which may lead to…

Sound · Computer Science 2024-07-11 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

Self-supervised learning (SSL) has transformed speech processing, with benchmarks such as SUPERB establishing fair comparisons across diverse downstream tasks. Despite it's security-critical importance, Audio deepfake detection has remained…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-10 Hashim Ali , Nithin Sai Adupa , Surya Subramani , Hafiz Malik

The generalization capability of deepfake detectors is critical for real-world use. Data augmentation via synthetic fake face generation effectively enhances generalization, yet current SoTA methods rely on fixed strategies-raising a key…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yuxuan Zhou , Tao Yu , Wen Huang , Yuheng Zhang , Tao Dai , Shu-Tao Xia

Conventional spoofing detection systems have heavily relied on the use of handcrafted features derived from speech data. However, a notable shift has recently emerged towards the direct utilization of raw speech waveforms, as demonstrated…

As deepfake audio becomes more realistic and diverse, developing generalizable countermeasure systems has become crucial. Existing detection methods primarily depend on XLS-R front-end features to improve generalization. Nonetheless, their…

Sound · Computer Science 2026-02-17 Zhe Ye , Xiangui Kang , Jiayi He , Chengxin Chen , Wei Zhu , Kai Wu , Yin Yang , Jiwu Huang

Thanks to recent advances in deep learning, sophisticated generation tools exist, nowadays, that produce extremely realistic synthetic speech. However, malicious uses of such tools are possible and likely, posing a serious threat to our…

Sound · Computer Science 2022-09-29 Alessandro Pianese , Davide Cozzolino , Giovanni Poggi , Luisa Verdoliva

Building speech deepfake detection models that are generalizable to unseen attacks remains a challenging problem. Although the field has shifted toward a pre-training and fine-tuning paradigm using speech foundation models, most approaches…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-04 Xin Wang , Ge Wanying , Junichi Yamagishi

The SAFE Challenge evaluates synthetic speech detection across three tasks: unmodified audio, processed audio with compression artifacts, and laundered audio designed to evade detection. We systematically explore self-supervised learning…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Hashim Ali , Surya Subramani , Lekha Bollinani , Nithin Sai Adupa , Sali El-Loh , Hafiz Malik

The past few years have witnessed the significant advances of speech synthesis and voice conversion technologies. However, such technologies can undermine the robustness of broadly implemented biometric identification models and can be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-16 Haibin Wu , Heng-Cheng Kuo , Naijun Zheng , Kuo-Hsuan Hung , Hung-Yi Lee , Yu Tsao , Hsin-Min Wang , Helen Meng

Current text-to-speech algorithms produce realistic fakes of human voices, making deepfake detection a much-needed area of research. While researchers have presented various techniques for detecting audio spoofs, it is often unclear exactly…

Generalization in audio deepfake detection presents a significant challenge, with models trained on specific datasets often struggling to detect deepfakes generated under varying conditions and unknown algorithms. While collectively…

In recent years, self-supervised learning (SSL) models have made significant progress in audio deepfake detection (ADD) tasks. However, existing SSL models mainly rely on large-scale real speech for pre-training and lack the learning of…

Sound · Computer Science 2025-09-05 Yunqi Hao , Yihao Chen , Minqiang Xu , Jianbo Zhan , Liang He , Lei Fang , Sian Fang , Lin Liu