English
Related papers

Related papers: Generalizable Audio Deepfake Detection via Latent …

200 papers

Self-supervised learning (SSL) speech representation models, trained on large speech corpora, have demonstrated effectiveness in extracting hierarchical speech embeddings through multiple transformer layers. However, the behavior of these…

Computation and Language · Computer Science 2024-06-18 Zihan Pan , Tianchi Liu , Hardik B. Sailor , Qiongqiong Wang

Current audio deepfake detection has achieved remarkable performance using diverse deep learning architectures such as ResNet, and has seen further improvements with the introduction of large models (LMs) like Wav2Vec. The success of large…

Sound · Computer Science 2026-03-27 Yupei Li , Shuaijie Shao , Manuel Milling , Björn Schuller

Recent advances in deep learning and computer vision have made the synthesis and counterfeiting of multimedia content more accessible than ever, leading to possible threats and dangers from malicious users. In the audio field, we are…

Sound · Computer Science 2023-07-31 Daniele Mari , Davide Salvi , Paolo Bestagini , Simone Milani

In real-world applications, it is challenging to build a speaker verification system that is simultaneously robust against common threats, including spoofing attacks, channel mismatch, and domain mismatch. Traditional automatic speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-11 Chang Zeng , Xiaoxiao Miao , Xin Wang , Erica Cooper , Junichi Yamagishi

Recent text-to-speech (TTS) developments have made voice cloning (VC) more realistic, affordable, and easily accessible. This has given rise to many potential abuses of this technology, including Joe Biden's New Hampshire deepfake robocall.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-29 Hashim Ali , Surya Subramani , Hafiz Malik

Automatic Speaker Verification (ASV) systems are increasingly used in voice bio-metrics for user authentication but are susceptible to logical and physical spoofing attacks, posing security risks. Existing research mainly tackles logical or…

Sound · Computer Science 2023-09-20 Awais Khan , Khalid Mahmood Malik

ASVspoof 2021 is the forth edition in the series of bi-annual challenges which aim to promote the study of spoofing and the design of countermeasures to protect automatic speaker verification systems from manipulation. In addition to a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-07 Junichi Yamagishi , Xin Wang , Massimiliano Todisco , Md Sahidullah , Jose Patino , Andreas Nautsch , Xuechen Liu , Kong Aik Lee , Tomi Kinnunen , Nicholas Evans , Héctor Delgado

Deep learning has brought impressive progress in the study of both automatic speaker verification (ASV) and spoofing countermeasures (CM). Although solutions are mutually dependent, they have typically evolved as standalone sub-systems…

Data augmentation is vital to the generalization ability and robustness of deep neural networks (DNNs) models. Existing augmentation methods for speaker verification manipulate the raw signal, which are time-consuming and the augmented…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-19 Yuanyuan Wang , Yang Zhang , Zhiyong Wu , Zhihan Yang , Tao Wei , Kun Zou , Helen Meng

Existing approaches for anti-spoofing in automatic speaker verification (ASV) still lack generalizability to unseen attacks. The Res2Net approach designs a residual-like connection between feature groups within one block, which increases…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-20 Xu Li , Xixin Wu , Hui Lu , Xunying Liu , Helen Meng

Automatic speaker verification (ASV) is one of the most natural and convenient means of biometric person recognition. Unfortunately, just like all other biometric systems, ASV is vulnerable to spoofing, also referred to as "presentation…

The use of deep neural networks (DNN) has dramatically elevated the performance of automatic speaker verification (ASV) over the last decade. However, ASV systems can be easily neutralized by spoofing attacks. Therefore, the Spoofing-Aware…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Jungwoo Heo , Ju-ho Kim , Hyun-seo Shin

Recent advances in Text-to-Speech (TTS) and Voice-Conversion (VC) using generative Artificial Intelligence (AI) technology have made it possible to generate high-quality and realistic human-like audio. This poses growing challenges in…

Sound · Computer Science 2025-03-25 Xiang Li , Pin-Yu Chen , Wenqi Wei

Modern text-to-speech (TTS) and voice conversion (VC) systems produce natural sounding speech that questions the security of automatic speaker verification (ASV). This makes detection of such synthetic speech very important to safeguard ASV…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-22 Zhenzong Wu , Rohan Kumar Das , Jichen Yang , Haizhou Li

Recent research has highlighted a key issue in speech deepfake detection: models trained on one set of deepfakes perform poorly on others. The question arises: is this due to the continuously improving quality of Text-to-Speech (TTS)…

Sound · Computer Science 2024-06-13 Nicolas M. Müller , Nicholas Evans , Hemlata Tak , Philip Sperl , Konstantin Böttinger

Speech deepfake detection has achieved remarkable success in clean environments but faces significant challenges in complex, real-world scenarios where speech is often mixed with background music or noise. Current state-of-the-art methods…

Sound · Computer Science 2026-05-25 Qingcao Li , Yipeng Lin , Weichen Lian , Zhongjie Ba , Peng Cheng , Zhichao Lian

Dysarthric speech reconstruction (DSR) aims to convert dysarthric speech into comprehensible speech while maintaining the speaker's identity. Despite significant advancements, existing methods often struggle with low speech intelligibility…

Sound · Computer Science 2025-06-03 Xueyuan Chen , Dongchao Yang , Wenxuan Wu , Minglin Wu , Jing Xu , Xixin Wu , Zhiyong Wu , Helen Meng

Recent studies in deepfake detection have yielded promising results when the training and testing face forgeries are from the same dataset. However, the problem remains challenging when one tries to generalize the detector to forgeries…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Liang Chen , Yong Zhang , Yibing Song , Lingqiao Liu , Jue Wang

Localizing partial deepfake audio, where only segments of speech are manipulated, remains challenging due to the subtle and scattered nature of these modifications. Existing approaches typically rely on frame-level predictions to identify…

Sound · Computer Science 2026-01-30 Yuchen Mao , Wen Huang , Yanmin Qian

The rapid advancement of spoofing algorithms necessitates the development of robust detection methods capable of accurately identifying emerging fake audio. Traditional approaches, such as finetuning on new datasets containing these novel…

Sound · Computer Science 2023-06-16 Xiaohui Zhang , Jiangyan Yi , Jianhua Tao , Chenlong Wang , Le Xu , Ruibo Fu