English
Related papers

Related papers: Improving Short Utterance Anti-Spoofing with AASIS…

200 papers

Spoofing detection systems are typically trained using diverse recordings from multiple speakers, often assuming that the resulting embeddings are independent of speaker identity. However, this assumption remains unverified. In this paper,…

Sound · Computer Science 2026-02-25 Anh-Tuan Dao , Driss Matrouf , Nicholas Evans

Automatic speaker verification (ASV) systems are often affected by spoofing attacks. Recent transformer-based models have improved anti-spoofing performance by learning strong feature representations. However, these models usually need high…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-14 Yang Xiao , Ting Dang , Rohan Kumar Das

Large Language Models (LLMs) have been applied in the speech domain, often incurring a performance drop due to misaligned between speech and language representations. To bridge this gap, we propose a joint speech and language model (SLM)…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Mingqiu Wang , Izhak Shafran , Hagen Soltau , Wei Han , Yuan Cao , Dian Yu , Laurent El Shafey

Multi-branch deep neural networks like AASIST3 achieve state-of-the-art comparable performance in audio anti-spoofing, yet their internal decision dynamics remain opaque compared to traditional input-level saliency methods. While existing…

Sound · Computer Science 2026-04-23 Ivan Viakhirev , Kirill Borodin , Mikhail Gorodnichev , Grach Mkrtchian

Text-based speech editing aims to modify specific segments while preserving speaker identity and acoustic context. Existing methods rely on task-specific training, which incurs high data costs and struggles with temporal fidelity in…

Sound · Computer Science 2026-04-20 Sihan Lv , Yechen Jin , Zhen Li , Jintao Chen , Jinshan Zhang , Ying Li , Jianwei Yin , Meng Xi

Speech self-supervised models such as wav2vec 2.0 and HuBERT are making revolutionary progress in Automatic Speech Recognition (ASR). However, they have not been totally proven to produce better performance on tasks other than ASR. In this…

Computation and Language · Computer Science 2022-10-05 Yingzhi Wang , Abdelmoumene Boumadane , Abdelwahab Heba

In recent years, synthetic speech generated by advanced text-to-speech (TTS) and voice conversion (VC) systems has caused great harms to automatic speaker verification (ASV) systems, urging us to design a synthetic speech detection system…

Sound · Computer Science 2021-08-16 Youxuan Ma , Zongze Ren , Shugong Xu

The existing fake audio detection systems often rely on expert experience to design the acoustic features or manually design the hyperparameters of the network structure. However, artificial adjustment of the parameters can have a…

Previous works have shown that automatic speaker verification (ASV) is seriously vulnerable to malicious spoofing attacks, such as replay, synthetic speech, and recently emerged adversarial attacks. Great efforts have been dedicated to…

Sound · Computer Science 2024-06-06 Haibin Wu , Xu Li , Andy T. Liu , Zhiyong Wu , Helen Meng , Hung-yi Lee

In real-world applications, it is challenging to build a speaker verification system that is simultaneously robust against common threats, including spoofing attacks, channel mismatch, and domain mismatch. Traditional automatic speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-11 Chang Zeng , Xiaoxiao Miao , Xin Wang , Erica Cooper , Junichi Yamagishi

Spoofing countermeasure (CM) and automatic speaker verification (ASV) sub-systems can be used in tandem with a backend classifier as a solution to the spoofing aware speaker verification (SASV) task. The two sub-systems are typically…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-21 Wanying Ge , Hemlata Tak , Massimiliano Todisco , Nicholas Evans

The performance of speech enhancement and separation systems in anechoic environments has been significantly advanced with the recent progress in end-to-end neural network architectures. However, the performance of such systems in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-17 Yi Luo , Cong Han , Nima Mesgarani

Deepfake speech detection presents a growing challenge as generative audio technologies continue to advance. We propose a hybrid training framework that advances detection performance through novel augmentation strategies. First, we…

Sound · Computer Science 2025-11-14 Inbal Rimon , Oren Gal , Haim Permuter

End-to-end speech-to-speech translation (S2ST) without relying on intermediate text representations is a rapidly emerging frontier of research. Recent works have demonstrated that the performance of such direct S2ST systems is approaching…

Computation and Language · Computer Science 2022-06-29 Ye Jia , Yifan Ding , Ankur Bapna , Colin Cherry , Yu Zhang , Alexis Conneau , Nobuyuki Morioka

The rapid advancement of audio generation technologies has escalated the risks of malicious deepfake audio across speech, sound, singing voice, and music, threatening multimedia security and trust. While existing countermeasures (CMs)…

Sound · Computer Science 2026-01-12 Yuankun Xie , Ruibo Fu , Zhiyong Wang , Xiaopeng Wang , Songjun Cao , Long Ma , Haonan Cheng , Long Ye

This paper presents a description of STC Ltd. systems submitted to the NIST 2021 Speaker Recognition Evaluation for both fixed and open training conditions. These systems consists of a number of diverse subsystems based on using deep neural…

Many recent source separation systems are designed to separate a fixed number of sources out of a mixture. In the cases where the source activation patterns are unknown, such systems have to either adjust the number of outputs or to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-19 Yi Luo , Nima Mesgarani

This paper introduces RawBoost, a data boosting and augmentation method for the design of more reliable spoofing detection solutions which operate directly upon raw waveform inputs. While RawBoost requires no additional data sources, e.g.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-23 Hemlata Tak , Madhu Kamble , Jose Patino , Massimiliano Todisco , Nicholas Evans

Sequence-to-Sequence (S2S) models recently started to show state-of-the-art performance for automatic speech recognition (ASR). With these large and deep models overfitting remains the largest problem, outweighing performance improvements…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-04 Thai-Son Nguyen , Sebastian Stueker , Jan Niehues , Alex Waibel

Speech enhancement improves speech quality and promotes the performance of various downstream tasks. However, most current speech enhancement work was mainly devoted to improving the performance of downstream automatic speech recognition…

Sound · Computer Science 2022-09-16 Jianrong Wang , Xiaomin Li , Xuewei Li , Mei Yu , Qiang Fang , Li Liu