English
Related papers

Related papers: Investigating self-supervised front ends for speec…

200 papers

Speech separation has been successfully applied as a frontend processing module of conversation transcription systems thanks to its ability to handle overlapped speech and its flexibility to combine with downstream tasks such as automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-06 Jian Wu , Zhuo Chen , Sanyuan Chen , Yu Wu , Takuya Yoshioka , Naoyuki Kanda , Shujie Liu , Jinyu Li

Recently, the end-to-end training approach for neural beamformer-supported multi-channel ASR has shown its effectiveness in multi-channel speech recognition. However, the integration of multiple modules makes it more difficult to perform…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-07 Keyu An , Zhijian Ou

The existing fake audio detection systems often rely on expert experience to design the acoustic features or manually design the hyperparameters of the network structure. However, artificial adjustment of the parameters can have a…

The automatic speaker verification spoofing (ASVspoof) challenge series is crucial for enhancing the spoofing consideration and the countermeasures growth. Although the recent ASVspoof 2019 validation results indicate the significant…

Sound · Computer Science 2022-09-27 Chenlei Hu , Ruohua Zhou

Single-channel speech enhancement approaches do not always improve automatic recognition rates in the presence of noise, because they can introduce distortions unhelpful for recognition. Following a trend towards end-to-end training of…

Sound · Computer Science 2021-12-14 Peter Plantinga , Deblin Bagchi , Eric Fosler-Lussier

This work details our approach to achieving a leading system with a 1.79% pooled equal error rate (EER) on the evaluation set of the Controlled Singing Voice Deepfake Detection (CtrSVDD). The rapid advancement of generative AI models…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-22 Anmol Guragain , Tianchi Liu , Zihan Pan , Hardik B. Sailor , Qiongqiong Wang

The second Automatic Speaker Verification Spoofing and Countermeasures challenge (ASVspoof 2017) focused on "replay attack" detection. The best deep-learning systems to compete in ASVspoof 2017 used Convolutional Neural Networks (CNNs) as a…

Audio and Speech Processing · Electrical Eng. & Systems 2018-05-24 Bhusan Chettri , Saumitra Mishra , Bob L. Sturm , Emmanouil Benetos

Deep learning has been applied to diverse audio semantics tasks, enabling the construction of models that learn hierarchical levels of features from high-dimensional raw data, delivering state-of-the-art performance. But do these algorithms…

Sound · Computer Science 2021-07-21 Lazaros Vrysis , Iordanis Thoidis , Charalampos Dimoulas , George Papanikolaou

This paper conducts a comprehensive layer-wise analysis of self-supervised learning (SSL) models for audio deepfake detection across diverse contexts, including multilingual datasets (English, Chinese, Spanish), partial, song, and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-10 Yassine El Kheir , Youness Samih , Suraj Maharjan , Tim Polzehl , Sebastian Möller

Recently, the end-to-end training approach for multi-channel ASR has shown its effectiveness, which usually consists of a beamforming front-end and a recognition back-end. However, the end-to-end training becomes more difficult due to the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-11 Keyu An , Ji Xiao , Zhijian Ou

This paper describes the UZH-CL system submitted to the SASV section of the WildSpoof 2026 challenge. The challenge focuses on the integrated defense against generative spoofing attacks by requiring the simultaneous verification of speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Aref Farhadipour , Ming Jin , Valeriia Vyshnevetska , Xiyang Li , Elisa Pellegrino , Srikanth Madikeri

Recent advancements in generative AI, particularly in speech synthesis, have enabled the generation of highly natural-sounding synthetic speech that closely mimics human voices. While these innovations hold promise for applications like…

Now-a-days, speech-based biometric systems such as automatic speaker verification (ASV) are highly prone to spoofing attacks by an imposture. With recent development in various voice conversion (VC) and speech synthesis (SS) algorithms,…

Sound · Computer Science 2016-11-18 Dipjyoti Paul , Monisankha Pal , Goutam Saha

Advances in speech synthesis technologies, like text-to-speech (TTS) and voice conversion (VC), have made detecting deepfake speech increasingly challenging. Spoofing countermeasures often struggle to generalize effectively, particularly…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-27 Wen Huang , Yanmei Gu , Zhiming Wang , Huijia Zhu , Yanmin Qian

This work proposes a novel support vector machine (SVM) based robust automatic speech recognition (ASR) front-end that operates on an ensemble of the subband components of high-dimensional acoustic waveforms. The key issues of selecting the…

Computation and Language · Computer Science 2014-01-15 Jibran Yousafzai , Zoran Cvetkovic , Peter Sollich , Matthew Ager

This work evaluated several cutting-edge large-scale foundation models based on self-supervision or weak supervision, including SeamlessM4T, SeamlessM4T v2, and Whisper-large-v3, on three code-switched corpora. We found that self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-02 Chih-Kai Yang , Kuan-Po Huang , Ke-Han Lu , Chun-Yi Kuan , Chi-Yuan Hsiao , Hung-yi Lee

The state-of-the-art audio deepfake detectors leveraging deep neural networks exhibit impressive recognition performance. Nonetheless, this advantage is accompanied by a significant carbon footprint. This is mainly due to the use of…

Sound · Computer Science 2024-03-22 Subhajit Saha , Md Sahidullah , Swagatam Das

This paper describes our DKU replay detection system for the ASVspoof 2019 challenge. The goal is to develop spoofing countermeasure for automatic speaker recognition in physical access scenario. We leverage the countermeasure system…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-08 Weicheng Cai , Haiwei Wu , Danwei Cai , Ming Li

Source separation can improve automatic speech recognition (ASR) under multi-party meeting scenarios by extracting single-speaker signals from overlapped speech. Despite the success of self-supervised learning models in single-channel…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-04 Yuang Li , Xianrui Zheng , Philip C. Woodland

Self-supervised learning (SSL) methods have proven to be very successful in automatic speech recognition (ASR). These great improvements have been reported mostly based on highly curated datasets such as LibriSpeech for non-streaming…

Sound · Computer Science 2022-05-19 Mostafa Karimi , Changliang Liu , Kenichi Kumatani , Yao Qian , Tianyu Wu , Jian Wu