English
Related papers

Related papers: Nes2Net: A Lightweight Nested Architecture for Fou…

200 papers

In interactive automatic speech recognition (ASR) systems, low-latency requirements limit the amount of search space that can be explored during decoding, particularly in end-to-end neural ASR. In this paper, we present a novel streaming…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-29 Denis Filimonov , Prabhat Pandey , Ariya Rastrow , Ankur Gandhe , Andreas Stolcke

We propose a novel neural speaker diarization system using memory-aware multi-speaker embedding with sequence-to-sequence architecture (NSD-MS2S), which integrates the strengths of memory-aware multi-speaker embedding (MA-MSE) and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-27 Gaobin Yang , Maokui He , Shutong Niu , Ruoyu Wang , Yanyan Yue , Shuangqing Qian , Shilong Wu , Jun Du , Chin-Hui Lee

The rapid advancement of AI has enabled highly realistic speech synthesis and voice cloning, posing serious risks to voice authentication, smart assistants, and telecom security. While most prior work frames spoof detection as a binary…

Sound · Computer Science 2025-09-10 Bin Hu , Kunyang Huang , Daehan Kwak , Meng Xu , Kuan Huang

It becomes urgent to design effective anti-spoofing algorithms for vulnerable automatic speaker verification systems due to the advancement of high-quality playback devices. Current studies mainly treat anti-spoofing as a binary…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Yongqiang Dou , Haocheng Yang , Maolin Yang , Yanyan Xu , Dengfeng Ke

This paper describes the IDLab submission for the text-independent task of the Short-duration Speaker Verification Challenge 2021 (SdSVC-21). This speaker verification competition focuses on short duration test recordings and cross-lingual…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-10 Jenthe Thienpondt , Brecht Desplanques , Kris Demuynck

The Automatic Speaker Verification (ASV) system is vulnerable to fraudulent activities using audio deepfakes, also known as logical-access voice spoofing attacks. These deepfakes pose a concerning threat to voice biometrics due to recent…

Sound · Computer Science 2023-10-09 Awais Khan , Khalid Mahmood Malik

We introduce Amortized Neural Networks (AmNets), a compute cost- and latency-aware network architecture particularly well-suited for sequence modeling tasks. We apply AmNets to the Recurrent Neural Network Transducer (RNN-T) to reduce…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-04 Jonathan Macoskey , Grant P. Strimel , Jinru Su , Ariya Rastrow

Modern speaker verification systems primarily rely on speaker embeddings, followed by verification based on cosine similarity between the embedding vectors of the enrollment and test utterances. While effective, these methods struggle with…

Sound · Computer Science 2025-07-04 Wan Lin , Junhui Chen , Tianhao Wang , Zhenyu Zhou , Lantian Li , Dong Wang

The DeepFilterNet (DFN) architecture was recently proposed as a deep learning model suited for hearing aid devices. Despite its competitive performance on numerous benchmarks, it still follows a `one-size-fits-all' approach, which aims to…

In this paper, we propose the multi-perspective information fusion (MPIF) Res2Net with random Specmix for fake speech detection (FSD). The main purpose of this system is to improve the model's ability to learn precise forgery information…

Sound · Computer Science 2023-06-28 Shunbo Dong , Jun Xue , Cunhang Fan , Kang Zhu , Yujie Chen , Zhao Lv

Deepfake audio detection has progressed rapidly with strong pre-trained encoders (e.g., WavLM, Wav2Vec2, MMS). However, performance in realistic capture conditions - background noise (domestic/office/transport), room reverberation, and…

Sound · Computer Science 2025-12-17 Udayon Sen , Alka Luqman , Anupam Chattopadhyay

Recently, deep neural networks (DNNs) have been successfully used for speech enhancement, and DNN-based speech enhancement is becoming an attractive research area. While time-frequency masking based on the short-time Fourier transform…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-21 Yuichiro Koyama , Tyler Vuong , Stefan Uhlich , Bhiksha Raj

Speech enhancement is critical for improving speech intelligibility and quality in various audio devices. In recent years, deep learning-based methods have significantly improved speech enhancement performance, but they often come with a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Xiang Hao , Chenxiang Ma , Qu Yang , Jibin Wu , Kay Chen Tan

Although deep neural networks are successful for many tasks in the speech domain, the high computational and memory costs of deep neural networks make it difficult to directly deploy highperformance Neural Network systems on low-resource…

Sound · Computer Science 2021-04-07 Tinglong Zhu , Xiaoyi Qin , Ming Li

Despite recent improvements in End-to-End Automatic Speech Recognition (E2E ASR) systems, the performance can degrade due to vocal characteristic mismatches between training and testing data, particularly with limited target speaker…

Recent advances in audio generation have increased the risk of realistic environmental sound manipulation, motivating the ESDD 2026 Challenge as the first large-scale benchmark for Environmental Sound Deepfake Detection (ESDD). We propose…

In this paper, we present ECAPA2, a novel hybrid neural network architecture and training strategy to produce robust speaker embeddings. Most speaker verification models are based on either the 1D- or 2D-convolutional operation, often…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-17 Jenthe Thienpondt , Kris Demuynck

Self-supervised speech representation learning (SSL) has shown to be effective in various downstream tasks, but SSL models are usually large and slow. Model compression techniques such as pruning aim to reduce the model size and computation…

Computation and Language · Computer Science 2023-03-01 Yifan Peng , Kwangyoun Kim , Felix Wu , Prashant Sridhar , Shinji Watanabe

The inverse short-time Fourier transform network (iSTFTNet) has garnered attention owing to its fast, lightweight, and high-fidelity speech synthesis. It obtains these characteristics using a fast and lightweight 1D CNN as the backbone and…

Sound · Computer Science 2023-08-15 Takuhiro Kaneko , Hirokazu Kameoka , Kou Tanaka , Shogo Seki

It is well known that speaker verification systems are subject to spoofing attacks. The Automatic Speaker Verification Spoofing and Countermeasures Challenge -- ASVSpoof2015 -- provides a standard spoofing database, containing attacks based…