English
Related papers

Related papers: On Data Sampling Strategies for Training Neural Ne…

200 papers

Although deep learning has substantially advanced speech separation in recent years, most existing studies continue to prioritize separation quality while overlooking computational efficiency, an essential factor for low-latency speech…

Sound · Computer Science 2025-05-20 Yuqi Li , Kai Li , Xin Yin , Zhifei Yang , Junhao Dong , Zeyu Dong , Chuanguang Yang , Yingli Tian , Yao Lu

Internal language model (ILM) subtraction has been widely applied to improve the performance of the RNN-Transducer with external language model (LM) fusion for speech recognition. In this work, we show that sequence discriminative training…

Sound · Computer Science 2024-04-16 Zijian Yang , Wei Zhou , Ralf Schlüter , Hermann Ney

In this paper, we address the intricate issue of RF signal separation by presenting a novel adaptation of the WaveNet architecture that introduces learnable dilation parameters, significantly enhancing signal separation in dense RF…

Signal Processing · Electrical Eng. & Systems 2024-02-16 Yu Tian , Ahmed Alhammadi , Abdullah Quran , Abubakar Sani Ali

There are a number of studies about extraction of bottleneck (BN) features from deep neural networks (DNNs)trained to discriminate speakers, pass-phrases and triphone states for improving the performance of text-dependent speaker…

Sound · Computer Science 2019-05-14 Achintya kr. Sarkar , Zheng-Hua Tan , Hao Tang , Suwon Shon , James Glass

Time-domain training criteria have proven to be very effective for the separation of single-channel non-reverberant speech mixtures. Likewise, mask-based beamforming has shown impressive performance in multi-channel reverberant speech…

Recording channel mismatch between training and testing conditions has been shown to be a serious problem for speech separation. This situation greatly reduces the separation performance, and cannot meet the requirement of daily use. In…

Sound · Computer Science 2022-10-28 Fan-Lin Wang , Yao-Fei Cheng , Hung-Shin Lee , Yu Tsao , Hsin-Min Wang

Deep learning applications are drastically progressing in seismic processing and interpretation tasks. However, the majority of approaches subsample data volumes and restrict model sizes to minimise computational requirements. Subsampling…

Geophysics · Physics 2021-02-26 Claire Birnie , Haithem Jarraya , Fredrik Hansteen

One of the leading single-channel speech separation (SS) models is based on a TasNet with a dual-path segmentation technique, where the size of each segment remains unchanged throughout all layers. In contrast, our key finding is that…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-09 Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu

Time Delay Neural Networks (TDNNs) are widely used in both DNN-HMM based hybrid speech recognition systems and recent end-to-end systems. Nevertheless, the receptive fields of TDNNs are limited and fixed, which is not desirable for tasks…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-03 Keyu An , Yi Zhang , Zhijian Ou

Target speech separation is the process of filtering a certain speaker's voice out of speech mixtures according to the additional speaker identity information provided. Recent works have made considerable improvement by processing signals…

Sound · Computer Science 2021-09-28 Qingjian Lin , Lin Yang , Xuyang Wang , Luyuan Xie , Chen Jia , Junjie Wang

Batch-splitting (data-parallelism) is the dominant distributed Deep Neural Network (DNN) training strategy, due to its universal applicability and its amenability to Single-Program-Multiple-Data (SPMD) programming. However, batch-splitting…

The real-time processing of time series signals is a critical issue for many real-life applications. The idea of real-time processing is especially important in audio domain as the human perception of sound is sensitive to any kind of…

Machine Learning · Computer Science 2023-02-10 Grzegorz Stefański , Krzysztof Arendt , Paweł Daniluk , Bartłomiej Jasik , Artur Szumaczuk

While deep learning has demonstrated impressive progress, it remains a daunting challenge to learn from hard samples as these samples are usually noisy and intricate. These hard samples play a crucial role in the optimal performance of deep…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Qiao Xiao , Boqian Wu , Lu Yin , Christopher Neil Gadzinski , Tianjin Huang , Mykola Pechenizkiy , Decebal Constantin Mocanu

We present a novel source separation model to decompose asingle-channel speech signal into two speech segments belonging to two different speakers. The proposed model is a neural network based on residual blocks, and uses learnt speaker…

Sound · Computer Science 2019-06-25 Shuo Liu , Gil Keren , Björn Schuller

Spoken language models (SLMs) typically discretize speech into high-frame-rate tokens extracted from SSL speech models. As the most successful LMs are based on the Transformer architecture, processing these long token streams with…

Computation and Language · Computer Science 2026-02-05 Nicholas Lee , Cheol Jun Cho , Alan W Black , Gopala K. Anumanchipalli

The goal of this paper is to simulate the benefits of jointly applying active learning (AL) and semi-supervised training (SST) in a new speech recognition application. Our data selection approach relies on confidence filtering, and its…

Computation and Language · Computer Science 2019-03-08 Thomas Drugman , Janne Pylkkonen , Reinhard Kneser

Speech-only spoken language models (SLMs) lag behind text and text-speech models in performance, with recent discrete autoregressive (AR) SLMs indicating significant computational and data demands to match text models. Since discretizing…

Deep dilated temporal convolutional networks (TCN) have been proved to be very effective in sequence modeling. In this paper we propose several improvements of TCN for end-to-end approach to monaural speech separation, which consists of 1)…

Sound · Computer Science 2023-06-27 Liwen Zhang , Ziqiang Shi , Jiqing Han , Anyan Shi , Ding Ma

This research addresses the problem of acoustic modeling of low-resource languages for which transcribed training data is absent. The goal is to learn robust frame-level feature representations that can be used to identify and distinguish…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-01 Siyuan Feng , Tan Lee

Speech enhancement and separation are two fundamental tasks for robust speech processing. Speech enhancement suppresses background noise while speech separation extracts target speech from interfering speakers. Despite a great number of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-16 Zili Huang , Shinji Watanabe , Shu-wen Yang , Paola Garcia , Sanjeev Khudanpur