English
Related papers

Related papers: Multi-Utterance Speech Separation and Association …

200 papers

In this paper we propose to use utterance-level Permutation Invariant Training (uPIT) for speaker independent multi-talker speech separation and denoising, simultaneously. Specifically, we train deep bi-directional Long Short-Term Memory…

Sound · Computer Science 2018-12-06 Morten Kolbæk , Dong Yu , Zheng-Hua Tan , Jesper Jensen

This paper proposes APSS, a novel neural speech separation model with parallel amplitude and phase spectrum estimation. Unlike most existing speech separation methods, the APSS distinguishes itself by explicitly estimating the phase…

Sound · Computer Science 2025-09-18 Fei Liu , Yang Ai , Zhen-Hua Ling

The x-vector based deep neural network (DNN) embedding systems have demonstrated effectiveness for text-independent speaker verification. This paper presents a multi-task learning architecture for training the speaker embedding DNN with the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-05 Lanhua You , Wu Guo , Lirong Dai , Jun Du

Improving distant speech recognition is a crucial step towards flexible human-machine interfaces. Current technology, however, still exhibits a lack of robustness, especially when adverse acoustic conditions are met. Despite the significant…

Computation and Language · Computer Science 2017-03-27 Mirco Ravanelli , Philemon Brakel , Maurizio Omologo , Yoshua Bengio

We have recently shown that deep Long Short-Term Memory (LSTM) recurrent neural networks (RNNs) outperform feed forward deep neural networks (DNNs) as acoustic models for speech recognition. More recently, we have shown that the performance…

Computation and Language · Computer Science 2015-07-27 Haşim Sak , Andrew Senior , Kanishka Rao , Françoise Beaufays

Recently, deep learning-based beamforming algorithms have shown promising performance in target speech extraction tasks. However, most systems do not fully utilize spatial information. In this paper, we propose a target speech extraction…

Sound · Computer Science 2023-06-29 Aoqi Guo , Junnan Wu , Peng Gao , Wenbo Zhu , Qinwen Guo , Dazhi Gao , Yujun Wang

Deep neural networks have shown recent promise in many language-related tasks such as the modeling of conversations. We extend RNN-based sequence to sequence models to capture the long range discourse across many turns of conversation. We…

Computation and Language · Computer Science 2016-07-18 John M. Pierre , Mark Butler , Jacob Portnoff , Luis Aguilar

Deep neural networks (DNNs) have achieved substantial predictive performance in various speech processing tasks. Particularly, it has been shown that a monaural speech separation task can be successfully solved with a DNN-based method…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-20 Chihiro Watanabe , Hirokazu Kameoka

We study the segmental recurrent neural network for end-to-end acoustic modelling. This model connects the segmental conditional random field (CRF) with a recurrent neural network (RNN) used for feature extraction. Compared to most previous…

Computation and Language · Computer Science 2016-06-21 Liang Lu , Lingpeng Kong , Chris Dyer , Noah A. Smith , Steve Renals

Speech separation seeks to isolate individual speech signals from a multi-talk speech mixture. Despite much progress, a system well-trained on synthetic data often experiences performance degradation on out-of-domain data, such as…

Sound · Computer Science 2025-03-18 Wupeng Wang , Zexu Pan , Jingru Lin , Shuai Wang , Haizhou Li

Recent advances in deep learning have significantly improved multichannel speech enhancement algorithms, yet conventional training loss functions such as the scale-invariant signal-to-distortion ratio (SDR) may fail to preserve fine-grained…

Sound · Computer Science 2025-06-24 Nasser-Eddine Monir , Paul Magron , Romain Serizel

Speech separation refers to extracting each individual speech source in a given mixed signal. Recent advancements in speech separation and ongoing research in this area, have made these approaches as promising techniques for pre-processing…

Machine Learning · Computer Science 2019-12-18 Fahimeh Bahmaninezhad , Shi-Xiong Zhang , Yong Xu , Meng Yu , John H. L. Hansen , Dong Yu

Speech segmentation is an essential part of speech translation (ST) systems in real-world scenarios. Since most ST models are designed to process speech segments, long-form audio must be partitioned into shorter segments before translation.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-18 Jaesong Lee , Soyoon Kim , Hanbyul Kim , Joon Son Chung

Sequence prediction and classification are ubiquitous and challenging problems in machine learning that can require identifying complex dependencies between temporally distant inputs. Recurrent Neural Networks (RNNs) have the ability, in…

Neural and Evolutionary Computing · Computer Science 2014-02-17 Jan Koutník , Klaus Greff , Faustino Gomez , Jürgen Schmidhuber

One of the fundamental principles of contemporary linguistics states that language processing requires the ability to extract recursively nested tree structures. However, it remains unclear whether and how this code could be implemented in…

Computation and Language · Computer Science 2021-01-08 Yair Lakretz , Théo Desbordes , Jean-Rémi King , Benoît Crabbé , Maxime Oquab , Stanislas Dehaene

Recent research shows that deep neural networks (DNNs) can be used to extract deep speaker vectors (d-vectors) that preserve speaker characteristics and can be used in speaker verification. This new method has been tested on text-dependent…

Computation and Language · Computer Science 2015-05-26 Lantian Li , Dong Wang , Zhiyong Zhang , Thomas Fang Zheng

Recurrent neural networks (RNNs) are powerful architectures to model sequential data, due to their capability to learn short and long-term dependencies between the basic elements of a sequence. Nonetheless, popular tasks such as speech or…

We propose a tensor-to-vector regression approach to multi-channel speech enhancement in order to address the issue of input size explosion and hidden-layer size expansion. The key idea is to cast the conventional deep neural network (DNN)…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-04 Jun Qi , Hu Hu , Yannan Wang , Chao-Han Huck Yang , Sabato Marco Siniscalchi , Chin-Hui Lee

Creating universal speaker encoders which are robust for different acoustic and speech duration conditions is a big challenge today. According to our observations systems trained on short speech segments are optimal for short phrase speaker…

Sound · Computer Science 2022-10-31 Sergey Novoselov , Vladimir Volokhov , Galina Lavrentyeva

The real-time processing of time series signals is a critical issue for many real-life applications. The idea of real-time processing is especially important in audio domain as the human perception of sound is sensitive to any kind of…

Machine Learning · Computer Science 2023-02-10 Grzegorz Stefański , Krzysztof Arendt , Paweł Daniluk , Bartłomiej Jasik , Artur Szumaczuk