English
Related papers

Related papers: TF-GridNet: Integrating Full- and Sub-Band Modelin…

200 papers

Recently, the source separation performance was greatly improved by time-domain audio source separation based on dual-path recurrent neural network (DPRNN). DPRNN is a simple but effective model for a long sequential data. While DPRNN is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-25 Keisuke Kinoshita , Thilo von Neumann , Marc Delcroix , Tomohiro Nakatani , Reinhold Haeb-Umbach

Music source separation (MSS) aims to extract 'vocals', 'drums', 'bass' and 'other' tracks from a piece of mixed music. While deep learning methods have shown impressive results, there is a trend toward larger models. In our paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-20 Junyu Chen , Susmitha Vekkot , Pancham Shukla

In this paper, we propose a novel recurrent neural network architecture for speech separation. This architecture is constructed by unfolding the iterations of a sequential iterative soft-thresholding algorithm (ISTA) that solves the…

Sound · Computer Science 2017-09-22 Scott Wisdom , Thomas Powers , James Pitton , Les Atlas

Previously proposed FullSubNet has achieved outstanding performance in Deep Noise Suppression (DNS) Challenge and attracted much attention. However, it still encounters issues such as input-output mismatch and coarse processing for…

Sound · Computer Science 2022-03-29 Jun Chen , Zilin Wang , Deyi Tuo , Zhiyong Wu , Shiyin Kang , Helen Meng

Monaural source separation is important for many real world applications. It is challenging because, with only a single channel of information available, without any constraints, an infinite number of solutions are possible. In this paper,…

Sound · Computer Science 2015-10-02 Po-Sen Huang , Minje Kim , Mark Hasegawa-Johnson , Paris Smaragdis

Recently, our proposed recurrent neural network (RNN) based all deep learning minimum variance distortionless response (ADL-MVDR) beamformer method yielded superior performance over the conventional MVDR by replacing the matrix inversion…

Sound · Computer Science 2021-04-27 Xiyun Li , Yong Xu , Meng Yu , Shi-Xiong Zhang , Jiaming Xu , Bo Xu , Dong Yu

Deep neural networks (DNNs) have greatly benefited direction of arrival (DoA) estimation methods for speech source localization in noisy environments. However, their localization accuracy is still far from satisfactory due to the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-21 Kuan-Lin Chen , Ching-Hua Lee , Bhaskar D. Rao , Harinath Garudadri

Multi-frame algorithms for single-channel speech enhancement are able to take advantage from short-time correlations within the speech signal. Deep Filtering (DF) was proposed to directly estimate a complex filter in frequency domain to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-16 Hendrik Schröter , Tobias Rosenkranz , Alberto N. Escalante-B. , Andreas Maier

The most recent deep neural network (DNN) models exhibit impressive denoising performance in the time-frequency (T-F) magnitude domain. However, the phase is also a critical component of the speech signal that is easily overlooked. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-10 Lu Zhang , Mingjiang Wang , Zehua Zhang , Xuyi Zhuang

Speech separation has been very successful with deep learning techniques. Substantial effort has been reported based on approaches over spectrogram, which is well known as the standard time-and-frequency cross-domain representation for…

Sound · Computer Science 2019-04-17 Gene-Ping Yang , Chao-I Tuan , Hung-Yi Lee , Lin-shan Lee

Speech enhancement aims to improve speech quality and intelligibility in noisy environments. Recent advancements have concentrated on deep neural networks, particularly employing the Two-Stage (TS) architecture to enhance feature…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-19 Zizhen Lin , Yuanle Li , Junyu Wang , Ruili Li

This work proposes a multichannel narrow-band speech separation network. In the short-time Fourier transform (STFT) domain, the proposed network processes each frequency independently, and all frequencies use a shared network. For each…

Sound · Computer Science 2022-12-06 Changsheng Quan , Xiaofei Li

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. To improve robustness of speaker recognition system performance in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Yanpei Shi , Qiang Huang , Thomas Hain

Deep neural networks have become an indispensable technique for audio source separation (ASS). It was recently reported that a variant of CNN architecture called MMDenseNet was successfully employed to solve the ASS problem of estimating…

Sound · Computer Science 2018-05-30 Naoya Takahashi , Nabarun Goswami , Yuki Mitsufuji

The DeepFilterNet (DFN) architecture was recently proposed as a deep learning model suited for hearing aid devices. Despite its competitive performance on numerous benchmarks, it still follows a `one-size-fits-all' approach, which aims to…

We propose a deep beamforming framework for enhancing target speaker(s) in multi-speaker environments. A deep neural network (DNN) is trained to estimate beamforming weights directly from noisy multichannel inputs while satisfying linear…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-21 Ilai Zaidel , Ori Engel , Bar Engel , Sharon Gannot

Speech dereverberation in distant-microphone scenarios remains challenging due to the high correlation between reverberation and target signals, often leading to poor generalization in real-world environments. We propose IF-CorrNet, a…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Ui-Hyeop Shin , Jun Hyung Kim , Jangyeon Kim , Wooseok Kim , Hyung-Min Park

Speech-related applications deliver inferior performance in complex noise environments. Therefore, this study primarily addresses this problem by introducing speech-enhancement (SE) systems based on deep neural networks (DNNs) applied to a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-26 Syu-Siang Wang , Yu-You Liang , Jeih-weih Hung , Yu Tsao , Hsin-Min Wang , Shih-Hau Fang

This paper aims at eliminating the interfering speakers' speech, additive noise, and reverberation from the noisy multi-talker speech mixture that benefits automatic speech recognition (ASR) backend. While the recently proposed Weighted…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-19 Zhaoheng Ni , Yong Xu , Meng Yu , Bo Wu , Shixiong Zhang , Dong Yu , Michael I Mandel

High-quality and intelligible speech is essential to text-to-speech (TTS) model training, however, obtaining high-quality data for low-resource languages is challenging and expensive. Applying speech enhancement on Automatic Speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-20 Zhaoheng Ni , Sravya Popuri , Ning Dong , Kohei Saijo , Xiaohui Zhang , Gael Le Lan , Yangyang Shi , Vikas Chandra , Changhan Wang