English
Related papers

Related papers: DPCRN: Dual-Path Convolution Recurrent Network for…

200 papers

The Deep Noise Suppression (DNS) challenge is designed to foster innovation in the area of noise suppression to achieve superior perceptual speech quality. We recently organized a DNS challenge special session at INTERSPEECH and ICASSP…

Audio-visual target speech extraction, which aims to extract a certain speaker's speech from the noisy mixture by looking at lip movements, has made significant progress combining time-domain speech separation models and visual feature…

Multimedia · Computer Science 2023-03-07 Zhongweiyang Xu , Xulin Fan , Mark Hasegawa-Johnson

This paper aims to address two issues existing in the current speech enhancement methods: 1) the difficulty of phase estimations; 2) a single objective function cannot consider multiple metrics simultaneously. To solve the first problem, we…

Machine Learning · Statistics 2017-09-12 Szu-Wei Fu , Ting-yao Hu , Yu Tsao , Xugang Lu

We propose a speech enhancement method using a causal deep neural network~(DNN) for real-time applications. DNN has been widely used for estimating a time-frequency~(T-F) mask which enhances a speech signal. One popular DNN structure for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Daiki Takeuchi , Kohei Yatabe , Yuma Koizumi , Yasuhiro Oikawa , Noboru Harada

Deep neural network with dual-path bi-directional long short-term memory (BiLSTM) block has been proved to be very effective in sequence modeling, especially in speech separation, e.g. DPRNN-TasNet \cite{luo2019dual}. In this paper, we…

Sound · Computer Science 2020-10-28 Ziqiang Shi , Rujie Liu , Jiqing Han

We investigate the effectiveness of convolutive prediction, a novel formulation of linear prediction for speech dereverberation, for speaker separation in reverberant conditions. The key idea is to first use a deep neural network (DNN) to…

Sound · Computer Science 2021-08-17 Zhong-Qiu Wang , Gordon Wichern , Jonathan Le Roux

Deep noise suppressors (DNS) have become an attractive solution to remove background noise, reverberation, and distortions from speech and are widely used in telephony/voice applications. They are also occasionally prone to introducing…

Sound · Computer Science 2022-04-15 Abu Zaher Md Faridee , Hannes Gamper

Speech enhancement and source localization has been active research for several decades with a wide range of real-world applications. Recently, the Deep Complex Convolution Recurrent network (DCCRN) has yielded impressive enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Yuan Chen , Yicheng Hsu , Mingsian R. Bai

In this paper, we propose a multi-channel network for simultaneous speech dereverberation, enhancement and separation (DESNet). To enable gradient propagation and joint optimization, we adopt the attentional selection mechanism of the…

Sound · Computer Science 2020-11-17 Yihui Fu , Jian Wu , Yanxin Hu , Mengtao Xing , Lei Xie

Clipping is a common nonlinear distortion that occurs whenever the input or output of an audio system exceeds the supported range. This phenomenon undermines not only the perception of speech quality but also downstream processes utilizing…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Jayeon Yi , Junghyun Koo , Kyogu Lee

Speech dereverberation is an important stage in many speech technology applications. Recent work in this area has been dominated by deep neural network models. Temporal convolutional networks (TCNs) are deep learning models that have been…

Sound · Computer Science 2022-07-26 William Ravenscroft , Stefan Goetze , Thomas Hain

Convolutional neural network (CNN) modules are widely being used to build high-end speech enhancement neural models. However, the feature extraction power of vanilla CNN modules has been limited by the dimensionality constraint of the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-07 Muhammed PV Shifas , Santelli Claudio , Vassilis Tsiaras , Yannis Stylianou

This study proposes a fully convolutional network (FCN) model for raw waveform-based speech enhancement. The proposed system performs speech enhancement in an end-to-end (i.e., waveform-in and waveform-out) manner, which dif-fers from most…

Machine Learning · Statistics 2017-06-16 Szu-Wei Fu , Yu Tsao , Xugang Lu , Hisashi Kawai

We present a novel model designed for resource-efficient multichannel speech enhancement in the time domain, with a focus on low latency, lightweight, and low computational requirements. The proposed model incorporates explicit spatial and…

Sound · Computer Science 2024-01-17 Ashutosh Pandey , Buye Xu

Accurate classification of fine-grained images remains a challenge in backbones based on convolutional operations or self-attention mechanisms. This study proposes novel dual-current neural networks (DCNN), which combine the advantages of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Da Fu , Mingfei Rong , Eun-Hu Kim , Hao Huang , Witold Pedrycz

We introduce a deep residual recurrent neural network (DR-RNN) as an efficient model reduction technique for nonlinear dynamical systems. The developed DR-RNN is inspired by the iterative steps of line search methods in finding the residual…

Computational Engineering, Finance, and Science · Computer Science 2017-09-05 J. Nagoor Kani , Ahmed H. Elsheikh

Despite multiple efforts made towards adopting complex-valued deep neural networks (DNNs), it remains an open question whether complex-valued DNNs are generally more effective than real-valued DNNs for monaural speech enhancement. This work…

Sound · Computer Science 2023-01-12 Haibin Wu , Ke Tan , Buye Xu , Anurag Kumar , Daniel Wong

Deep neural networks are often coupled with traditional spatial filters, such as MVDR beamformers for effectively exploiting spatial information. Even though single-stage end-to-end supervised models can obtain impressive enhancement,…

Sound · Computer Science 2022-04-07 Asutosh Pandey , Buye Xu , Anurag Kumar , Jacob Donley , Paul Calamia , DeLiang Wang

Data-driven speech enhancement employing deep neural networks (DNNs) can provide state-of-the-art performance even in the presence of non-stationary noise. During the training process, most of the speech enhancement neural networks are…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-01 Ziyi Xu , Maximilian Strake , Tim Fingscheidt

This paper introduces a new Dynamic Gated Recurrent Neural Network (DG-RNN) for compute-efficient speech enhancement models running on resource-constrained hardware platforms. It leverages the slow evolution characteristic of RNN hidden…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Longbiao Cheng , Ashutosh Pandey , Buye Xu , Tobi Delbruck , Shih-Chii Liu