English
Related papers

Related papers: Dense CNN with Self-Attention for Time-Domain Spee…

200 papers

Previous speech enhancement methods focus on estimating the short-time spectrum of speech signals due to its short-term stability. However, these methods often only estimate the clean magnitude spectrum and reuse the noisy phase when…

Sound · Computer Science 2019-10-23 Chuang Geng , Lei Wang

Convolutional neural network (CNN) modules are widely being used to build high-end speech enhancement neural models. However, the feature extraction power of vanilla CNN modules has been limited by the dimensionality constraint of the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-07 Muhammed PV Shifas , Santelli Claudio , Vassilis Tsiaras , Yannis Stylianou

Recently, multi-channel speech enhancement has drawn much interest due to the use of spatial information to distinguish target speech from interfering signal. To make full use of spatial information and neural network based masking…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-18 Shubo Lv , Yihui Fu , Yukai Jv , Lei Xie , Weixin Zhu , Wei Rao , Yannan Wang

Decoding human activity accurately from wearable sensors can aid in applications related to healthcare and context awareness. The present approaches in this domain use recurrent and/or convolutional models to capture the spatio-temporal…

Human-Computer Interaction · Computer Science 2020-12-21 Satya P. Singh , Aimé Lay-Ekuakille , Deepak Gangwar , Madan Kumar Sharma , Sukrit Gupta

Deep neural network (DNN) based end-to-end optimization in the complex time-frequency (T-F) domain or time domain has shown considerable potential in monaural speech separation. Many recent studies optimize loss functions defined solely in…

Sound · Computer Science 2022-01-05 Zhong-Qiu Wang , Gordon Wichern , Jonathan Le Roux

Fully Convolution Networks (FCN) have achieved great success in dense prediction tasks including semantic segmentation. In this paper, we start from discussing FCN by understanding its architecture limitations in building a strong…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Bing Shuai , Ting Liu , Gang Wang

Audio-visual speech enhancement system is regarded to be one of promising solutions for isolating and enhancing speech of desired speaker. Conventional methods focus on predicting clean speech spectrum via a naive convolution neural network…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-28 Xinmeng Xu , Jianjun Hao

Algorithmic latency in speech processing is dominated by the frame length used for Fourier analysis, which in turn limits the achievable performance of magnitude-centric approaches. As previous studies suggest the importance of phase grows…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-26 Tal Peer , Timo Gerkmann

The encoder-decoder architecture is widely used as a lightweight semantic segmentation network. However, it struggles with a limited performance compared to a well-designed Dilated-FCN model for two major problems. First, commonly used…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Jiangyun Li , Sen Zha , Chen Chen , Meng Ding , Tianxiang Zhang , Hong Yu

Deep convolutional neural networks (CNNs) for image denoising can effectively exploit rich hierarchical features and have achieved great success. However, many deep CNN-based denoising models equally utilize the hierarchical features of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Wencong Wu , An Ge , Guannan Lv , Yuelong Xia , Yungang Zhang , Wen Xiong

From hearing aids to augmented and virtual reality devices, binaural speech enhancement algorithms have been established as state-of-the-art techniques to improve speech intelligibility and listening comfort. In this paper, we present an…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-29 Vikas Tokala , Eric Grinstein , Mike Brookes , Simon Doclo , Jesper Jensen , Patrick A. Naylor

Recently, neural machine translation has achieved remarkable progress by introducing well-designed deep neural networks into its encoder-decoder framework. From the optimization perspective, residual connections are adopted to improve…

Computation and Language · Computer Science 2018-07-03 Yanyao Shen , Xu Tan , Di He , Tao Qin , Tie-Yan Liu

Single-channel speech enhancement (SE) is an important task in speech processing. A widely used framework combines an analysis/synthesis filterbank with a mask prediction network, such as the Conv-TasNet architecture. In such systems, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-06 Yuma Koizumi , Shigeki Karita , Scott Wisdom , Hakan Erdogan , John R. Hershey , Llion Jones , Michiel Bacchiani

The human auditory system has the ability to selectively focus on key speech elements in an audio stream while giving secondary attention to less relevant areas such as noise or distortion within the background, dynamically adjusting its…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-09 Nursadul Mamun , John H. L. Hansen

Recent studies have increasingly acknowledged the advantages of incorporating visual data into speech enhancement (SE) systems. In this paper, we introduce a novel audio-visual SE approach, termed DCUC-Net (deep complex U-Net with conformer…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Shafique Ahmed , Chia-Wei Chen , Wenze Ren , Chin-Jou Li , Ernie Chu , Jun-Cheng Chen , Amir Hussain , Hsin-Min Wang , Yu Tsao , Jen-Cheng Hou

Whereas deep neural networks were first mostly used for classification tasks, they are rapidly expanding in the realm of structured output problems, where the observed target is composed of multiple random variables that have a rich joint…

Neural and Evolutionary Computing · Computer Science 2016-11-15 Kyunghyun Cho , Aaron Courville , Yoshua Bengio

2D convolutional neural networks (CNNs) have attracted significant attention for hyperspectral image super-resolution tasks. However, a key limitation is their reliance on local neighborhoods, which leads to a lack of global contextual…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Usman Muhammad , Jorma Laaksonen

Speech enhancement in multichannel settings has been realized by utilizing the spatial information embedded in multiple microphone signals. Moreover, deep neural networks (DNNs) have been recently advanced in this field; however, studies on…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-28 Dongheon Lee , Seongrae Kim , Jung-Woo Choi

Speaker recognition is the process of identifying a speaker based on the voice. The technology has attracted more attention with the recent increase in popularity of smart voice assistants, such as Amazon Alexa. In the past few years,…

Sound · Computer Science 2021-05-21 Haici Yang , Hongda Mao , Ruirui Li , Chelsea J. T. Ju , Oguz Elibol

In recent decades, neural network based methods have significantly improved the performace of speech enhancement. Most of them estimate time-frequency (T-F) representation of target speech directly or indirectly, then resynthesize waveform…

Sound · Computer Science 2020-02-06 Jingdong Li , Hui Zhang , Xueliang Zhang , Changliang Li