English
Related papers

Related papers: DPDFNet: Boosting DeepFilterNet2 via Dual-Path RNN

200 papers

In this paper, we propose a multi-channel network for simultaneous speech dereverberation, enhancement and separation (DESNet). To enable gradient propagation and joint optimization, we adopt the attentional selection mechanism of the…

Sound · Computer Science 2020-11-17 Yihui Fu , Jian Wu , Yanxin Hu , Mengtao Xing , Lei Xie

Classical speech coding uses low-complexity postfilters with zero lookahead to enhance the quality of coded speech, but their effectiveness is limited by their simplicity. Deep Neural Networks (DNNs) can be much more effective, but require…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-14 Jan Büthe , Jean-Marc Valin , Ahmed Mustafa

Most deep learning-based multi-channel speech enhancement methods focus on designing a set of beamforming coefficients to directly filter the low signal-to-noise ratio signals received by microphones, which hinders the performance of these…

Sound · Computer Science 2022-02-08 Wenzhe Liu , Andong Li , Chengshi Zheng , Xiaodong Li

Noisy situations cause huge problems for suffers of hearing loss as hearing aids often make the signal more audible but do not always restore the intelligibility. In noisy settings, humans routinely exploit the audio-visual (AV) nature of…

Sound · Computer Science 2019-09-24 Mandar Gogate , Kia Dashtipour , Ahsan Adeel , Amir Hussain

In this paper, we propose to extend the deep, complex U-Network architecture for speech enhancement by incorporating a probabilistic (i.e., variational) latent space model. The proposed model is evaluated against several ablated versions of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Eike J. Nustede , Jörn Anemüller

Low-complexity speech enhancement on mobile phones is crucial in the era of 5G. Thus, focusing on handheld mobile phone communication scenario, based on power level difference (PLD) algorithm and lightweight U-Net, we propose PLD-guided…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-07 Nan Zhou , Youhai Jiang , Jialin Tan , Chongmin Qi

Acoustic beamformers have been widely used to enhance audio signals. Currently, the best methods are the deep neural network (DNN)-powered variants of the generalized eigenvalue and minimum-variance distortionless response beamformers and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-12 Yuichiro Koyama , Bhiksha Raj

In this paper, we present a method that allows to further improve speech enhancement obtained with recently introduced Deep Neural Network (DNN) models. We propose a multi-channel refinement method of time-frequency masks obtained with…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-19 Julitta Bartolewska , Stanisław Kacprzak , Konrad Kowalczyk

Recurrent neural networks (RNNs) have shown significant improvements in recent years for speech enhancement. However, the model complexity and inference time cost of RNNs are much higher than deep feed-forward neural networks (DNNs).…

Sound · Computer Science 2020-11-12 Cunhang Fan , Bin Liu , Jianhua Tao , Jiangyan Yi , Zhengqi Wen , Leichao Song

In the intricate acoustic landscapes where speech intelligibility is challenged by noise and reverberation, multichannel speech enhancement emerges as a promising solution for individuals with hearing loss. Such algorithms are commonly…

Sound · Computer Science 2024-01-25 Nasser-Eddine Monir , Paul Magron , Romain Serizel

The key advantage of using multiple microphones for speech enhancement is that spatial filtering can be used to complement the tempo-spectral processing. In a traditional setting, linear spatial filtering (beamforming) and single-channel…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-18 Kristina Tesch , Timo Gerkmann

The prosperity of deep learning contributes to the rapid progress in scene text detection. Among all the methods with convolutional networks, segmentation-based ones have drawn extensive attention due to their superiority in detecting text…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Jingyu Lin , Jie Jiang , Yan Yan , Chunchao Guo , Hongfa Wang , Wei Liu , Hanzi Wang

This paper proposes a deep speech enhancement method which exploits the high potential of residual connections in a wide neural network architecture, a topology known as Wide Residual Network. This is supported on single dimensional…

Sound · Computer Science 2019-01-04 Dayana Ribas , Jorge Llombart , Antonio Miguel , Luis Vicente

This paper proposes a full-band and sub-band fusion model, named as FullSubNet, for single-channel real-time speech enhancement. Full-band and sub-band refer to the models that input full-band and sub-band noisy spectral feature, output…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-04 Xiang Hao , Xiangdong Su , Radu Horaud , Xiaofei Li

Recent advancements in speaker verification techniques show promise, but their performance often deteriorates significantly in challenging acoustic environments. Although speech enhancement methods can improve perceived audio quality, they…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-27 Adam Katav , Yair Moshe , Israel Cohen

In multi-speaker applications is common to have pre-computed models from enrolled speakers. Using these models to identify the instances in which these speakers intervene in a recording is the task of speaker tracking. In this paper, we…

While machine learning techniques are traditionally resource intensive, we are currently witnessing an increased interest in hardware and energy efficient approaches. This need for resource-efficient machine learning is primarily driven by…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-23 Lukas Pfeifenberger , Matthias Zöhrer , Günther Schindler , Wolfgang Roth , Holger Fröning , Franz Pernkopf

Speech denoising (SD) is an important task of many, if not all, modern signal processing chains used in devices and for everyday-life applications. While there are many published and powerful deep neural network (DNN)-based methods for SD,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-08 Konstantinos Drossos , Mikko Heikkinen , Paschalis Tsiaflakis

The paper introduces Diff-Filter, a multichannel speech enhancement approach based on the diffusion probabilistic model, for improving speaker verification performance under noisy and reverberant conditions. It also presents a new two-step…

Sound · Computer Science 2023-07-06 Sandipana Dowerah , Ajinkya Kulkarni , Romain Serizel , Denis Jouvet

This paper describes our submission to the L3DAS22 Challenge Task 1, which consists of speech enhancement with 3D Ambisonic microphones. The core of our approach combines Deep Neural Network (DNN) driven complex spectral mapping with linear…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-25 Yen-Ju Lu , Samuele Cornell , Xuankai Chang , Wangyou Zhang , Chenda Li , Zhaoheng Ni , Zhong-Qiu Wang , Shinji Watanabe