English
Related papers

Related papers: Speech Enhancement with Perceptually-motivated Opt…

200 papers

Consonant and vowel reduction are often encountered in speech, which might cause performance degradation in automatic speech recognition (ASR). Our recently proposed learning strategy based on masking, Phone Masking Training (PMT),…

Sound · Computer Science 2022-07-05 Guodong Ma , Pengfei Hu , Nurmemet Yolwas , Shen Huang , Hao Huang

Many deep learning-based speech enhancement algorithms are designed to minimize the mean-square error (MSE) in some transform domain between a predicted and a target speech signal. However, optimizing for MSE does not necessarily guarantee…

Sound · Computer Science 2020-01-31 Morten Kolbæk , Zheng-Hua Tan , Søren Holdt Jensen , Jesper Jensen

Recent studies have demonstrated that incorporating auxiliary information, such as speaker voiceprint or visual cues, can substantially improve Speech Enhancement (SE) performance. However, single-channel methods often yield suboptimal…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-06 Chihyun Liu , Jiaxuan Fan , Mingtung Sun , Michael Anthony , Mingsian R. Bai , Yu Tsao

Generative models have excelled in audio tasks using approaches such as language models, diffusion, and flow matching. However, existing generative approaches for speech enhancement (SE) face notable challenges: language model-based methods…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Ziqian Wang , Zikai Liu , Xinfa Zhu , Yike Zhu , Mingshuai Liu , Jun Chen , Longshuai Xiao , Chao Weng , Lei Xie

Recently, more and more personalized speech enhancement systems (PSE) with excellent performance have been proposed. However, two critical issues still limit the performance and generalization ability of the model: 1) Acoustic environment…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-23 Xiaofeng Ge , Jiangyu Han , Haixin Guan , Yanhua Long

Diffusion models have recently set new benchmarks in Speech Enhancement (SE). However, most existing score-based models treat speech spectrograms merely as generic 2D images, applying uniform processing that ignores the intrinsic structural…

Sound · Computer Science 2026-02-03 Ke Xue , Rongfei Fan , Kai Li , Shanping Yu , Puning Zhao , Jianping An

In this paper, a two-stage dual tree complex wavelet packet transform (DTCWPT) based speech enhancement algorithm has been proposed, in which a speech presence probability (SPP) estimator and a generalized minimum mean squared error (MMSE)…

Sound · Computer Science 2017-04-05 Pengfei Sun , Jun Qin

The goal in speech enhancement is to obtain an estimate of clean speech starting from the noisy signal by minimizing a chosen distortion measure, which results in an estimate that depends on the unknown clean signal or its statistics. Since…

Audio and Speech Processing · Electrical Eng. & Systems 2017-10-12 Jishnu Sadasivan , Chandra Sekhar Seelamantula , Nagarjuna Reddy Muraka

Speech-related applications deliver inferior performance in complex noise environments. Therefore, this study primarily addresses this problem by introducing speech-enhancement (SE) systems based on deep neural networks (DNNs) applied to a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-26 Syu-Siang Wang , Yu-You Liang , Jeih-weih Hung , Yu Tsao , Hsin-Min Wang , Shih-Hau Fang

STOI-optimal masking has been previously proposed and developed for single-channel speech enhancement. In this paper, we consider the extension to the task of binaural speech enhancement in which spatial information is known to be important…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-03 Vikas Tokala , Mike Brookes , Patrick A. Naylor

Current speech enhancement (SE) research has largely neglected channel attention and spatial attention, and encoder-decoder architecture-based networks have not adequately considered how to provide efficient inputs to the intermediate…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-12 Junyu Wang

With recent advances of diffusion model, generative speech enhancement (SE) has attracted a surge of research interest due to its great potential for unseen testing noises. However, existing efforts mainly focus on inherent properties of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Yuchen Hu , Chen Chen , Ruizhe Li , Qiushi Zhu , Eng Siong Chng

Most current speech enhancement (SE) methods recover clean speech from noisy inputs by directly estimating time-frequency masks or spectrums. However, these approaches often neglect the distinct attributes, such as semantic content and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Yang Xiang , Canan Huang , Desheng Hu , Jingguang Tian , Xinhui Hu , Chao Zhang

Attention mechanism has been widely utilized in speech enhancement (SE) because theoretically it can effectively model the inherent connection of signal both in time domain and spectrum domain. Usually, the span of attention is limited in…

Sound · Computer Science 2023-02-14 Zhongshu Hou , Qinwen Hu , Kai Chen , Jing Lu

This paper proposes an noise type classification aided attention-based neural network approach for monaural speech enhancement. The network is constructed based on a previous work by introducing a noise classification subnetwork into the…

Sound · Computer Science 2021-06-01 Lu Ma , Song Yang , Yaguang Gong , Zhongqin Wu

In this study, we present an approach to train a single speech enhancement network that can perform both personalized and non-personalized speech enhancement. This is achieved by incorporating a frame-wise conditioning input that specifies…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-24 Zhepei Wang , Ritwik Giri , Devansh Shah , Jean-Marc Valin , Michael M. Goodwin , Paris Smaragdis

Curriculum learning begins to thrive in the speech enhancement area, which decouples the original spectrum estimation task into multiple easier sub-tasks to achieve better performance. Motivated by that, we propose a dual-branch…

Sound · Computer Science 2022-02-15 Guochen Yu , Andong Li , Chengshi Zheng , Yinuo Guo , Yutian Wang , Hui Wang

There is a surge in interest in self-supervised learning approaches for end-to-end speech encoding in recent years as they have achieved great success. Especially, WavLM showed state-of-the-art performance on various speech processing…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-21 Hyungchan Song , Sanyuan Chen , Zhuo Chen , Yu Wu , Takuya Yoshioka , Min Tang , Jong Won Shin , Shujie Liu

With fewer feature dimensions, filter banks are often used in light-weight full-band speech enhancement models. In order to further enhance the coarse speech in the sub-band domain, it is necessary to apply a post-filtering for harmonic…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Xiaohuai Le , Tong Lei , Li Chen , Yiqing Guo , Chao He , Cheng Chen , Xianjun Xia , Hua Gao , Yijian Xiao , Piao Ding , Shenyi Song , Jing Lu

Speech enhancement employing deep neural networks (DNNs) for denoising are called deep noise suppression (DNS). During training, DNS methods are typically trained with mean squared error (MSE) type loss functions, which do not guarantee…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-09 Ziyi Xu , Maximilian Strake , Tim Fingscheidt