English
Related papers

Related papers: Unsupervised Low Latency Speech Enhancement with R…

200 papers

It is highly desirable that speech enhancement algorithms can achieve good performance while keeping low latency for many applications, such as digital hearing aids, acoustically transparent hearing devices, and public address systems. To…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-01 Chengshi Zheng , Wenzhe Liu , Andong Li , Yuxuan Ke , Xiaodong Li

Speech recognition system performance degrades in noisy environments. If the acoustic models are built using features of clean utterances, the features of a noisy test utterance would be acoustically mismatched with the trained model. This…

Computation and Language · Computer Science 2015-07-16 D. S. Pavan Kumar

Ensuring intelligible speech communication for hearing assistive devices in low-latency scenarios presents significant challenges in terms of speech enhancement, coding and transmission. In this paper, we propose novel solutions for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-01 Mohammad Bokaei , Jesper Jensen , Simon Doclo , Jan Østergaard

Recently, deep neural network (DNN) based time-frequency (T-F) mask estimation has shown remarkable effectiveness for speech enhancement. Typically, a single T-F mask is first estimated based on DNN and then used to mask the spectrogram of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-29 Liangchen Zhou , Wenbin Jiang , Jingyan Xu , Fei Wen , Peilin Liu

We propose FSB-LSTM, a novel long short-term memory (LSTM) based architecture that integrates full- and sub-band (FSB) modeling, for single- and multi-channel speech enhancement in the short-time Fourier transform (STFT) domain. The model…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-19 Zhong-Qiu Wang , Samuele Cornell , Shukjae Choi , Younglo Lee , Byeong-Yeol Kim , Shinji Watanabe

Enhancing noisy speech is an important task to restore its quality and to improve its intelligibility. In traditional non-machine-learning (ML) based approaches the parameters required for noise reduction are estimated blindly from the…

Sound · Computer Science 2018-01-16 Robert Rehr , Timo Gerkmann

Speech enhancement in hearing aids is a challenging task since the hardware limits the number of possible operations and the latency needs to be in the range of only a few milliseconds. We propose a deep-learning model compatible with these…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-19 Nils L. Westhausen , Bernd T. Meyer

Nonnegative Matrix Factorization (NMF) is a widely used technique in many applications such as face recognition, motion segmentation, etc. It approximates the nonnegative data in an original high dimensional space with a linear…

Machine Learning · Computer Science 2012-04-12 Bin Shen , Luo Si , Rongrong Ji , Baodi Liu

Deep learning based speech enhancement in the short-time Fourier transform (STFT) domain typically uses a large window length such as 32 ms. A larger window can lead to higher frequency resolution and potentially better enhancement. This…

Sound · Computer Science 2022-12-07 Zhong-Qiu Wang , Gordon Wichern , Shinji Watanabe , Jonathan Le Roux

Although supervised learning based on a deep neural network has recently achieved substantial improvement on speech enhancement, the existing schemes have either of two critical issues: spectrum or metric mismatches. The spectrum mismatch…

Sound · Computer Science 2020-05-12 Jaeyoung Kim , Mostafa El-Khamy , Jungwon Lee

Multi-channel speech enhancement aims to extract clean speech from a noisy mixture using signals captured from multiple microphones. Recently proposed methods tackle this problem by incorporating deep neural network models with spatial…

Sound · Computer Science 2021-02-16 Panagiotis Tzirakis , Anurag Kumar , Jacob Donley

This work proposes a multichannel narrow-band speech separation network. In the short-time Fourier transform (STFT) domain, the proposed network processes each frequency independently, and all frequencies use a shared network. For each…

Sound · Computer Science 2022-12-06 Changsheng Quan , Xiaofei Li

Supervised learning based on a deep neural network recently has achieved substantial improvement on speech enhancement. Denoising networks learn mapping from noisy speech to clean one directly, or to a spectrum mask which is the ratio…

Sound · Computer Science 2023-03-10 Jaeyoung Kim , Mostafa El-Khamy , Jungwon Lee

A novel non-negative matrix factorization (NMF) based subband decomposition in frequency spatial domain for acoustic source localization using a microphone array is introduced. The proposed method decomposes source and noise subband and…

Sound · Computer Science 2016-10-18 Suwon Shon , Seongkyu Mun , David Han , Hanseok Ko

Distributed microphone arrays composed of multiple subarrays enable blind source separation over a wide spatial area. Directly applying fast multichannel nonnegative matrix factorization (FastMNMF) to all subarrays can exploit observations…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-20 Hirotaka Nishikori , Nobutaka Ito , Kouei Yamaoka , Norihiro Takamune , Hiroshi Saruwatari

This paper describes heavy-tailed extensions of a state-of-the-art versatile blind source separation method called fast multichannel nonnegative matrix factorization (FastMNMF) from a unified point of view. The common way of deriving such…

Sound · Computer Science 2022-05-12 Mathieu Fontaine , Kouhei Sekiguchi , Aditya Nugraha , Yoshiaki Bando , Kazuyoshi Yoshii

In recent years, deep networks have led to dramatic improvements in speech enhancement by framing it as a data-driven pattern recognition problem. In many modern enhancement systems, large amounts of data are used to train a deep network to…

Usually, hearing impaired people use hearing aids which are implemented with speech enhancement algorithms. Estimation of speech and estimation of nose are the components in single channel speech enhancement system. The main objective of…

Sound · Computer Science 2014-11-10 M. Ravichandra Kumar , B. Ravi Teja

This paper addresses unsupervised diffusion-based single-channel speech enhancement (SE). Prior work in this direction combines a score-based diffusion model trained on clean speech with a Gaussian noise model whose covariance is structured…

Sound · Computer Science 2026-05-26 Jean-Eudes Ayilo , Mostafa Sadeghi , Romain Serizel , Xavier Alameda-Pineda

Time-frequency masking or spectrum prediction computed via short symmetric windows are commonly used in low-latency deep neural network (DNN) based source separation. In this paper, we propose the usage of an asymmetric analysis-synthesis…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-23 Shanshan Wang , Gaurav Naithani , Archontis Politis , Tuomas Virtanen