English
Related papers

Related papers: Frequency-Weighted Training Losses for Phoneme-Lev…

200 papers

Many deep learning-based speech enhancement algorithms are designed to minimize the mean-square error (MSE) in some transform domain between a predicted and a target speech signal. However, optimizing for MSE does not necessarily guarantee…

Sound · Computer Science 2020-01-31 Morten Kolbæk , Zheng-Hua Tan , Søren Holdt Jensen , Jesper Jensen

This paper investigates several aspects of training a RNN (recurrent neural network) that impact the objective and subjective quality of enhanced speech for real-time single-channel speech enhancement. Specifically, we focus on a RNN that…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-14 Yangyang Xia , Sebastian Braun , Chandan K. A. Reddy , Harishchandra Dubey , Ross Cutler , Ivan Tashev

Single-channel speech enhancement with deep neural networks (DNNs) has shown promising performance and is thus intensively being studied. In this paper, instead of applying the mean squared error (MSE) as the loss function during DNN…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-20 Ziyue Zhao , Samy Elshamy , Tim Fingscheidt

Recently, deep neural networks (DNNs) have been successfully used for speech enhancement, and DNN-based speech enhancement is becoming an attractive research area. While time-frequency masking based on the short-time Fourier transform…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-21 Yuichiro Koyama , Tyler Vuong , Stefan Uhlich , Bhiksha Raj

A deep neural network (DNN)-based model has been developed to predict non-parametric distributions of durations of phonemes in specified phonetic contexts and used to explore which factors influence durations most. Major factors in US…

Sound · Computer Science 2019-09-09 Xizi Wei , Melvyn Hunt , Adrian Skilling

Speech enhancement using neural networks is recently receiving large attention in research and being integrated in commercial devices and applications. In this work, we investigate data augmentation techniques for supervised deep…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-25 Sebastian Braun , Ivan Tashev

Time-domain training criteria have proven to be very effective for the separation of single-channel non-reverberant speech mixtures. Likewise, mask-based beamforming has shown impressive performance in multi-channel reverberant speech…

In the intricate acoustic landscapes where speech intelligibility is challenged by noise and reverberation, multichannel speech enhancement emerges as a promising solution for individuals with hearing loss. Such algorithms are commonly…

Sound · Computer Science 2024-01-25 Nasser-Eddine Monir , Paul Magron , Romain Serizel

In this paper, we address the generalization of deep neural network (DNN) based speech enhancement to unseen noise conditions for the case that training data is limited in size and diversity. To gain more insights, we analyze the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-18 Robert Rehr , Timo Gerkmann

Most deep learning-based models for speech enhancement have mainly focused on estimating the magnitude of spectrogram while reusing the phase from noisy speech for reconstruction. This is due to the difficulty of estimating the phase of…

Sound · Computer Science 2019-04-03 Hyeong-Seok Choi , Jang-Hyun Kim , Jaesung Huh , Adrian Kim , Jung-Woo Ha , Kyogu Lee

Conventional speech enhancement technique such as beamforming has known benefits for far-field speech recognition. Our own work in frequency-domain multi-channel acoustic modeling has shown additional improvements by training a spatial…

Sound · Computer Science 2020-02-10 Taejin Park , Kenichi Kumatani , Minhua Wu , Shiva Sundaram

Single-channel speech enhancement approaches do not always improve automatic recognition rates in the presence of noise, because they can introduce distortions unhelpful for recognition. Following a trend towards end-to-end training of…

Sound · Computer Science 2021-12-14 Peter Plantinga , Deblin Bagchi , Eric Fosler-Lussier

Conventional deep neural network (DNN)-based speech enhancement (SE) approaches aim to minimize the mean square error (MSE) between enhanced speech and clean reference. The MSE-optimized model may not directly improve the performance of an…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-13 Yih-Liang Shen , Chao-Yuan Huang , Syu-Siang Wang , Yu Tsao , Hsin-Min Wang , Tai-Shih Chi

Deep learning-based speech enhancement for real-time applications recently made large advancements. Due to the lack of a tractable perceptual optimization target, many myths around training losses emerged, whereas the contribution to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-28 Sebastian Braun , Ivan Tashev

Despite the rapid progress of automatic speech recognition (ASR) technologies targeting normal speech in recent decades, accurate recognition of dysarthric and elderly speech remains highly challenging tasks to date. Sources of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-18 Mengzhe Geng , Xurong Xie , Zi Ye , Tianzi Wang , Guinan Li , Shujie Hu , Xunying Liu , Helen Meng

Recent work in the field of speech enhancement (SE) has involved the use of self-supervised speech representations (SSSRs) as feature transformations in loss functions. However, in prior work, very little attention has been paid to the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-23 George Close , Thomas Hain , Stefan Goetze

We describe a modulation-domain loss function for deep-learning-based speech enhancement systems. Learnable spectro-temporal receptive fields (STRFs) were adapted to optimize for a speaker identification task. The learned STRFs were then…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Tyler Vuong , Yangyang Xia , Richard M. Stern

Modern neural speech enhancement models usually include various forms of phase information in their training loss terms, either explicitly or implicitly. However, these loss terms are typically designed to reduce the distortion of phase…

Sound · Computer Science 2022-02-25 Doyeon Kim , Hyewon Han , Hyeon-Kyeong Shin , Soo-Whan Chung , Hong-Goo Kang

This study proposes a fully convolutional network (FCN) model for raw waveform-based speech enhancement. The proposed system performs speech enhancement in an end-to-end (i.e., waveform-in and waveform-out) manner, which dif-fers from most…

Machine Learning · Statistics 2017-06-16 Szu-Wei Fu , Yu Tsao , Xugang Lu , Hisashi Kawai

In this paper, we propose to extend the deep, complex U-Network architecture for speech enhancement by incorporating a probabilistic (i.e., variational) latent space model. The proposed model is evaluated against several ablated versions of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Eike J. Nustede , Jörn Anemüller
‹ Prev 1 2 3 10 Next ›