English
Related papers

Related papers: On The Compensation Between Magnitude and Phase in…

200 papers

We propose a speech enhancement method using a causal deep neural network~(DNN) for real-time applications. DNN has been widely used for estimating a time-frequency~(T-F) mask which enhances a speech signal. One popular DNN structure for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Daiki Takeuchi , Kohei Yatabe , Yuma Koizumi , Yasuhiro Oikawa , Noboru Harada

Machine learning techniques are an active area of research for speech enhancement for hearing aids, with one particular focus on improving the intelligibility of a noisy speech signal. Recent work has shown that feature encodings from…

Sound · Computer Science 2024-07-19 Robert Sutherland , George Close , Thomas Hain , Stefan Goetze , Jon Barker

In this paper, we present a novel diffusion model-based monaural speech enhancement method. Our approach incorporates the separate estimation of speech spectra's magnitude and phase in two diffusion networks. Throughout the diffusion…

Sound · Computer Science 2024-12-13 Yi Li , Yang Sun , Plamen Angelov

Speech recognition systems have improved dramatically over the last few years, however, their performance is significantly degraded for the cases of accented or impaired speech. This work explores domain adversarial neural networks (DANN)…

Sound · Computer Science 2020-10-09 Dominika Woszczyk , Stavros Petridis , David Millard

Recent neural network strategies for source separation attempt to model audio signals by processing their waveforms directly. Mean squared error (MSE) that measures the Euclidean distance between waveforms of denoised speech and the…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-05 Shrikant Venkataramani , Ryley Higa , Paris Smaragdis

Audio-visual target speech extraction, which aims to extract a certain speaker's speech from the noisy mixture by looking at lip movements, has made significant progress combining time-domain speech separation models and visual feature…

Multimedia · Computer Science 2023-03-07 Zhongweiyang Xu , Xulin Fan , Mark Hasegawa-Johnson

Automatic speech recognition (ASR) in multimedia content is one of the promising applications, but speech data in this kind of content are frequently mixed with background music, which is harmful for the performance of ASR. In this study,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Jeongwoo Woo , Masato Mimura , Kazuyoshi Yoshii , Tatsuya Kawahara

Monaural speech enhancement has achieved remarkable progress recently. However, its performance has been constrained by the limited spatial cues available at a single microphone. To overcome this limitation, we introduce a strategy to map…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-05 Xinmeng Xu , Yuhong Yang , Weiping Tu

Conventional deep neural network (DNN)-based speech enhancement (SE) approaches aim to minimize the mean square error (MSE) between enhanced speech and clean reference. The MSE-optimized model may not directly improve the performance of an…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-13 Yih-Liang Shen , Chao-Yuan Huang , Syu-Siang Wang , Yu Tsao , Hsin-Min Wang , Tai-Shih Chi

Although the conventional mask-based minimum variance distortionless response (MVDR) could reduce the non-linear distortion, the residual noise level of the MVDR separated speech is still high. In this paper, we propose a spatio-temporal…

Sound · Computer Science 2021-04-06 Yong Xu , Zhuohuang Zhang , Meng Yu , Shi-Xiong Zhang , Dong Yu

Recent progress in audio source separation lead by deep learning has enabled many neural network models to provide robust solutions to this fundamental estimation problem. In this study, we provide a family of efficient neural network…

Sound · Computer Science 2022-02-01 Efthymios Tzinis , Zhepei Wang , Xilin Jiang , Paris Smaragdis

The task of estimating the maximum number of concurrent speakers from single channel mixtures is important for various audio-based applications, such as blind source separation, speaker diarisation, audio surveillance or auditory scene…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-05 Fabian-Robert Stöter , Soumitro Chakrabarty , Bernd Edler , Emanuël A. P. Habets

Recently, Convolutional Neural Network (CNN) and Long short-term memory (LSTM) based models have been introduced to deep learning-based target speaker separation. In this paper, we propose an Attention-based neural network (Atss-Net) in the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 Tingle Li , Qingjian Lin , Yuanyuan Bao , Ming Li

We present a hybrid framework that leverages the trade-off between temporal and frequency precision in audio representations to improve the performance of speech enhancement task. We first show that conventional approaches using specific…

Audio and Speech Processing · Electrical Eng. & Systems 2018-12-24 Jang-Hyun Kim , Jaejun Yoo , Sanghyuk Chun , Adrian Kim , Jung-Woo Ha

Recurrent neural networks (RNNs) are a powerful model for sequential data. End-to-end training methods such as Connectionist Temporal Classification make it possible to train RNNs for sequence labelling problems where the input-output…

Neural and Evolutionary Computing · Computer Science 2013-03-26 Alex Graves , Abdel-rahman Mohamed , Geoffrey Hinton

Deep learning has achieved substantial improvement on single-channel speech enhancement tasks. However, the performance of multi-layer perceptions (MLPs)-based methods is limited by the ability to capture the long-term effective history…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Qiquan Zhang , Aaron Nicolson , Mingjiang Wang , Kuldip K. Paliwal , Chenxu Wang

Supervised speech separation uses supervised learning algorithms to learn a mapping from an input noisy signal to an output target. With the fast development of deep learning, supervised separation has become the most important direction in…

Sound · Computer Science 2017-09-05 Shasha Xia , Hao Li , Xueliang Zhang

It remains a tough challenge to recover the speech signals contaminated by various noises under real acoustic environments. To this end, we propose a novel system for denoising in the complicated applications, which is mainly comprised of…

Sound · Computer Science 2021-03-02 Andong Li , Wenzhe Liu , Xiaoxue Luo , Chengshi Zheng , Xiaodong Li

The effect of hearing impairment on speech perception was described by Plomp (1978) as a sum of a loss of class A, due to signal attenuation, and a loss of class D, due to signal distortion. While a loss of class A can be compensated by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-25 Marc René Schädler

Models for audio source separation usually operate on the magnitude spectrum, which ignores phase information and makes separation performance dependant on hyper-parameters for the spectral front-end. Therefore, we investigate end-to-end…

Sound · Computer Science 2018-06-11 Daniel Stoller , Sebastian Ewert , Simon Dixon