中文
相关论文

相关论文: Improved Speech Enhancement with the Wave-U-Net

200 篇论文

Speech enhancement and speech separation are two related tasks, whose purpose is to extract either one or more target speech signals, respectively, from a mixture of sounds generated by several sources. Traditionally, these tasks have been…

音频与语音处理 · 电气工程与系统科学 2021-03-16 Daniel Michelsanti , Zheng-Hua Tan , Shi-Xiong Zhang , Yong Xu , Meng Yu , Dong Yu , Jesper Jensen

Single-channel, speaker-independent speech separation methods have recently seen great progress. However, the accuracy, latency, and computational cost of such methods remain insufficient. The majority of the previous methods have…

声音 · 计算机科学 2019-05-16 Yi Luo , Nima Mesgarani

In this paper, we present a novel multi-channel speech extraction system to simultaneously extract multiple clean individual sources from a mixture in noisy and reverberant environments. The proposed method is built on an improved…

音频与语音处理 · 电气工程与系统科学 2021-06-17 Jisi Zhang , Catalin Zorila , Rama Doddipatla , Jon Barker

Teleconferencing is becoming essential during the COVID-19 pandemic. However, in real-world applications, speech quality can deteriorate due to, for example, background interference, noise, or reverberation. To solve this problem, target…

音频与语音处理 · 电气工程与系统科学 2022-05-02 Yicheng Hsu , Yonghan Lee , Mingsian R. Bai

The rising interest in single-channel multi-speaker speech separation sparked development of End-to-End (E2E) approaches to multi-speaker speech recognition. However, up until now, state-of-the-art neural network-based time domain source…

音频与语音处理 · 电气工程与系统科学 2020-04-14 Thilo von Neumann , Keisuke Kinoshita , Lukas Drude , Christoph Boeddeker , Marc Delcroix , Tomohiro Nakatani , Reinhold Haeb-Umbach

Speech enhancement, particularly denoising, is vital in improving the intelligibility and quality of speech signals for real-world applications, especially in noisy environments. While prior research has introduced various deep learning…

Currently, most speech processing techniques use magnitude spectrograms as front-end and are therefore by default discarding part of the signal: the phase. In order to overcome this limitation, we propose an end-to-end learning method for…

声音 · 计算机科学 2018-02-01 Dario Rethage , Jordi Pons , Xavier Serra

Recently, direct modeling of raw waveforms using deep neural networks has been widely studied for a number of tasks in audio domains. In speaker verification, however, utilization of raw waveforms is in its preliminary phase, requiring…

音频与语音处理 · 电气工程与系统科学 2019-07-18 Jee-weon Jung , Hee-Soo Heo , Ju-ho Kim , Hye-jin Shim , Ha-Jin Yu

Singing Voice Separation (SVS) tries to separate singing voice from a given mixed musical signal. Recently, many U-Net-based models have been proposed for the SVS task, but there were no existing works that evaluate and compare various…

音频与语音处理 · 电气工程与系统科学 2020-10-09 Woosung Choi , Minseok Kim , Jaehwa Chung , Daewon Lee , Soonyoung Jung

Deep learning has become a de facto method of choice for speech enhancement tasks with significant improvements in speech quality. However, real-time processing with reduced size and computations for low-power edge devices drastically…

音频与语音处理 · 电气工程与系统科学 2024-05-28 Monisankha Pal , Arvind Ramanathan , Ted Wada , Ashutosh Pandey

This paper proposes a WaveNet-based neural excitation model (ExcitNet) for statistical parametric speech synthesis systems. Conventional WaveNet-based neural vocoding systems significantly improve the perceptual quality of synthesized…

音频与语音处理 · 电气工程与系统科学 2019-08-23 Eunwoo Song , Kyungguen Byun , Hong-Goo Kang

The objective of deep learning methods based on encoder-decoder architectures for music source separation is to approximate either ideal time-frequency masks or spectral representations of the target music source(s). The spectral…

Our goal is to isolate individual speakers from multi-talker simultaneous speech in videos. Existing works in this area have focussed on trying to separate utterances from known speakers in controlled environments. In this paper, we propose…

计算机视觉与模式识别 · 计算机科学 2018-06-20 Triantafyllos Afouras , Joon Son Chung , Andrew Zisserman

Modern audio source separation techniques rely on optimizing sequence model architectures such as, 1D-CNNs, on mixture recordings to generalize well to unseen mixtures. Specifically, recent focus is on time-domain based architectures such…

Neural multi-channel speech enhancement models, in particular those based on the U-Net architecture, demonstrate promising performance and generalization potential. These models typically encode input channels independently, and integrate…

声音 · 计算机科学 2024-10-08 Ibrahim Aldarmaki , Thamar Solorio , Bhiksha Raj , Hanan Aldarmaki

Recent studies in neural network-based monaural speech separation (SS) have achieved a remarkable success thanks to increasing ability of long sequence modeling. However, they would degrade significantly when put under realistic noisy…

音频与语音处理 · 电气工程与系统科学 2023-02-23 Yuchen Hu , Chen Chen , Heqing Zou , Xionghu Zhong , Eng Siong Chng

The end-to-end approach for single-channel speech separation has been studied recently and shown promising results. This paper extended the previous approach and proposed a new end-to-end model for multi-channel speech separation. The…

声音 · 计算机科学 2019-05-29 Rongzhi Gu , Jian Wu , Shi-Xiong Zhang , Lianwu Chen , Yong Xu , Meng Yu , Dan Su , Yuexian Zou , Dong Yu

Speech separation seeks to isolate individual speech signals from a multi-talk speech mixture. Despite much progress, a system well-trained on synthetic data often experiences performance degradation on out-of-domain data, such as…

声音 · 计算机科学 2025-03-18 Wupeng Wang , Zexu Pan , Jingru Lin , Shuai Wang , Haizhou Li

The presence of multiple talkers in the surrounding environment poses a difficult challenge for real-time speech communication systems considering the constraints on network size and complexity. In this paper, we present Personalized…

音频与语音处理 · 电气工程与系统科学 2021-06-09 Ritwik Giri , Shrikant Venkataramani , Jean-Marc Valin , Umut Isik , Arvindh Krishnaswamy

We consider the problem of audio voice separation for binaural applications, such as earphones and hearing aids. While today's neural networks perform remarkably well (separating $4+$ sources with 2 microphones) they assume a known or fixed…

声音 · 计算机科学 2022-07-18 Zhongweiyang Xu , Romit Roy Choudhury