中文
相关论文

相关论文: End-to-End Speech Separation with Unfolded Iterati…

200 篇论文

Supervised learning based on a deep neural network recently has achieved substantial improvement on speech enhancement. Denoising networks learn mapping from noisy speech to clean one directly, or to a spectrum mask which is the ratio…

声音 · 计算机科学 2023-03-10 Jaeyoung Kim , Mostafa El-Khamy , Jungwon Lee

Audio-visual speech separation aims to isolate each speaker's clean voice from mixtures by leveraging visual cues such as lip movements and facial features. While visual information provides complementary semantic guidance, existing methods…

声音 · 计算机科学 2025-10-13 Ke Xue , Rongfei Fan , Lixin , Dawei Zhao , Chao Zhu , Han Hu

Hand-crafted spatial features (e.g., inter-channel phase difference, IPD) play a fundamental role in recent deep learning based multi-channel speech separation (MCSS) methods. However, these manually designed spatial features are hard to…

音频与语音处理 · 电气工程与系统科学 2020-03-16 Rongzhi Gu , Shi-Xiong Zhang , Lianwu Chen , Yong Xu , Meng Yu , Dan Su , Yuexian Zou , Dong Yu

The SpeakerBeam-FE (SBF) method is proposed for speaker extraction. It attempts to overcome the problem of unknown number of speakers in an audio recording during source separation. The mask approximation loss of SBF is sub-optimal, which…

音频与语音处理 · 电气工程与系统科学 2019-03-26 Chenglin Xu , Wei Rao , Eng Siong Chng , Haizhou Li

In a multi-channel separation task with multiple speakers, we aim to recover all individual speech signals from the mixture. In contrast to single-channel approaches, which rely on the different spectro-temporal characteristics of the…

音频与语音处理 · 电气工程与系统科学 2024-01-11 Kristina Tesch , Timo Gerkmann

In this paper, we propose a novel recurrent neural network architecture for speech separation. This architecture is constructed by unfolding the iterations of a sequential iterative soft-thresholding algorithm (ISTA) that solves the…

声音 · 计算机科学 2017-09-22 Scott Wisdom , Thomas Powers , James Pitton , Les Atlas

Vocal dereverberation remains a challenging task in audio processing, particularly for real-time applications where both accuracy and efficiency are crucial. Traditional deep learning approaches often struggle to suppress reverberation…

声音 · 计算机科学 2025-10-02 Daniel G. Williams

The crux of single-channel speech separation is how to encode the mixture of signals into such a latent embedding space that the signals from different speakers can be precisely separated. Existing methods for speech separation either…

音频与语音处理 · 电气工程与系统科学 2022-02-01 Zengwei Yao , Wenjie Pei , Fanglin Chen , Guangming Lu , David Zhang

Recently, deep neural networks (DNNs) have been successfully used for speech enhancement, and DNN-based speech enhancement is becoming an attractive research area. While time-frequency masking based on the short-time Fourier transform…

音频与语音处理 · 电气工程与系统科学 2020-08-21 Yuichiro Koyama , Tyler Vuong , Stefan Uhlich , Bhiksha Raj

Speech separation involves extracting an individual speaker's voice from a multi-speaker audio signal. The increasing complexity of real-world environments, where multiple speakers might converse simultaneously, underscores the importance…

音频与语音处理 · 电气工程与系统科学 2024-01-09 Renana Opochinsky , Mordehay Moradi , Sharon Gannot

This paper proposes a neural network based speech separation method using spatially distributed microphones. Unlike with traditional microphone array settings, neither the number of microphones nor their spatial arrangement is known in…

音频与语音处理 · 电气工程与系统科学 2020-05-01 Dongmei Wang , Zhuo Chen , Takuya Yoshioka

Deep learning based speech enhancement in the short-time Fourier transform (STFT) domain typically uses a large window length such as 32 ms. A larger window can lead to higher frequency resolution and potentially better enhancement. This…

声音 · 计算机科学 2022-12-07 Zhong-Qiu Wang , Gordon Wichern , Shinji Watanabe , Jonathan Le Roux

This paper addresses the problem of multi-channel multi-speech separation based on deep learning techniques. In the short time Fourier transform domain, we propose an end-to-end narrow-band network that directly takes as input the…

声音 · 计算机科学 2022-04-13 Changsheng Quan , Xiaofei Li

Multi-speaker speech recognition has been one of the keychallenges in conversation transcription as it breaks the singleactive speaker assumption employed by most state-of-the-artspeech recognition systems. Speech separation is consideredas…

音频与语音处理 · 电气工程与系统科学 2020-09-08 Jian Wu , Zhuo Chen , Jinyu Li , Takuya Yoshioka , Zhili Tan , Ed Lin , Yi Luo , Lei Xie

Deep gated convolutional networks have been proved to be very effective in single channel speech separation. However current state-of-the-art framework often considers training the gated convolutional networks in time-frequency (TF) domain.…

声音 · 计算机科学 2019-03-19 Ziqiang Shi , Huibin Lin , Liu Liu , Rujie Liu , Shoji Hayakawa , Shouji Harada , Jiqing Han

Short-time Fourier transform (STFT) is used as the front end of many popular successful monaural speech separation methods, such as deep clustering (DPCL), permutation invariant training (PIT) and their various variants. Since the frequency…

声音 · 计算机科学 2019-02-05 Ziqiang Shi , Huibin Lin , Liu Liu , Rujie Liu , Jiqing Han

This work proposes a multichannel narrow-band speech separation network. In the short-time Fourier transform (STFT) domain, the proposed network processes each frequency independently, and all frequencies use a shared network. For each…

声音 · 计算机科学 2022-12-06 Changsheng Quan , Xiaofei Li

Separating competing speech in reverberant environments requires models that preserve spatial cues while maintaining separation efficiency. We present a Phase-aware Ear-conditioned speaker Separation network using eight microphones…

音频与语音处理 · 电气工程与系统科学 2025-10-14 Ruben Johnson Robert Jeremiah , Peyman Goli , Steven van de Par

We study the use of the Wave-U-Net architecture for speech enhancement, a model introduced by Stoller et al for the separation of music vocals and accompaniment. This end-to-end learning method for audio source separation operates directly…

声音 · 计算机科学 2018-11-29 Craig Macartney , Tillman Weyde

The objective of deep learning methods based on encoder-decoder architectures for music source separation is to approximate either ideal time-frequency masks or spectral representations of the target music source(s). The spectral…