中文
相关论文

相关论文: Real-time Stereo Speech Enhancement with Spatial-C…

200 篇论文

Multichannel speech enhancement is widely used as a front-end in microphone array processing systems. While most existing approaches produce a single enhanced signal, direction-preserving multiple-input multiple-output (MIMO) methods…

音频与语音处理 · 电气工程与系统科学 2026-04-14 Thomas Deppisch

In this work, we address the challenge of encoding speech captured by a microphone array using deep learning techniques with the aim of preserving and accurately reconstructing crucial spatial cues embedded in multi-channel recordings. We…

声音 · 计算机科学 2024-07-10 Zhongweiyang Xu , Yong Xu , Vinay Kothapally , Heming Wang , Muqiao Yang , Dong Yu

Speech separation seeks to isolate individual speech signals from a multi-talk speech mixture. Despite much progress, a system well-trained on synthetic data often experiences performance degradation on out-of-domain data, such as…

声音 · 计算机科学 2025-03-18 Wupeng Wang , Zexu Pan , Jingru Lin , Shuai Wang , Haizhou Li

Hand-crafted spatial features (e.g., inter-channel phase difference, IPD) play a fundamental role in recent deep learning based multi-channel speech separation (MCSS) methods. However, these manually designed spatial features are hard to…

音频与语音处理 · 电气工程与系统科学 2020-03-16 Rongzhi Gu , Shi-Xiong Zhang , Lianwu Chen , Yong Xu , Meng Yu , Dan Su , Yuexian Zou , Dong Yu

This paper introduces a practical approach for leveraging a real-time deep learning model to alternate between speech enhancement and joint speech enhancement and separation depending on whether the input mixture contains one or two active…

音频与语音处理 · 电气工程与系统科学 2023-10-17 Kashyap Patel , Anton Kovalyov , Issa Panahi

In recent years, deep learning-based approaches have significantly improved the performance of single-channel speech enhancement. However, due to the limitation of training data and computational complexity, real-time enhancement of…

音频与语音处理 · 电气工程与系统科学 2022-03-16 Zehua Zhang , Lu Zhang , Xuyi Zhuang , Yukun Qian , Heng Li , Mingjiang Wang

We consider the problem of separating speech sources captured by multiple spatially separated devices, each of which has multiple microphones and samples its signals at a slightly different rate. Most asynchronous array processing methods…

音频与语音处理 · 电气工程与系统科学 2019-12-12 Ryan M. Corey , Andrew C. Singer

Speech separation refers to extracting each individual speech source in a given mixed signal. Recent advancements in speech separation and ongoing research in this area, have made these approaches as promising techniques for pre-processing…

机器学习 · 计算机科学 2019-12-18 Fahimeh Bahmaninezhad , Shi-Xiong Zhang , Yong Xu , Meng Yu , John H. L. Hansen , Dong Yu

Separating an audio scene into isolated sources is a fundamental problem in computer audition, analogous to image segmentation in visual scene analysis. Source separation systems based on deep learning are currently the most successful…

声音 · 计算机科学 2018-11-07 Prem Seetharaman , Gordon Wichern , Jonathan Le Roux , Bryan Pardo

Speech separation has been shown effective for multi-talker speech recognition. Under the ad hoc microphone array setup where the array consists of spatially distributed asynchronous microphones, additional challenges must be overcome as…

声音 · 计算机科学 2021-03-04 Dongmei Wang , Takuya Yoshioka , Zhuo Chen , Xiaofei Wang , Tianyan Zhou , Zhong Meng

In this paper, we propose a speech enhancement method us ing dual-path Multi-Channel Linear Prediction (MCLP) filters and multi-norm beamforming. Specifically, the MCLP part in the proposed method is designed with dual-path filters in both…

音频与语音处理 · 电气工程与系统科学 2025-07-25 Chengyuan Qin , Wenmeng Xiong , Jing Zhou , Maoshen Jia , Changchun Bao

Recently, speech enhancement technologies that are based on deep learning have received considerable research attention. If the spatial information in microphone signals is exploited, microphone arrays can be advantageous under some adverse…

音频与语音处理 · 电气工程与系统科学 2022-07-19 Yicheng Hsu , Yonghan Lee , Mingsian R. Bai

When using artificial neural networks for multichannel speech enhancement, filtering is often achieved by estimating a complex-valued mask that is applied to all or one reference channel of the input signal. The estimation of this mask is…

音频与语音处理 · 电气工程与系统科学 2024-06-18 Annika Briegleb , Walter Kellermann

Recently, deep learning-based beamforming algorithms have shown promising performance in target speech extraction tasks. However, most systems do not fully utilize spatial information. In this paper, we propose a target speech extraction…

声音 · 计算机科学 2023-06-29 Aoqi Guo , Junnan Wu , Peng Gao , Wenbo Zhu , Qinwen Guo , Dazhi Gao , Yujun Wang

Current multi-channel speech enhancement systems mainly adopt single-output architecture, which face significant challenges in preserving spatio-temporal signal integrity during multiple-input multiple-output (MIMO) processing. To address…

音频与语音处理 · 电气工程与系统科学 2025-06-30 Lu Han , Junqi Zhao , Renhua Peng

In this contribution, we present a novel online approach to multichannel speech enhancement. The proposed method estimates the enhanced signal through a filter-and-sum framework. More specifically, complex-valued masks are estimated by a…

音频与语音处理 · 电气工程与系统科学 2021-08-09 Mhd Modar Halimeh , Walter Kellermann

The key advantage of using multiple microphones for speech enhancement is that spatial filtering can be used to complement the tempo-spectral processing. In a traditional setting, linear spatial filtering (beamforming) and single-channel…

音频与语音处理 · 电气工程与系统科学 2023-01-18 Kristina Tesch , Timo Gerkmann

Binaural audio remains underexplored within the music information retrieval community. Motivated by the rising popularity of virtual and augmented reality experiences as well as potential applications to accessibility, we investigate how…

音频与语音处理 · 电气工程与系统科学 2025-07-02 Richa Namballa , Agnieszka Roginska , Magdalena Fuentes

Single-channel speech separation in time domain and frequency domain has been widely studied for voice-driven applications over the past few years. Most of previous works assume known number of speakers in advance, however, which is not…

音频与语音处理 · 电气工程与系统科学 2020-04-02 Yiming Xiao , Haijian Zhang

STOI-optimal masking has been previously proposed and developed for single-channel speech enhancement. In this paper, we consider the extension to the task of binaural speech enhancement in which spatial information is known to be important…

音频与语音处理 · 电气工程与系统科学 2022-10-03 Vikas Tokala , Mike Brookes , Patrick A. Naylor