中文
相关论文

相关论文: Multi-channel Speech Separation Using Spatially Se…

200 篇论文

This work introduces sequential neural beamforming, which alternates between neural network based spectral separation and beamforming based spatial separation. Our neural networks for separation use an advanced convolutional architecture…

We propose a separation guided speaker diarization (SGSD) approach by fully utilizing a complementarity of speech separation and speaker clustering. Since the conventional clustering-based speaker diarization (CSD) approach cannot well…

音频与语音处理 · 电气工程与系统科学 2021-07-07 Shu-Tong Niu , Jun Du , Lei Sun , Chin-Hui Lee

Signal extraction from a single-channel mixture with additional undesired signals is most commonly performed using time-frequency (TF) masks. Typically, the mask is estimated with a deep neural network (DNN), and element-wise applied to the…

声音 · 计算机科学 2019-12-10 Wolfgang Mack , Emanuël A. P. Habets

The field of speech separation, addressing the "cocktail party problem", has seen revolutionary advances with DNNs. Speech separation enhances clarity in complex acoustic environments and serves as crucial pre-processing for speech…

声音 · 计算机科学 2025-08-15 Kai Li , Guo Chen , Wendi Sang , Yi Luo , Zhuo Chen , Shuai Wang , Shulin He , Zhong-Qiu Wang , Andong Li , Zhiyong Wu , Xiaolin Hu

High quality speech capture has been widely studied for both voice communication and human computer interface reasons. To improve the capture performance, we can often find multi-microphone speech enhancement techniques deployed on various…

音频与语音处理 · 电气工程与系统科学 2023-03-15 Yang Yang , Shao-Fu Shih , Hakan Erdogan , Jamie Menjay Lin , Chehung Lee , Yunpeng Li , George Sung , Matthias Grundmann

Speech separation in realistic acoustic environments remains challenging because overlapping speakers, background noise, and reverberation must be resolved simultaneously. Although recent time-frequency (TF) domain models have shown strong…

音频与语音处理 · 电气工程与系统科学 2026-05-15 Ui-Hyeop Shin , Hyung-Min Park

Most existing deep learning based binaural speaker separation systems focus on producing a monaural estimate for each of the target speakers, and thus do not preserve the interaural cues, which are crucial for human listeners to perform…

音频与语音处理 · 电气工程与系统科学 2021-02-03 Ke Tan , Buye Xu , Anurag Kumar , Eliya Nachmani , Yossi Adi

Target speaker extraction focuses on extracting a target speech signal from an environment with multiple speakers by leveraging an enrollment. Existing methods predominantly rely on speaker embeddings obtained from the enrollment,…

声音 · 计算机科学 2025-02-13 Ke Xue , Rongfei Fan , Shanping Yu , Chang Sun , Jianping An

Many applications of single channel source separation (SCSS) including automatic speech recognition (ASR), hearing aids etc. require an estimation of only one source from a mixture of many sources. Treating this special case as a regular…

音频与语音处理 · 电气工程与系统科学 2018-06-22 Arpita Gang , Pravesh Biyani , Akshay Soni

In this work, we introduce S4M, a new efficient speech separation framework based on neural state-space models (SSM). Motivated by linear time-invariant systems for sequence modeling, our SSM-based approach can efficiently model input…

声音 · 计算机科学 2023-05-29 Chen Chen , Chao-Han Huck Yang , Kai Li , Yuchen Hu , Pin-Jui Ku , Eng Siong Chng

Speaker extraction (SE) aims to segregate the speech of a target speaker from a mixture of interfering speakers with the help of auxiliary information. Several forms of auxiliary information have been employed in single-channel SE, such as…

音频与语音处理 · 电气工程与系统科学 2023-09-18 Mohamed Elminshawi , Wolfgang Mack , Srikanth Raj Chetupalli , Soumitro Chakrabarty , Emanuël A. P. Habets

Current deep neural network (DNN) based speech separation faces a fundamental challenge -- while the models need to be trained on short segments due to computational constraints, real-world applications typically require processing…

音频与语音处理 · 电气工程与系统科学 2025-07-04 Yuzhu Wang , Archontis Politis , Konstantinos Drossos , Tuomas Virtanen

We present a unified network for voice separation of an unknown number of speakers. The proposed approach is composed of several separation heads optimized together with a speaker classification branch. The separation is carried out in the…

声音 · 计算机科学 2020-11-05 Shlomo E. Chazan , Lior Wolf , Eliya Nachmani , Yossi Adi

In this paper we propose a method of single-channel speaker-independent multi-speaker speech separation for an unknown number of speakers. As opposed to previous works, in which the number of speakers is assumed to be known in advance and…

声音 · 计算机科学 2019-09-04 Naoya Takahashi , Sudarsanam Parthasaarathy , Nabarun Goswami , Yuki Mitsufuji

Speech separation has been shown effective for multi-talker speech recognition. Under the ad hoc microphone array setup where the array consists of spatially distributed asynchronous microphones, additional challenges must be overcome as…

声音 · 计算机科学 2021-03-04 Dongmei Wang , Takuya Yoshioka , Zhuo Chen , Xiaofei Wang , Tianyan Zhou , Zhong Meng

Capturing audio signals with specific directivity patterns is essential in speech communication. This study presents a deep neural network (DNN)-based approach to directional filtering, alleviating the need for explicit signal models. More…

音频与语音处理 · 电气工程与系统科学 2024-09-23 Julian Wechsler , Srikanth Raj Chetupalli , Mhd Modar Halimeh , Oliver Thiergart , Emanuël A. P. Habets

The separation of single-channel underwater acoustic signals is a challenging problem with practical significance. Few existing studies focus on the source separation problem with unknown numbers of signals, and how to evaluate the…

声音 · 计算机科学 2024-05-29 Qinggang Sun , Kejun Wang

While machine learning techniques are traditionally resource intensive, we are currently witnessing an increased interest in hardware and energy efficient approaches. This need for resource-efficient machine learning is primarily driven by…

音频与语音处理 · 电气工程与系统科学 2020-07-23 Lukas Pfeifenberger , Matthias Zöhrer , Günther Schindler , Wolfgang Roth , Holger Fröning , Franz Pernkopf

Conventional far-field automatic speech recognition (ASR) systems typically employ microphone array techniques for speech enhancement in order to improve robustness against noise or reverberation. However, such speech enhancement techniques…

音频与语音处理 · 电气工程与系统科学 2021-12-23 Minhua Wu , Kenichi Kumatani , Shiva Sundaram , Nikko Strom , Bjorn Hoffmeister

Speech separation has been studied widely for single-channel close-talk microphone recordings over the past few years; developed solutions are mostly in frequency-domain. Recently, a raw audio waveform separation network (TasNet) is…

声音 · 计算机科学 2019-07-25 Fahimeh Bahmaninezhad , Jian Wu , Rongzhi Gu , Shi-Xiong Zhang , Yong Xu , Meng Yu , Dong Yu