English
Related papers

Related papers: Moving Speaker Separation via Parallel Spectral-Sp…

200 papers

This paper introduces a practical approach for leveraging a real-time deep learning model to alternate between speech enhancement and joint speech enhancement and separation depending on whether the input mixture contains one or two active…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-17 Kashyap Patel , Anton Kovalyov , Issa Panahi

The source separation-based speech enhancement problem with multiple beamforming in reverberant indoor environments is addressed in this paper. We propose that more generic solutions should cope with time-varying dynamic scenarios with…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Alejandro Díaz , Diego Pincheira , Rodrigo Mahu , Nestor Becerra Yoma

Single-channel speech separation in time domain and frequency domain has been widely studied for voice-driven applications over the past few years. Most of previous works assume known number of speakers in advance, however, which is not…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-02 Yiming Xiao , Haijian Zhang

This paper describes a versatile method that accelerates multichannel source separation methods based on full-rank spatial modeling. A popular approach to multichannel source separation is to integrate a spatial model with a source model…

Sound · Computer Science 2019-03-11 Kouhei Sekiguchi , Aditya Arie Nugraha , Yoshiaki Bando , Kazuyoshi Yoshii

A three-stage approach is proposed for speaker counting and speech separation in noisy and reverberant environments. In the spatial feature extraction, a spatial coherence matrix (SCM) is computed using whitened relative transfer functions…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-08 Yicheng Hsu , Mingsian Bai

With the recent advancements of data driven approaches using deep neural networks, music source separation has been formulated as an instrument-specific supervised problem. While existing deep learning models implicitly absorb the spatial…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-16 Darius Petermann , Minje Kim

In daily listening environments, speech is always distorted by background noise, room reverberation and interference speakers. With the developing of deep learning approaches, much progress has been performed on monaural multi-speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Chao Ma , Dongmei Li , Xupeng Jia

Separating competing speech in reverberant environments requires models that preserve spatial cues while maintaining separation efficiency. We present a Phase-aware Ear-conditioned speaker Separation network using eight microphones…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-14 Ruben Johnson Robert Jeremiah , Peyman Goli , Steven van de Par

In speech separation, time-domain approaches have successfully replaced the time-frequency domain with latent sequence feature from a learnable encoder. Conventionally, the feature is separated into speaker-specific ones at the final stage…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-01 Ui-Hyeop Shin , Sangyoun Lee , Taehan Kim , Hyung-Min Park

When dealing with overlapped speech, the performance of automatic speech recognition (ASR) systems substantially degrades as they are designed for single-talker speech. To enhance ASR performance in conversational or meeting environments,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-16 Hassan Taherian , DeLiang Wang

Music source separation (MSS) aims to separate mixed music into its distinct tracks, such as vocals, bass, drums, and more. MSS is considered to be a challenging audio separation task due to the complexity of music signals. Although the RNN…

Sound · Computer Science 2024-09-16 Jinglin Bai , Yuan Fang , Jiajie Wang , Xueliang Zhang

We address talker-independent monaural speaker separation from the perspectives of deep learning and computational auditory scene analysis (CASA). Specifically, we decompose the multi-speaker separation task into the stages of simultaneous…

Sound · Computer Science 2019-04-26 Yuzhou Liu , DeLiang Wang

Transformers have been the most successful architecture for various speech modeling tasks, including speech separation. However, the self-attention mechanism in transformers with quadratic complexity is inefficient in computation and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-02 Xilin Jiang , Cong Han , Nima Mesgarani

This paper introduces a new method for multi-channel time domain speech separation in reverberant environments. A fully-convolutional neural network structure has been used to directly separate speech from multiple microphone recordings,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-12 Jisi Zhang , Catalin Zorila , Rama Doddipatla , Jon Barker

In general, multi-channel source separation has utilized inter-microphone phase differences (IPDs) concatenated with magnitude information in time-frequency domain, or real and imaginary components stacked along the channel axis. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-01 Ui-Hyeop Shin , Bon Hyeok Ku , Hyung-Min Park

For the task of speech separation, previous study usually treats multi-channel and single-channel scenarios as two research tracks with specialized solutions developed respectively. Instead, we propose a simple and unified architecture -…

Sound · Computer Science 2023-03-15 Shuo Wang , Xiangyu Kong , Xiulian Peng , Mahmood Movassagh , Vinod Prakash , Yan Lu

Hand-crafted spatial features (e.g., inter-channel phase difference, IPD) play a fundamental role in recent deep learning based multi-channel speech separation (MCSS) methods. However, these manually designed spatial features are hard to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-16 Rongzhi Gu , Shi-Xiong Zhang , Lianwu Chen , Yong Xu , Meng Yu , Dan Su , Yuexian Zou , Dong Yu

In this paper, we propose a two-step training procedure for source separation via a deep neural network. In the first step we learn a transform (and it's inverse) to a latent space where masking-based separation performance using oracles is…

Machine Learning · Computer Science 2021-05-12 Efthymios Tzinis , Shrikant Venkataramani , Zhepei Wang , Cem Subakan , Paris Smaragdis

A robust multichannel speaker diarization and separation system is proposed by exploiting the spatio-temporal activity of the speakers. The system is realized in a hybrid architecture that combines the array signal processing units and the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-31 Yicheng Hsu , Ssuhan Chen , Mingsian R. Bai

Automatic speech recognition (ASR) of multi-channel multi-speaker overlapped speech remains one of the most challenging tasks to the speech community. In this paper, we look into this challenge by utilizing the location information of…

Sound · Computer Science 2021-11-23 Yiwen Shao , Shi-Xiong Zhang , Dong Yu