English
Related papers

Related papers: Single-Microphone Speech Enhancement and Separatio…

200 papers

Speech enhancement and speech separation are two related tasks, whose purpose is to extract either one or more target speech signals, respectively, from a mixture of sounds generated by several sources. Traditionally, these tasks have been…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-16 Daniel Michelsanti , Zheng-Hua Tan , Shi-Xiong Zhang , Yong Xu , Meng Yu , Dong Yu , Jesper Jensen

Deep clustering (DC) and utterance-level permutation invariant training (uPIT) have been demonstrated promising for speaker-independent speech separation. DC is usually formulated as two-step processes: embedding learning and embedding…

Sound · Computer Science 2019-07-24 Cunhang Fan , Bin Liu , Jianhua Tao , Jiangyan Yi , Zhengqi Wen

We present an upper bound for the Single Channel Speech Separation task, which is based on an assumption regarding the nature of short segments of speech. Using the bound, we are able to show that while the recent methods have made…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-23 Shahar Lutati , Eliya Nachmani , Lior Wolf

Despite the recent success of deep learning for many speech processing tasks, single-microphone, speaker-independent speech separation remains challenging for two main reasons. The first reason is the arbitrary order of the target and…

Sound · Computer Science 2018-04-19 Yi Luo , Zhuo Chen , Nima Mesgarani

Speech separation refers to extracting each individual speech source in a given mixed signal. Recent advancements in speech separation and ongoing research in this area, have made these approaches as promising techniques for pre-processing…

Machine Learning · Computer Science 2019-12-18 Fahimeh Bahmaninezhad , Shi-Xiong Zhang , Yong Xu , Meng Yu , John H. L. Hansen , Dong Yu

This paper introduces a practical approach for leveraging a real-time deep learning model to alternate between speech enhancement and joint speech enhancement and separation depending on whether the input mixture contains one or two active…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-17 Kashyap Patel , Anton Kovalyov , Issa Panahi

Most speech separation methods, trying to separate all channel sources simultaneously, are still far from having enough general- ization capabilities for real scenarios where the number of input sounds is usually uncertain and even dynamic.…

Sound · Computer Science 2021-02-09 Chenxing Li , Jiaming Xu , Nima Mesgarani , Bo Xu

In recent years, rapid progress has been made on the problem of single-channel sound separation using supervised training of deep neural networks. In such supervised approaches, a model is trained to predict the component sources from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Scott Wisdom , Efthymios Tzinis , Hakan Erdogan , Ron J. Weiss , Kevin Wilson , John R. Hershey

Humans can listen to a target speaker even in challenging acoustic conditions that have noise, reverberation, and interfering speakers. This phenomenon is known as the cocktail-party effect. For decades, researchers have focused on…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-17 Katerina Zmolikova , Marc Delcroix , Tsubasa Ochiai , Keisuke Kinoshita , Jan Černocký , Dong Yu

Recent progress in separating the speech signals from multiple overlapping speakers using a single audio channel has brought us closer to solving the cocktail party problem. However, most studies in this area use a constrained problem…

The cocktail party problem aims at isolating any source of interest within a complex acoustic scene, and has long inspired audio source separation research. Recent efforts have mainly focused on separating speech from noise, speech from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-25 Darius Petermann , Gordon Wichern , Zhong-Qiu Wang , Jonathan Le Roux

Separation of competing speech is a key challenge in signal processing and a feat routinely performed by the human auditory brain. A long standing benchmark of the spectrogram approach to source separation is known as the ideal binary mask.…

Sound · Computer Science 2015-03-25 Andrew J. R. Simpson

Deep neural network with dual-path bi-directional long short-term memory (BiLSTM) block has been proved to be very effective in sequence modeling, especially in speech separation. This work investigates how to extend dual-path BiLSTM to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Ziqiang Shi , Rujie Liu , Jiqing Han

Discriminatively localizing sounding objects in cocktail-party, i.e., mixed sound scenes, is commonplace for humans, but still challenging for machines. In this paper, we propose a two-stage learning framework to perform self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Di Hu , Rui Qian , Minyue Jiang , Xiao Tan , Shilei Wen , Errui Ding , Weiyao Lin , Dejing Dou

The problem of speech separation, also known as the cocktail party problem, refers to the task of isolating a single speech signal from a mixture of speech signals. Previous work on source separation derived an upper bound for the source…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-27 Shahar Lutati , Eliya Nachmani , Lior Wolf

The optimization of a wavelet-based algorithm to improve speech intelligibility along with the full data set and results are reported. The discrete-time speech signal is split into frequency sub-bands via a multi-level discrete wavelet…

Sound · Computer Science 2022-07-25 Tianqu Kang , Anh-Dung Dinh , Binghong Wang , Tianyuan Du , Yijia Chen , Kevin Chau

Conventional speech enhancement (SE) aims to improve speech perception and intelligibility by suppressing noise without requiring enrollment speech as reference, whereas personalized SE (PSE) addresses the cocktail party problem by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-20 Ziling Huang , Haixin Guan , Yanhua Long

In this paper we propose to use utterance-level Permutation Invariant Training (uPIT) for speaker independent multi-talker speech separation and denoising, simultaneously. Specifically, we train deep bi-directional Long Short-Term Memory…

Sound · Computer Science 2018-12-06 Morten Kolbæk , Dong Yu , Zheng-Hua Tan , Jesper Jensen

A prototypical blind signal separation problem is the so-called cocktail party problem, with n people talking simultaneously and n different microphones within a room. The goal is to recover each speech signal from the microphone inputs.…

Machine Learning · Computer Science 2013-06-11 Mikhail Belkin , Luis Rademacher , James Voss

Speech enhancement and separation have been a long-standing problem, especially with the recent advances using a single microphone. Although microphones perform well in constrained settings, their performance for speech separation decreases…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-15 Muhammed Zahid Ozturk , Chenshu Wu , Beibei Wang , Min Wu , K. J. Ray Liu