English
Related papers

Related papers: Advances in Speech Separation: Techniques, Challen…

200 papers

Recent advances in the design of neural network architectures, in particular those specialized in modeling sequences, have provided significant improvements in speech separation performance. In this work, we propose to use a bio-inspired…

Sound · Computer Science 2021-12-07 Xiaolin Hu , Kai Li , Weiyi Zhang , Yi Luo , Jean-Marie Lemercier , Timo Gerkmann

Separation of competing speech is a key challenge in signal processing and a feat routinely performed by the human auditory brain. A long standing benchmark of the spectrogram approach to source separation is known as the ideal binary mask.…

Sound · Computer Science 2015-03-25 Andrew J. R. Simpson

Source separation (SS) of acoustic signals is a research field that emerged in the mid-1990s and has flourished ever since. On the occasion of ICASSP's 50th anniversary, we review the major contributions and advancements in the past three…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Shoko Araki , Nobutaka Ito , Reinhold Haeb-Umbach , Gordon Wichern , Zhong-Qiu Wang , Yuki Mitsufuji

We consider the problem of audio voice separation for binaural applications, such as earphones and hearing aids. While today's neural networks perform remarkably well (separating $4+$ sources with 2 microphones) they assume a known or fixed…

Sound · Computer Science 2022-07-18 Zhongweiyang Xu , Romit Roy Choudhury

Speaker diarization is a task to label audio or video recordings with classes that correspond to speaker identity, or in short, a task to identify "who spoke when". In the early years, speaker diarization algorithms were developed for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-29 Tae Jin Park , Naoyuki Kanda , Dimitrios Dimitriadis , Kyu J. Han , Shinji Watanabe , Shrikanth Narayanan

While neural network approaches have made significant strides in resolving classical signal processing problems, it is often the case that hybrid approaches that draw insight from both signal processing and neural networks produce more…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-13 Karim Helwani , Masahito Togami , Paris Smaragdis , Michael M. Goodwin

Speech separation has been extensively explored to tackle the cocktail party problem. However, these studies are still far from having enough generalization capabilities for real scenarios. In this work, we raise a common strategy named…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-26 Jing Shi , Jiaming Xu , Yusuke Fujita , Shinji Watanabe , Bo Xu

In noisy and reverberant environments, the performance of deep learning-based speech separation methods drops dramatically because previous methods are not designed and optimized for such situations. To address this issue, we propose a…

Sound · Computer Science 2023-03-08 Zhaoxi Mu , Xinyu Yang , Xiangyuan Yang , Wenjing Zhu

We present a new method for separating a mixed audio sequence, in which multiple voices speak simultaneously. The new method employs gated neural networks that are trained to separate the voices at multiple processing steps, while…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-02 Eliya Nachmani , Yossi Adi , Lior Wolf

The current monaural state of the art tools for speech separation relies on supervised learning. This means that they must deal with permutation problem, they are impacted by the mismatch on the number of speakers used in training and…

Sound · Computer Science 2024-10-10 Peter Ochieng

We address talker-independent monaural speaker separation from the perspectives of deep learning and computational auditory scene analysis (CASA). Specifically, we decompose the multi-speaker separation task into the stages of simultaneous…

Sound · Computer Science 2019-04-26 Yuzhou Liu , DeLiang Wang

Recent progress in speech separation has been largely driven by advances in deep neural networks, yet their high computational and memory requirements hinder deployment on resource-constrained devices. A significant inefficiency in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-09 Mohamed Elminshawi , Srikanth Raj Chetupalli , Emanuël A. P. Habets

Because the performance of speech separation is excellent for speech in which two speakers completely overlap, research attention has been shifted to dealing with more realistic scenarios. However, domain mismatch between training/test…

Sound · Computer Science 2022-06-22 Fan-Lin Wang , Hung-Shin Lee , Yu Tsao , Hsin-Min Wang

Speech separation has been shown effective for multi-talker speech recognition. Under the ad hoc microphone array setup where the array consists of spatially distributed asynchronous microphones, additional challenges must be overcome as…

Sound · Computer Science 2021-03-04 Dongmei Wang , Takuya Yoshioka , Zhuo Chen , Xiaofei Wang , Tianyan Zhou , Zhong Meng

Deep clustering is a recently introduced deep learning architecture that uses discriminatively trained embeddings as the basis for clustering. It was recently applied to spectrogram segmentation, resulting in impressive results on…

Machine Learning · Computer Science 2016-07-11 Yusuf Isik , Jonathan Le Roux , Zhuo Chen , Shinji Watanabe , John R. Hershey

Speaker embeddings represent a means to extract representative vectorial representations from a speech signal such that the representation pertains to the speaker identity alone. The embeddings are commonly used to classify and discriminate…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-07 Adriana Stan

Recent advancements in deep learning have significantly impacted the field of speech signal processing, particularly in the analysis and manipulation of complex spectrograms. This survey provides a comprehensive overview of the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-06 Yuying Xie , Zheng-Hua Tan

This survey presents a review of state-of-the-art deep neural network architectures, algorithms, and systems in vision and speech applications. Recent advances in deep artificial neural network algorithms and architectures have spurred…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Mahbubul Alam , Manar D. Samad , Lasitha Vidyaratne , Alexander Glandon , Khan M. Iftekharuddin

Deep neural networks (DNNs) are now a central component of nearly all state-of-the-art speech recognition systems. Building neural network acoustic models requires several design decisions including network architecture, size, and training…

Computation and Language · Computer Science 2015-01-21 Andrew L. Maas , Peng Qi , Ziang Xie , Awni Y. Hannun , Christopher T. Lengerich , Daniel Jurafsky , Andrew Y. Ng

Speech separation is an important problem in speech processing, which targets to separate and generate clean speech from a mixed audio containing speech from different speakers. Empowered by the deep learning technologies over…

Sound · Computer Science 2021-02-22 Zining Zhang , Bingsheng He , Zhenjie Zhang