English
Related papers

Related papers: A comprehensive study of speech separation: spectr…

200 papers

The crux of single-channel speech separation is how to encode the mixture of signals into such a latent embedding space that the signals from different speakers can be precisely separated. Existing methods for speech separation either…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-01 Zengwei Yao , Wenjie Pei , Fanglin Chen , Guangming Lu , David Zhang

Speech separation involves extracting an individual speaker's voice from a multi-speaker audio signal. The increasing complexity of real-world environments, where multiple speakers might converse simultaneously, underscores the importance…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Renana Opochinsky , Mordehay Moradi , Sharon Gannot

Speech separation has been successfully applied as a frontend processing module of conversation transcription systems thanks to its ability to handle overlapped speech and its flexibility to combine with downstream tasks such as automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-06 Jian Wu , Zhuo Chen , Sanyuan Chen , Yu Wu , Takuya Yoshioka , Naoyuki Kanda , Shujie Liu , Jinyu Li

Separating vocal elements from musical tracks is a longstanding challenge in audio signal processing. This study tackles the distinct separation of vocal components from musical spectrograms. We employ the Short Time Fourier Transform…

Sound · Computer Science 2024-05-31 Adam Sorrenti

Deep neural network with dual-path bi-directional long short-term memory (BiLSTM) block has been proved to be very effective in sequence modeling, especially in speech separation. This work investigates how to extend dual-path BiLSTM to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Ziqiang Shi , Rujie Liu , Jiqing Han

Models for audio source separation usually operate on the magnitude spectrum, which ignores phase information and makes separation performance dependant on hyper-parameters for the spectral front-end. Therefore, we investigate end-to-end…

Sound · Computer Science 2018-06-11 Daniel Stoller , Sebastian Ewert , Simon Dixon

One of the leading single-channel speech separation (SS) models is based on a TasNet with a dual-path segmentation technique, where the size of each segment remains unchanged throughout all layers. In contrast, our key finding is that…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-09 Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu

The performance of single channel source separation algorithms has improved greatly in recent times with the development and deployment of neural networks. However, many such networks continue to operate on the magnitude spectrogram of a…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-08 Shrikant Venkataramani , Paris Smaragdis

This work introduces sequential neural beamforming, which alternates between neural network based spectral separation and beamforming based spatial separation. Our neural networks for separation use an advanced convolutional architecture…

In daily listening environments, speech is always distorted by background noise, room reverberation and interference speakers. With the developing of deep learning approaches, much progress has been performed on monaural multi-speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Chao Ma , Dongmei Li , Xupeng Jia

Target speech extraction, which extracts a single target source in a mixture given clues about the target speaker, has attracted increasing attention. We have recently proposed SpeakerBeam, which exploits an adaptation utterance of the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-24 Marc Delcroix , Tsubasa Ochiai , Katerina Zmolikova , Keisuke Kinoshita , Naohiro Tawara , Tomohiro Nakatani , Shoko Araki

The deep learning based time-domain models, e.g. Conv-TasNet, have shown great potential in both single-channel and multi-channel speech enhancement. However, many experiments on the time-domain speech enhancement model are done in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-28 Wangyou Zhang , Jing Shi , Chenda Li , Shinji Watanabe , Yanmin Qian

In recent years, many deep learning techniques for single-channel sound source separation have been proposed using recurrent, convolutional and transformer networks. When multiple microphones are available, spatial diversity between…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-23 Ali Aroudi , Stefan Uhlich , Marc Ferras Font

Although deep-learning-based methods have markedly improved the performance of speech separation over the past few years, it remains an open question how to integrate multi-channel signals for speech separation. We propose two methods,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-12 Yuichiro Koyama , Oluwafemi Azeez , Bhiksha Raj

Target speech separation refers to extracting the target speaker's speech from mixed signals. Despite the recent advances in deep learning based close-talk speech separation, the applications to real-world are still an open issue. Two main…

Sound · Computer Science 2020-01-03 Rongzhi Gu , Yuexian Zou

Speech separation remains an important area of multi-speaker signal processing. Deep neural network (DNN) models have attained the best performance on many speech separation benchmarks. Some of these models can take significant time to…

Sound · Computer Science 2023-06-19 William Ravenscroft , Stefan Goetze , Thomas Hain

Recent research on the time-domain audio separation networks (TasNets) has brought great success to speech separation. Nevertheless, conventional TasNets struggle to satisfy the memory and latency constraints in industrial applications. In…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-14 Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu

Deep learning-based methods have made significant achievements in music source separation. However, obtaining good results while maintaining a low model complexity remains challenging in super wide-band music source separation. Previous…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-25 Weinan Tong , Jiaxu Zhu , Jun Chen , Shiyin Kang , Tao Jiang , Yang Li , Zhiyong Wu , Helen Meng

In general, multi-channel source separation has utilized inter-microphone phase differences (IPDs) concatenated with magnitude information in time-frequency domain, or real and imaginary components stacked along the channel axis. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-01 Ui-Hyeop Shin , Bon Hyeok Ku , Hyung-Min Park

Raman spectra obtained in real world applications are often a noisy combination of several spectra of various substances in a tested sample. Unmixing such spectra into individual components corresponding to each of the substances is of…

Machine Learning · Computer Science 2026-04-27 Gaoruishu Long , Jinchao Liu , Bo Liu , Jie Liu , Xiaolin Hu