English
Related papers

Related papers: Two-Step Sound Source Separation: Training on Lear…

200 papers

Most speech separation methods, trying to separate all channel sources simultaneously, are still far from having enough general- ization capabilities for real scenarios where the number of input sounds is usually uncertain and even dynamic.…

Sound · Computer Science 2021-02-09 Chenxing Li , Jiaming Xu , Nima Mesgarani , Bo Xu

The crux of single-channel speech separation is how to encode the mixture of signals into such a latent embedding space that the signals from different speakers can be precisely separated. Existing methods for speech separation either…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-01 Zengwei Yao , Wenjie Pei , Fanglin Chen , Guangming Lu , David Zhang

Real-time single-channel speech separation aims to unmix an audio stream captured from a single microphone that contains multiple people talking at once, environmental noise, and reverberation into multiple de-reverberated and noise-free…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-18 Julian Neri , Sebastian Braun

Deep neural networks have achieved great success in computer vision, speech recognition and many other areas. The potential of recurrent neural networks especially the Long Short-Term Memory (LSTM) for open set communication signal…

Signal Processing · Electrical Eng. & Systems 2020-02-28 Youwei Guo , Hongyu Jiang , Jing Wu , Jie Zhou

Multi-channel speech separation in dynamic environments is challenging as time-varying spatial and spectral features evolve at different temporal scales. Existing methods typically employ sequential architectures, forcing a single network…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-27 Yuzhu Wang , Archontis Politis , Konstantinos Drossos , Tuomas Virtanen

State of the art audio source separation models rely on supervised data-driven approaches, which can be expensive in terms of labeling resources. On the other hand, approaches for training these models without any direct supervision are…

Machine Learning · Computer Science 2022-04-04 Michele Mancusi , Emilian Postolache , Giorgio Mariani , Marco Fumero , Andrea Santilli , Luca Cosmo , Emanuele Rodolà

Recent progress in audio source separation lead by deep learning has enabled many neural network models to provide robust solutions to this fundamental estimation problem. In this study, we provide a family of efficient neural network…

Sound · Computer Science 2022-02-01 Efthymios Tzinis , Zhepei Wang , Xilin Jiang , Paris Smaragdis

In this paper, we study whether music source separation can be used as a pre-training strategy for music representation learning, targeted at music classification tasks. To this end, we first pre-train U-Net networks under various music…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-24 Christos Garoufis , Athanasia Zlatintsi , Petros Maragos

Monaural source separation is important for many real world applications. It is challenging because, with only a single channel of information available, without any constraints, an infinite number of solutions are possible. In this paper,…

Sound · Computer Science 2015-10-02 Po-Sen Huang , Minje Kim , Mark Hasegawa-Johnson , Paris Smaragdis

We study the single-channel source separation problem involving orthogonal frequency-division multiplexing (OFDM) signals, which are ubiquitous in many modern-day digital communication systems. Related efforts have been pursued in monaural…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Gary C. F. Lee , Amir Weiss , Alejandro Lancho , Yury Polyanskiy , Gregory W. Wornell

This paper introduces a new method for multi-channel time domain speech separation in reverberant environments. A fully-convolutional neural network structure has been used to directly separate speech from multiple microphone recordings,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-12 Jisi Zhang , Catalin Zorila , Rama Doddipatla , Jon Barker

Privacy preservation has long been a concern in smart acoustic monitoring systems, where speech can be passively recorded along with a target signal in the system's operating environment. In this study, we propose the integration of two…

Sound · Computer Science 2025-05-05 Diep Luong , Minh Tran , Shayan Gharib , Konstantinos Drossos , Tuomas Virtanen

Segmenting objects in images and separating sound sources in audio are challenging tasks, in part because traditional approaches require large amounts of labeled data. In this paper we develop a neural network model for visual object…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Andrew Rouditchenko , Hang Zhao , Chuang Gan , Josh McDermott , Antonio Torralba

Target speech separation is the process of filtering a certain speaker's voice out of speech mixtures according to the additional speaker identity information provided. Recent works have made considerable improvement by processing signals…

Sound · Computer Science 2021-09-28 Qingjian Lin , Lin Yang , Xuyang Wang , Luyuan Xie , Chen Jia , Junjie Wang

In this paper, a novel approach for single channel source separation (SCSS) using a deep neural network (DNN) architecture is introduced. Unlike previous studies in which DNN and other classifiers were used for classifying time-frequency…

Neural and Evolutionary Computing · Computer Science 2013-11-13 Emad M. Grais , Mehmet Umut Sen , Hakan Erdogan

Although deep-learning-based methods have markedly improved the performance of speech separation over the past few years, it remains an open question how to integrate multi-channel signals for speech separation. We propose two methods,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-12 Yuichiro Koyama , Oluwafemi Azeez , Bhiksha Raj

Source separation can improve automatic speech recognition (ASR) under multi-party meeting scenarios by extracting single-speaker signals from overlapped speech. Despite the success of self-supervised learning models in single-channel…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-04 Yuang Li , Xianrui Zheng , Philip C. Woodland

The audio source separation tasks, such as speech enhancement, speech separation, and music source separation, have achieved impressive performance in recent studies. The powerful modeling capabilities of deep neural networks give us hope…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-15 Lu Zhang , Chenxing Li , Feng Deng , Xiaorui Wang

Tiny, causal models are crucial for embedded audio machine learning applications. Model compression can be achieved via distilling knowledge from a large teacher into a smaller student model. In this work, we propose a novel two-step…

Sound · Computer Science 2023-09-18 Rayan Daod Nathoo , Mikolaj Kegler , Marko Stamenovic

Deep neural networks have recently shown great success in the task of blind source separation, both under monaural and binaural settings. Although these methods were shown to produce high-quality separations, they were mainly applied under…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-28 Ori Kabeli , Yossi Adi , Zhenyu Tang , Buye Xu , Anurag Kumar