English
Related papers

Related papers: A Conditioned UNet for Music Source Separation

200 papers

Conditioned source separations have attracted significant attention because of their flexibility, applicability and extensionality. Their performance was usually inferior to the existing approaches, such as the single source separation…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-27 Yeong-Seok Jeong , Jinsung Kim , Woosung Choi , Jaehwa Chung , Soonyoung Jung

Supervised neural network training has led to significant progress on single-channel sound separation. This approach relies on ground truth isolated sources, which precludes scaling to widely available mixture data and limits progress on…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-19 Scott Wisdom , Aren Jansen , Ron J. Weiss , Hakan Erdogan , John R. Hershey

Source separation is the task to separate an audio recording into individual sound sources. Source separation is fundamental for computational auditory scene analysis. Previous work on source separation has focused on separating particular…

Sound · Computer Science 2020-02-07 Qiuqiang Kong , Yuxuan Wang , Xuchen Song , Yin Cao , Wenwu Wang , Mark D. Plumbley

Most current music source separation (MSS) methods rely on supervised learning, limited by training data quantity and quality. Though web-crawling can bring abundant data, platform-level track labeling often causes metadata mismatches,…

Sound · Computer Science 2025-10-13 Ji Yu , Yang shuo , Xu Yuetonghui , Liu Mengmei , Ji Qiang , Han Zerui

Raman spectra obtained in real world applications are often a noisy combination of several spectra of various substances in a tested sample. Unmixing such spectra into individual components corresponding to each of the substances is of…

Machine Learning · Computer Science 2026-04-27 Gaoruishu Long , Jinchao Liu , Bo Liu , Jie Liu , Xiaolin Hu

Speech, Music and Noise classification/segmentation is an important preprocessing step for audio processing/indexing. To this end, we propose a novel 1D Convolutional Neural Network (CNN) - SwishNet. It is a fast and lightweight…

Machine Learning · Computer Science 2018-12-04 Md. Shamim Hussain , Mohammad Ariful Haque

Recently, audio-visual separation approaches have taken advantage of the natural synchronization between the two modalities to boost audio source separation performance. They extracted high-level semantics from visual inputs as the guidance…

Sound · Computer Science 2024-07-08 Shentong Mo , Yapeng Tian

We propose a generative framework for multi-track music source separation (MSS) that reformulates the task as conditional discrete token generation. Unlike conventional approaches that directly estimate continuous signals in the time or…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-20 Pengbo Lyu , Xiangyu Zhao , Chengwei Liu , Haoyin Yan , Xiaotao Liang , Hongyu Wang , Shaofei Xue

Recent advancements in music source separation (MSS) have focused in the multi-timbral case, with existing architectures tailored for the separation of distinct instruments, overlooking thus the challenge of separating instruments with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-03 Marios Glytsos , Christos Garoufis , Athanasia Zlatintsi , Petros Maragos

The state of the art in music source separation employs neural networks trained in a supervised fashion on multi-track databases to estimate the sources from a given mixture. With only few datasets available, often extensive data…

Machine Learning · Computer Science 2018-04-09 Daniel Stoller , Sebastian Ewert , Simon Dixon

In recent years, deep neural networks (DNNs) based approaches have achieved the start-of-the-art performance for music source separation (MSS). Although previous methods have addressed the large receptive field modeling using various…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-05 Lianwu Chen , Xiguang Zheng , Chen Zhang , Liang Guo , Bing Yu

Existing weakly supervised semantic segmentation (WSSS) methods usually utilize the results of pre-trained saliency detection (SD) models without explicitly modeling the connections between the two tasks, which is not the most efficient…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Yu Zeng , Yunzhi Zhuge , Huchuan Lu , Lihe Zhang

Blind speech separation (BSS) aims to recover multiple speech sources from multi-channel, multi-speaker mixtures under unknown array geometry and room impulse responses. In unsupervised setup where clean target speech is not available for…

Sound · Computer Science 2025-10-13 Shulin He , Zhong-Qiu Wang

We proposed the expected energy-based restricted Boltzmann machine (EE-RBM) as a discriminative RBM method for classification. Two characteristics of the EE-RBM are that the output is unbounded and that the target value of correct…

Machine Learning · Computer Science 2018-07-26 Stefan Elfwing , Eiji Uchibe , Kenji Doya

In recent years, rapid progress has been made on the problem of single-channel sound separation using supervised training of deep neural networks. In such supervised approaches, a model is trained to predict the component sources from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Scott Wisdom , Efthymios Tzinis , Hakan Erdogan , Ron J. Weiss , Kevin Wilson , John R. Hershey

Sounds provide rich semantics, complementary to visual data, for many tasks. However, in practice, sounds from multiple sources are often mixed together. In this paper we propose a novel framework, referred to as MinusPlus Network (MP-Net),…

Computer Vision and Pattern Recognition · Computer Science 2019-10-24 Xudong Xu , Bo Dai , Dahua Lin

Several attempts have been made to handle multiple source separation tasks such as speech enhancement, speech separation, sound event separation, music source separation (MSS), or cinematic audio source separation (CASS) with a single…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-01 Kohei Saijo , Janek Ebbers , François G. Germain , Gordon Wichern , Jonathan Le Roux

Music Source Restoration (MSR) extends source separation to realistic settings where signals undergo production effects (equalization, compression, reverb) and real-world degradations, with the goal of recovering the original unprocessed…

Isolating individual instruments in a musical mixture has a myriad of potential applications, and seems imminently achievable given the levels of performance reached by recent deep learning methods. While most musical source separation…

Sound · Computer Science 2018-11-08 Prem Seetharaman , Gordon Wichern , Shrikant Venkataramani , Jonathan Le Roux

Deep clustering is the first method to handle general audio separation scenarios with multiple sources of the same type and an arbitrary number of sources, performing impressively in speaker-independent speech separation tasks. However,…

Machine Learning · Statistics 2017-11-30 Yi Luo , Zhuo Chen , John R. Hershey , Jonathan Le Roux , Nima Mesgarani