English
Related papers

Related papers: CatNet: music source separation system with mix-au…

200 papers

Monaural source separation is important for many real world applications. It is challenging because, with only a single channel of information available, without any constraints, an infinite number of solutions are possible. In this paper,…

Sound · Computer Science 2015-10-02 Po-Sen Huang , Minje Kim , Mark Hasegawa-Johnson , Paris Smaragdis

Harmonic/percussive source separation (HPSS) consists in separating the pitched instruments from the percussive parts in a music mixture. In this paper, we propose to apply the recently introduced Masker-Denoiser with twin networks (MaD…

Recent advancements in music source separation have significantly progressed, particularly in isolating vocals, drums, and bass elements from mixed tracks. These developments owe much to the creation and use of large-scale, multitrack…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-18 Jaime Garcia-Martinez , David Diaz-Guerra , Archontis Politis , Tuomas Virtanen , Julio J. Carabias-Orti , Pedro Vera-Candeas

This paper proposes a neural network that performs audio transformations to user-specified sources (e.g., vocals) of a given audio track according to a given description while preserving other sources not mentioned in the description. Audio…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-29 Woosung Choi , Minseok Kim , Marco A. Martínez Ramírez , Jaehwa Chung , Soonyoung Jung

With the recent advancements of data driven approaches using deep neural networks, music source separation has been formulated as an instrument-specific supervised problem. While existing deep learning models implicitly absorb the spatial…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-16 Darius Petermann , Minje Kim

We introduce UNMIXX, a novel framework for multiple singing voices separation (MSVS). While related to speech separation, MSVS faces unique challenges: data scarcity and the highly correlated nature of singing voices mixture. To address…

Sound · Computer Science 2026-01-21 Jihoo Jung , Ji-Hoon Kim , Doyeop Kwak , Junwon Lee , Juhan Nam , Joon Son Chung

In this paper, we study whether music source separation can be used as a pre-training strategy for music representation learning, targeted at music classification tasks. To this end, we first pre-train U-Net networks under various music…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-24 Christos Garoufis , Athanasia Zlatintsi , Petros Maragos

Musical source separation (MSS) has recently seen a big breakthrough in separating instruments from a mixture in the context of Western music, but research on non-Western instruments is still limited due to a lack of data. In this demo, we…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-02 Richa Namballa , Giovana Morais , Magdalena Fuentes

In music source separation (MSS), obtaining isolated sources or stems is highly costly, making pre-training on unlabeled data a promising approach. Although source-agnostic unsupervised learning like mixture-invariant training (MixIT) has…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-13 Kohei Saijo , Yoshiaki Bando

Informed source separation has recently gained renewed interest with the introduction of neural networks and the availability of large multitrack datasets containing both the mixture and the separated sources. These approaches use prior…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-06 Gabriel Meseguer-Brocal , Geoffroy Peeters

This work addresses the problem of multichannel source separation combining two powerful approaches, multichannel spectral factorization with recent monophonic deep-learning (DL) based spectrum inference. Individual source spectra at…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-04 Antonio J. Muñoz-Montoro , Julio J. Carabias-Orti , Archontis Politis , Konstantinos Drossos

Speech separation has been studied widely for single-channel close-talk microphone recordings over the past few years; developed solutions are mostly in frequency-domain. Recently, a raw audio waveform separation network (TasNet) is…

Sound · Computer Science 2019-07-25 Fahimeh Bahmaninezhad , Jian Wu , Rongzhi Gu , Shi-Xiong Zhang , Yong Xu , Meng Yu , Dong Yu

Music source separation involves a large input field to model a long-term dependence of an audio signal. Previous convolutional neural network (CNN)-based approaches address the large input field modeling using sequentially down- and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-30 Naoya Takahashi , Yuki Mitsufuji

This paper presents the crossing scheme (X-scheme) for improving the performance of deep neural network (DNN)-based music source separation (MSS) with almost no increasing calculation cost. It consists of three components: (i) multi-domain…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-07 Ryosuke Sawata , Naoya Takahashi , Stefan Uhlich , Shusuke Takahashi , Yuki Mitsufuji

In recent years, many deep learning techniques for single-channel sound source separation have been proposed using recurrent, convolutional and transformer networks. When multiple microphones are available, spatial diversity between…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-23 Ali Aroudi , Stefan Uhlich , Marc Ferras Font

Robust speech processing in multi-talker environments requires effective speech separation. Recent deep learning systems have made significant progress toward solving this problem, yet it remains challenging particularly in real-time, short…

Sound · Computer Science 2018-04-19 Yi Luo , Nima Mesgarani

Modern audio source separation techniques rely on optimizing sequence model architectures such as, 1D-CNNs, on mixture recordings to generalize well to unseen mixtures. Specifically, recent focus is on time-domain based architectures such…

Machine Learning · Computer Science 2019-04-09 Vivek Sivaraman Narayanaswamy , Sameeksha Katoch , Jayaraman J. Thiagarajan , Huan Song , Andreas Spanias

We propose a time-domain audio source separation method using down-sampling (DS) and up-sampling (US) layers based on a discrete wavelet transform (DWT). The proposed method is based on one of the state-of-the-art deep neural networks,…

Sound · Computer Science 2022-12-05 Tomohiko Nakamura , Hiroshi Saruwatari

Universal sound separation (USS) is a task of separating mixtures of arbitrary sound sources. Typically, universal separation models are trained from scratch in a supervised manner, using labeled data. Self-supervised learning (SSL) is an…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-07 Junqi Zhao , Xubo Liu , Jinzheng Zhao , Yi Yuan , Qiuqiang Kong , Mark D. Plumbley , Wenwu Wang

Source separation is the task to separate an audio recording into individual sound sources. Source separation is fundamental for computational auditory scene analysis. Previous work on source separation has focused on separating particular…

Sound · Computer Science 2020-02-07 Qiuqiang Kong , Yuxuan Wang , Xuchen Song , Yin Cao , Wenwu Wang , Mark D. Plumbley