English
Related papers

Related papers: Deep Learning Based Source Separation Applied To C…

200 papers

Music source separation is an audio-to-audio retrieval task of extracting one or more constituent components, or composites thereof, from a musical audio mixture. Each of these constituent components is often referred to as a "stem" in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-28 Karn N. Watcharasupat , Alexander Lerch

Music is often experienced as a progression of concurrent streams of notes, or voices. The degree to which this happens depends on the position along a voice-leading continuum, ranging from monophonic, to homophonic, to polyphonic, which…

Sound · Computer Science 2020-11-06 Patrick Gray , Razvan Bunescu

Modern audio source separation techniques rely on optimizing sequence model architectures such as, 1D-CNNs, on mixture recordings to generalize well to unseen mixtures. Specifically, recent focus is on time-domain based architectures such…

Machine Learning · Computer Science 2019-04-09 Vivek Sivaraman Narayanaswamy , Sameeksha Katoch , Jayaraman J. Thiagarajan , Huan Song , Andreas Spanias

Can we perform an end-to-end music source separation with a variable number of sources using a deep learning model? We present an extension of the Wave-U-Net model which allows end-to-end monaural source separation with a non-fixed number…

Sound · Computer Science 2019-05-10 Olga Slizovskaia , Leo Kim , Gloria Haro , Emilia Gomez

In this work, we study the task of multi-singer separation in a cappella music, where the number of active singers varies across mixtures. To address this, we use a power set-based data augmentation strategy that expands limited…

Sound · Computer Science 2025-10-01 Luca A. Lanzendörfer , Constantin Pinkl , Florian Grötschla

Identification and extraction of singing voice from within musical mixtures is a key challenge in source separation and machine audition. Recently, deep neural networks (DNN) have been used to estimate 'ideal' binary masks for carefully…

Sound · Computer Science 2015-04-21 Andrew J. R. Simpson , Gerard Roma , Mark D. Plumbley

Previous approaches in singer identification have used one of monophonic vocal tracks or mixed tracks containing multiple instruments, leaving a semantic gap between these two domains of audio. In this paper, we present a system to learn a…

Sound · Computer Science 2019-06-27 Kyungyun Lee , Juhan Nam

Deep learning techniques for separating audio into different sound sources face several challenges. Standard architectures require training separate models for different types of audio sources. Although some universal separators employ a…

Sound · Computer Science 2022-02-15 Ke Chen , Xingjian Du , Bilei Zhu , Zejun Ma , Taylor Berg-Kirkpatrick , Shlomo Dubnov

Extracting individual elements from music mixtures is a valuable tool for music production and practice. While neural networks optimized to mask or transform mixture spectrograms into the individual source(s) have been the leading approach,…

Sound · Computer Science 2025-11-26 Genís Plaja-Roglans , Yun-Ning Hung , Xavier Serra , Igor Pereira

Universal source separation (USS) is a fundamental research task for computational auditory scene analysis, which aims to separate mono recordings into individual source tracks. There are three potential challenges awaiting the solution to…

In music source separation, a standard training data augmentation procedure is to create new training samples by randomly combining instrument stems from different songs. These random mixes have mismatched characteristics compared to real…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-29 Chang-Bin Jeon , Gordon Wichern , François G. Germain , Jonathan Le Roux

This paper presents a novel method for extracting the vocal track from a musical mixture. The musical mixture consists of a singing voice and a backing track which may comprise of various instruments. We use a convolutional network with…

Sound · Computer Science 2020-02-13 Pritish Chandna , Merlijn Blaauw , Jordi Bonada , Emilia Gomez

In this paper, we study whether music source separation can be used as a pre-training strategy for music representation learning, targeted at music classification tasks. To this end, we first pre-train U-Net networks under various music…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-24 Christos Garoufis , Athanasia Zlatintsi , Petros Maragos

In this paper, we propose a simple yet effective method for multiple music source separation using convolutional neural networks. Stacked hourglass network, which was originally designed for human pose estimation in natural images, is…

Sound · Computer Science 2018-06-25 Sungheon Park , Taehoon Kim , Kyogu Lee , Nojun Kwak

Recent years have witnessed the success of deep learning on the visual sound separation task. However, existing works follow similar settings where the training and testing datasets share the same musical instrument categories, which to…

Multimedia · Computer Science 2022-03-28 Xinchi Zhou , Dongzhan Zhou , Wanli Ouyang , Hang Zhou , Ziwei Liu , Di Hu

Training neural networks for source separation involves presenting a mixture recording at the input of the network and updating network parameters in order to produce an output that resembles the clean source. Consequently, supervised…

Sound · Computer Science 2019-05-10 Shrikant Venkataramani , Efthymios Tzinis , Paris Smaragdis

Most music source separation systems require large collections of isolated sources for training, which can be difficult to obtain. In this work, we use musical scores, which are comparatively easy to obtain, as a weak label for training a…

Sound · Computer Science 2020-10-23 Yun-Ning Hung , Gordon Wichern , Jonathan Le Roux

Deep learning-based music source separation has gained a lot of interest in the last decades. Most of the existing methods operate with either spectrograms or waveforms. Spectrogram based models learn suitable masks for separating magnitude…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-10 Chin-Yun Yu , Kin-Wai Cheuk

Music source separation has been intensively studied in the last decade and tremendous progress with the advent of deep learning could be observed. Evaluation campaigns such as MIREX or SiSEC connected state-of-the-art models and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-24 Yuki Mitsufuji , Giorgio Fabbro , Stefan Uhlich , Fabian-Robert Stöter , Alexandre Défossez , Minseok Kim , Woosung Choi , Chin-Yun Yu , Kin-Wai Cheuk

This paper deals with the problem of audio source separation. To handle the complex and ill-posed nature of the problems of audio source separation, the current state-of-the-art approaches employ deep neural networks to obtain instrumental…

Sound · Computer Science 2017-06-30 Naoya Takahashi , Yuki Mitsufuji