English
Related papers

Related papers: Conditioned Source Separation for Music Instrument…

200 papers

Sound source separation has attracted attention from Music Information Retrieval(MIR) researchers, since it is related to many MIR tasks such as automatic lyric transcription, singer identification, and voice conversion. In this paper, we…

Sound · Computer Science 2018-10-31 Jaehoon Oh , Duyeon Kim , Se-Young Yun

With the recent advancements of data driven approaches using deep neural networks, music source separation has been formulated as an instrument-specific supervised problem. While existing deep learning models implicitly absorb the spatial…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-16 Darius Petermann , Minje Kim

Universal source separation targets at separating the audio sources of an arbitrary mix, removing the constraint to operate on a specific domain like speech or music. Yet, the potential of universal source separation is limited because most…

Sound · Computer Science 2023-10-03 Jordi Pons , Xiaoyu Liu , Santiago Pascual , Joan Serrà

Diffusion models have recently shown strong potential in both music generation and music source separation tasks. Although in early stages, a trend is emerging towards integrating these tasks into a single framework, as both involve…

Sound · Computer Science 2024-12-31 Tornike Karchkhadze , Mohammad Rasool Izadi , Shlomo Dubnov

We introduce a new paradigm for single-channel target source separation where the sources of interest can be distinguished using non-mutually exclusive concepts (e.g., loudness, gender, language, spatial location, etc). Our proposed…

We propose a method of separating a desired sound source from a single-channel mixture, based on either a textual description or a short audio sample of the target source. This is achieved by combining two distinct models. The first model,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-13 Kevin Kilgour , Beat Gfeller , Qingqing Huang , Aren Jansen , Scott Wisdom , Marco Tagliasacchi

Augmented listening devices such as hearing aids often perform poorly in noisy and reverberant environments with many competing sound sources. Large distributed microphone arrays can improve performance, but data from remote microphones…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-12 Ryan M. Corey , Matthew D. Skarha , Andrew C. Singer

Music mixing is compositional -- experts combine multiple audio processors to achieve a cohesive mix from dry source tracks. We propose a method to reverse engineer this process from the input and output audio. First, we create a mixing…

Multi-Source Diffusion Models (MSDM) allow for compositional musical generation tasks: generating a set of coherent sources, creating accompaniments, and performing source separation. Despite their versatility, they require estimating the…

Sound · Computer Science 2024-03-19 Emilian Postolache , Giorgio Mariani , Luca Cosmo , Emmanouil Benetos , Emanuele Rodolà

The problem of broadcasting a pair of correlated Gaussian sources using optimal separate source and channel codes is studied. Considerable performance gains over previously known separate source-channel schemes are observed. Although…

Information Theory · Computer Science 2011-05-10 Yang Gao , Ertem Tuncel

The audio source separation tasks, such as speech enhancement, speech separation, and music source separation, have achieved impressive performance in recent studies. The powerful modeling capabilities of deep neural networks give us hope…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-15 Lu Zhang , Chenxing Li , Feng Deng , Xiaorui Wang

Audio source separation is the task of isolating sound sources that are active simultaneously in a room captured by a set of microphones. Convolutive audio source separation of equal number of sources and microphones has a number of…

Sound · Computer Science 2018-11-27 Dimitrios Mallis , Thomas Sgouros , Nikolaos Mitianoudis

Upsampling artifacts are caused by problematic upsampling layers and due to spectral replicas that emerge while upsampling. Also, depending on the used upsampling layer, such artifacts can either be tonal artifacts (additive high-frequency…

Sound · Computer Science 2021-11-24 Jordi Pons , Joan Serrà , Santiago Pascual , Giulio Cengarle , Daniel Arteaga , Davide Scaini

We propose a knowledge-driven, model-based approach to segmenting audio into single-category and mixed-category chunks with applications to source separation. "Knowledge" here denotes information associated with the data, such as music…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-26 Chun-wei Ho , Sabato Marco Siniscalchi , Kai Li , Chin-Hui Lee

Music source separation (MSS) aims to extract individual instrument sources from their mixture. While most existing methods focus on the widely adopted four-stem separation setup (vocals, bass, drums, and other instruments), this approach…

Sound · Computer Science 2025-08-06 Yutong Wen , Minje Kim , Paris Smaragdis

Existing work on pitch and timbre disentanglement has been mostly focused on single-instrument music audio, excluding the cases where multiple instruments are presented. To fill the gap, we propose DisMix, a generative framework in which…

The task of manipulating the level and/or effects of individual instruments to recompose a mixture of recordings, or remixing, is common across a variety of applications such as music production, audio-visual post-production, podcasts, and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-25 Haici Yang , Shivani Firodiya , Nicholas J. Bryan , Minje Kim

A music mashup combines audio elements from two or more songs to create a new work. To reduce the time and effort required to make them, researchers have developed algorithms that predict the compatibility of audio elements. Prior work has…

Sound · Computer Science 2021-03-29 Jiawen Huang , Ju-Chiang Wang , Jordan B. L. Smith , Xuchen Song , Yuxuan Wang

Emulating the human ability to solve the cocktail party problem, i.e., focus on a source of interest in a complex acoustic scene, is a long standing goal of audio source separation research. Much of this research investigates separating…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-15 Darius Petermann , Gordon Wichern , Aswin Shanmugam Subramanian , Zhong-Qiu Wang , Jonathan Le Roux

In this paper we propose a conditioned UNet for Music Source Separation (MSS). MSS is generally performed by multi-output neural networks, typically UNets, with each output representing a particular stem from a predefined instrument…

Sound · Computer Science 2025-12-19 Ken O'Hanlon , Basil Woods , Lin Wang , Mark Sandler