English
Related papers

Related papers: Learned complex masks for multi-instrument source …

200 papers

This work proposes a learnable filterbank based on a multi-channel masking framework for multi-channel source separation. The learnable filterbank is a 1D Conv layer, which transforms the raw waveform into a 2D representation. In contrast…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-15 Wang Dai , Archontis Politis , Tuomas Virtanen

Time-frequency audio source separation is usually achieved by estimating the short-time Fourier transform (STFT) magnitude of each source, and then applying a phase recovery algorithm to retrieve time-domain signals. In particular, the…

Sound · Computer Science 2021-02-10 Paul Magron , Pierre-Hugo Vial , Thomas Oberlin , Cédric Févotte

This paper proposes a novel framework for unsupervised audio source separation using a deep autoencoder. The characteristics of unknown source signals mixed in the mixed input is automatically by properly configured autoencoders implemented…

Sound · Computer Science 2014-12-24 Giljin Jang , Han-Gyu Kim , Yung-Hwan Oh

We introduce a framework for audio source separation using embeddings on a hyperbolic manifold that compactly represent the hierarchical relationship between sound sources and time-frequency features. Inspired by recent successes modeling…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-12 Darius Petermann , Gordon Wichern , Aswin Subramanian , Jonathan Le Roux

This paper presents a novel approach to sound source separation that leverages spatial information obtained during the recording setup. Our method trains a spatial mixing filter using solo passages to capture information about the room…

In most current approaches of speech processing, information is extracted from the magnitude spectrum. However recent perceptual studies have underlined the importance of the phase component. The goal of this paper is to investigate the…

Sound · Computer Science 2020-01-03 Thomas Drugman , Thomas Dubuisson , Thierry Dutoit

Estimating audio and musical signals from single channel mixtures often, if not always, involves a transformation of the mixture signal to the time-frequency (T-F) domain in which a masking operation takes place. Masking is realized as an…

Sound · Computer Science 2017-06-16 Stylianos Ioannis Mimilakis , Gerald Schuller

Current generative models are able to generate high-quality artefacts but have been shown to struggle with compositional reasoning, which can be defined as the ability to generate complex structures from simpler elements. In this paper, we…

Machine Learning · Computer Science 2024-08-20 Giovanni Bindi , Philippe Esling

To achieve a flexible recommendation and retrieval system, it is desirable to calculate music similarity by focusing on multiple partial elements of musical pieces and allowing the users to select the element they want to focus on. A…

Sound · Computer Science 2024-04-11 Yuka Hashizume , Li Li , Atsushi Miyashita , Tomoki Toda

Audio source separation is the process of separating a mixture (e.g. a pop band recording) into isolated sounds from individual sources (e.g. just the lead vocals). Deep learning models are the state-of-the-art in source separation, given…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Alisa Liu , Prem Seetharaman , Bryan Pardo

In music source separation, a standard training data augmentation procedure is to create new training samples by randomly combining instrument stems from different songs. These random mixes have mismatched characteristics compared to real…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-29 Chang-Bin Jeon , Gordon Wichern , François G. Germain , Jonathan Le Roux

Music source separation is a core task in music information retrieval which has seen a dramatic improvement in the past years. Nevertheless, most of the existing systems focus exclusively on the problem of source separation itself and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Yun-Ning Hung , Alexander Lerch

We propose a new blind source separation algorithm based on mixtures of alpha-stable distributions. Complex symmetric alpha-stable distributions have been recently showed to better model audio signals in the time-frequency domain than…

Machine Learning · Statistics 2018-02-13 Nicolas Keriven , Antoine Deleforge , Antoine Liutkus

We extend frequency-domain blind source separation based on independent vector analysis to the case where there are more microphones than sources. The signal is modelled as non-Gaussian sources in a Gaussian background. The proposed…

Sound · Computer Science 2019-08-08 Robin Scheibler , Nobutaka Ono

Music source separation (MSS) is the task of separating a music piece into individual sources, such as vocals and accompaniment. Recently, neural network based methods have been applied to address the MSS problem, and can be categorized…

Sound · Computer Science 2021-02-22 Xuchen Song , Qiuqiang Kong , Xingjian Du , Yuxuan Wang

In this paper, we address a multichannel audio source separation task and propose a new efficient method called independent deeply learned matrix analysis (IDLMA). IDLMA estimates the demixing matrix in a blind manner and updates the…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-28 Shinichi Mogami , Hayato Sumino , Daichi Kitamura , Norihiro Takamune , Shinnosuke Takamichi , Hiroshi Saruwatari , Nobutaka Ono

A mixed sample data augmentation strategy is proposed to enhance the performance of models on audio scene classification, sound event classification, and speech enhancement tasks. While there have been several augmentation methods shown to…

Sound · Computer Science 2021-08-09 Gwantae Kim , David K. Han , Hanseok Ko

Blind music source separation has been a popular and active subject of research in both the music information retrieval and signal processing communities. To counter the lack of available multi-track data for supervised model training, a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Ching-Yu Chiu , Wen-Yi Hsiao , Yin-Cheng Yeh , Yi-Hsuan Yang , Alvin Wen-Yu Su

Separating vocal elements from musical tracks is a longstanding challenge in audio signal processing. This study tackles the distinct separation of vocal components from musical spectrograms. We employ the Short Time Fourier Transform…

Sound · Computer Science 2024-05-31 Adam Sorrenti

Sound source separation has attracted attention from Music Information Retrieval(MIR) researchers, since it is related to many MIR tasks such as automatic lyric transcription, singer identification, and voice conversion. In this paper, we…

Sound · Computer Science 2018-10-31 Jaehoon Oh , Duyeon Kim , Se-Young Yun