English
Related papers

Related papers: Meta-learning Extractors for Music Source Separati…

200 papers

In some DNNs for audio source separation, the relevant model parameters are independent of the sampling frequency of the audio used for training. Considering the application of dialogue separation, this is shown for two DNN architectures: a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-07 Jouni Paulus , Matteo Torcoli

Harmonic/percussive source separation (HPSS) consists in separating the pitched instruments from the percussive parts in a music mixture. In this paper, we propose to apply the recently introduced Masker-Denoiser with twin networks (MaD…

Text-to-music generation models are now capable of generating high-quality music audio in broad styles. However, text control is primarily suitable for the manipulation of global musical attributes like genre, mood, and tempo, and is less…

Sound · Computer Science 2023-11-14 Shih-Lun Wu , Chris Donahue , Shinji Watanabe , Nicholas J. Bryan

In deep learning research, many melody extraction models rely on redesigning neural network architectures to improve performance. In this paper, we propose an input feature modification and a training objective modification based on two…

Sound · Computer Science 2023-08-08 Keren Shao , Ke Chen , Taylor Berg-Kirkpatrick , Shlomo Dubnov

Extracting pitch information from music recordings is a challenging but important problem in music signal processing. Frame-wise transcription or multi-pitch estimation aims for detecting the simultaneous activity of pitches in polyphonic…

Sound · Computer Science 2022-02-21 Christof Weiß , Geoffroy Peeters

In-context learning enables transformer models to generalize to new tasks based solely on input prompts, without any need for weight updates. However, existing training paradigms typically rely on large, unstructured datasets that are…

We introduce a new paradigm for single-channel target source separation where the sources of interest can be distinguished using non-mutually exclusive concepts (e.g., loudness, gender, language, spatial location, etc). Our proposed…

Unsupervised outlier detection is attractive because it eliminates the need for labeled data. Moreover, forming multi-model ensembles can improve detection robustness. However, composing an ensemble without labeled data is challenging.…

Machine Learning · Computer Science 2026-05-19 Hong-Phuc Phan , Tuan-Anh Vu , Tung Kieu , Son Ha Xuan , Bin Yang , Christian S. Jensen

State-of-the-art under-determined audio source separation systems rely on supervised end-end training of carefully tailored neural network architectures operating either in the time or the spectral domain. However, these methods are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-29 Vivek Narayanaswamy , Jayaraman J. Thiagarajan , Rushil Anirudh , Andreas Spanias

The objective of deep learning methods based on encoder-decoder architectures for music source separation is to approximate either ideal time-frequency masks or spectral representations of the target music source(s). The spectral…

The sound identification of refactoring opportunities is still an open problem in software engineering. Recent studies have shown the effectiveness of machine learning models in recommending methods that should undergo different refactoring…

Software Engineering · Computer Science 2021-07-23 David van der Leij , Jasper Binda , Robbert van Dalen , Pieter Vallen , Yaping Luo , Maurício Aniche

Training models to high-end performance requires availability of large labeled datasets, which are expensive to get. The goal of our work is to automatically synthesize labeled datasets that are relevant for a downstream task. We propose…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Amlan Kar , Aayush Prakash , Ming-Yu Liu , Eric Cameracci , Justin Yuan , Matt Rusiniak , David Acuna , Antonio Torralba , Sanja Fidler

Transfer learning is a common practice that alleviates the need for extensive data to train neural networks. It is performed by pre-training a model using a source dataset and fine-tuning it for a target task. However, not every source…

Machine Learning · Computer Science 2024-10-01 Jiseok Lee , Brian Kenji Iwana

The remarkable ability of humans to selectively focus on a target speaker in cocktail party scenarios is facilitated by binaural audio processing. In this paper, we present a binaural time-domain Target Speaker Extraction model based on the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-19 Hanyu Meng , Qiquan Zhang , Xiangyu Zhang , Vidhyasaharan Sethu , Eliathamby Ambikairajah

In recent years, music source separation has been one of the most intensively studied research areas in music information retrieval. Improvements in deep learning lead to a big progress in music source separation performance. However, most…

Sound · Computer Science 2019-08-20 Jie Hwan Lee , Hyeong-Seok Choi , Kyogu Lee

Most machine learning models for audio tasks are dealing with a handcrafted feature, the spectrogram. However, it is still unknown whether the spectrogram could be replaced with deep learning based features. In this paper, we answer this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-20 Zhaoyang Bu , Hanhaodi Zhang , Xiaohu Zhu

We propose a new method for separating superimposed sources using diffusion-based generative models. Our method relies only on separately trained statistical priors of independent sources to establish a new objective function guided by…

Machine Learning · Computer Science 2024-01-18 Tejas Jayashankar , Gary C. F. Lee , Alejandro Lancho , Amir Weiss , Yury Polyanskiy , Gregory W. Wornell

Task-agnostic knowledge distillation, a teacher-student framework, has been proved effective for BERT compression. Although achieving promising results on NLP tasks, it requires enormous computational resources. In this paper, we propose…

Computation and Language · Computer Science 2021-04-27 Cheng Chen , Yichun Yin , Lifeng Shang , Zhi Wang , Xin Jiang , Xiao Chen , Qun Liu

Recently, several very effective neural approaches for single-channel speech separation have been presented in the literature. However, due to the size and complexity of these models, their use on low-resource devices, e.g. for hearing…

Sound · Computer Science 2023-03-07 Mohamed Nabih Ali , Francesco Paissan , Daniele Falavigna , Alessio Brutti

Audio source separation is the process of separating a mixture (e.g. a pop band recording) into isolated sounds from individual sources (e.g. just the lead vocals). Deep learning models are the state-of-the-art in source separation, given…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Alisa Liu , Prem Seetharaman , Bryan Pardo