English
Related papers

Related papers: Music Source Separation Based on a Lightweight Dee…

200 papers

We introduce the Free Universal Sound Separation (FUSS) dataset, a new corpus for experiments in separating mixtures of an unknown number of sounds from an open domain of sound types. The dataset consists of 23 hours of single-source audio…

Monaural singing voice separation task focuses on the prediction of the singing voice from a single channel music mixture signal. Current state of the art (SOTA) results in monaural singing voice separation are obtained with deep learning…

We present a new approach and a novel architecture, termed WSNet, for learning compact and efficient deep neural networks. Existing approaches conventionally learn full model parameters independently and then compress them via ad hoc…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Xiaojie Jin , Yingzhen Yang , Ning Xu , Jianchao Yang , Nebojsa Jojic , Jiashi Feng , Shuicheng Yan

Recent advancements in deep learning have led to drastic improvements in speech segregation models. Despite their success and growing applicability, few efforts have been made to analyze the underlying principles that these networks learn…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-10 Rahil Parikh , Ilya Kavalerov , Carol Espy-Wilson , Shihab Shamma

Target speaker extraction focuses on extracting a target speech signal from an environment with multiple speakers by leveraging an enrollment. Existing methods predominantly rely on speaker embeddings obtained from the enrollment,…

Sound · Computer Science 2025-02-13 Ke Xue , Rongfei Fan , Shanping Yu , Chang Sun , Jianping An

Sub-band models have achieved promising results due to their ability to model local patterns in the spectrogram. Some studies further improve the performance by fusing sub-band and full-band information. However, the structure for the…

Sound · Computer Science 2022-01-26 Feng Dang , Hangting Chen , Pengyuan Zhang

In this paper we propose a method for separation of moving sound sources. The method is based on first tracking the sources and then estimation of source spectrograms using multichannel non-negative matrix factorization (NMF) and extracting…

Sound · Computer Science 2017-10-30 Joonas Nikunen , Aleksandr Diment , Tuomas Virtanen

In this work, we propose the Sparse Multi-Family Deep Scattering Network (SMF-DSN), a novel architecture exploiting the interpretability of the Deep Scattering Network (DSN) and improving its expressive power. The DSN extracts salient and…

Machine Learning · Statistics 2020-12-15 Romain Cosentino , Randall Balestriero

Conditioned source separations have attracted significant attention because of their flexibility, applicability and extensionality. Their performance was usually inferior to the existing approaches, such as the single source separation…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-27 Yeong-Seok Jeong , Jinsung Kim , Woosung Choi , Jaehwa Chung , Soonyoung Jung

The instantaneous underdetermined audio source separation problem of K-sensors, L-sources mixing scenario (where K < L) has been addressed by many different approaches, provided the sources remain quite distinct in the virtual positioning…

Sound · Computer Science 2017-08-17 Thomas Sgouros , Nikolaos Mitianoudis

A natural question arising in Music Source Separation (MSS) is whether long range contextual information is useful, or whether local acoustic features are sufficient. In other fields, attention based Transformers have shown their ability to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-17 Simon Rouard , Francisco Massa , Alexandre Défossez

In this paper, we propose a two-step training procedure for source separation via a deep neural network. In the first step we learn a transform (and it's inverse) to a latent space where masking-based separation performance using oracles is…

Machine Learning · Computer Science 2021-05-12 Efthymios Tzinis , Shrikant Venkataramani , Zhepei Wang , Cem Subakan , Paris Smaragdis

Multi-Source Diffusion Models (MSDM) allow for compositional musical generation tasks: generating a set of coherent sources, creating accompaniments, and performing source separation. Despite their versatility, they require estimating the…

Sound · Computer Science 2024-03-19 Emilian Postolache , Giorgio Mariani , Luca Cosmo , Emmanouil Benetos , Emanuele Rodolà

In many signal processing applications, metadata may be advantageously used in conjunction with a high dimensional signal to produce a desired output. In the case of classical Sound Source Localization (SSL) algorithms, information from a…

Sound · Computer Science 2023-08-09 Eric Grinstein , Vincent W. Neo , Patrick A. Naylor

Existing deep learning based methods effectively prompt the performance of aerial scene classification. However, due to the large amount of parameters and computational cost, it is rather difficult to apply these methods to multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jingjun Yi , Beichen Zhou

In this paper we propose an efficient deep learning encoder-decoder network for performing Harmonic-Percussive Source Separation (HPSS). It is shown that we are able to greatly reduce the number of model trainable parameters by using a…

Sound · Computer Science 2019-07-31 Carlos Lordelo , Emmanouil Benetos , Simon Dixon , Sven Ahlbäck

Multi-task learning (MTL) is an efficient way to improve the performance of related tasks by sharing knowledge. However, most existing MTL networks run on a single end and are not suitable for collaborative intelligence (CI) scenarios. In…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Mengyang Wang , Zhicong Zhang , Jiahui Li , Mengyao Ma , Xiaopeng Fan

Single-channel, speaker-independent speech separation methods have recently seen great progress. However, the accuracy, latency, and computational cost of such methods remain insufficient. The majority of the previous methods have…

Sound · Computer Science 2019-05-16 Yi Luo , Nima Mesgarani

Recently, audio-visual separation approaches have taken advantage of the natural synchronization between the two modalities to boost audio source separation performance. They extracted high-level semantics from visual inputs as the guidance…

Sound · Computer Science 2024-07-08 Shentong Mo , Yapeng Tian

Recent progress in audio source separation lead by deep learning has enabled many neural network models to provide robust solutions to this fundamental estimation problem. In this study, we provide a family of efficient neural network…

Sound · Computer Science 2022-02-01 Efthymios Tzinis , Zhepei Wang , Xilin Jiang , Paris Smaragdis