English
Related papers

Related papers: Weakly Supervised Audio Source Separation via Spec…

200 papers

We extend frequency-domain blind source separation based on independent vector analysis to the case where there are more microphones than sources. The signal is modelled as non-Gaussian sources in a Gaussian background. The proposed…

Sound · Computer Science 2019-08-08 Robin Scheibler , Nobutaka Ono

Audio source separation is often achieved by estimating the magnitude spectrogram of each source, and then applying a phase recovery (or spectrogram inversion) algorithm to retrieve time-domain signals. Typically, spectrogram inversion is…

Sound · Computer Science 2023-07-03 Paul Magron , Tuomas Virtanen

Speech synthesis is an important practical generative modeling problem that has seen great progress over the last few years, with likelihood-based autoregressive neural models now outperforming traditional concatenative systems. A downside…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-26 Alexey A. Gritsenko , Tim Salimans , Rianne van den Berg , Jasper Snoek , Nal Kalchbrenner

We propose a novel Wasserstein method with a distillation mechanism, yielding joint learning of word embeddings and topics. The proposed method is based on the fact that the Euclidean distance between word embeddings may be employed as the…

Machine Learning · Computer Science 2018-09-14 Hongteng Xu , Wenlin Wang , Wei Liu , Lawrence Carin

The objective of this paper is to perform audio-visual sound source separation, i.e.~to separate component audios from a mixture based on the videos of sound sources. Moreover, we aim to pinpoint the source location in the input video…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Lingyu Zhu , Esa Rahtu

In this article, we generalize the Wasserstein distance to measures with different masses. We study the properties of such distance. In particular, we show that it metrizes weak convergence for tight sequences. We use this generalized…

Analysis of PDEs · Mathematics 2015-06-05 Benedetto Piccoli , Francesco Rossi

Recently, researches related to unsupervised disentanglement learning with deep generative models have gained substantial popularity. However, without introducing supervision, there is no guarantee that the factors of interest can be…

Machine Learning · Computer Science 2020-03-13 Junxiang Chen , Kayhan Batmanghelich

Fake audio attack becomes a major threat to the speaker verification system. Although current detection approaches have achieved promising results on dataset-specific scenarios, they encounter difficulties on unseen spoofing data.…

Sound · Computer Science 2022-07-12 Haoxin Ma , Jiangyan Yi , Jianhua Tao , Ye Bai , Zhengkun Tian , Chenglong Wang

We propose a knowledge-driven, model-based approach to segmenting audio into single-category and mixed-category chunks with applications to source separation. "Knowledge" here denotes information associated with the data, such as music…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-26 Chun-wei Ho , Sabato Marco Siniscalchi , Kai Li , Chin-Hui Lee

Audio content analysis in terms of sound events is an important research problem for a variety of applications. Recently, the development of weak labeling approaches for audio or sound event detection (AED) and availability of large scale…

Sound · Computer Science 2018-04-26 Ankit Shah , Anurag Kumar , Alexander G. Hauptmann , Bhiksha Raj

Weakly-supervised learning has attracted growing research attention on medical lesions segmentation due to significant saving in pixel-level annotation cost. However, 1) most existing methods require effective prior and constraints to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Jiahua Dong , Yang Cong , Gan Sun , Yunsheng Yang , Xiaowei Xu , Zhengming Ding

We investigate which loss functions provide better separations via benchmarking an extensive set of those for music source separation. To that end, we first survey the most representative audio source separation losses we identified, to…

Sound · Computer Science 2022-02-17 Enric Gusó , Jordi Pons , Santiago Pascual , Joan Serrà

Separating two sources from an audio mixture is an important task with many applications. It is a challenging problem since only one signal channel is available for analysis. In this paper, we propose a novel framework for singing voice…

Sound · Computer Science 2017-11-15 Zhe-Cheng Fan , Yen-Lin Lai , Jyh-Shing Roger Jang

Current weakly supervised semantic segmentation (WSSS) frameworks usually contain the separated mask-refinement model and the main semantic region mining model. These approaches would contain redundant feature extraction backbones and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Dingwen Zhang , Wenyuan Zeng , Guangyu Guo , Chaowei Fang , Lechao Cheng , Ming-Ming Cheng , Junwei Han

Our objective is to transform a video into a set of discrete audio-visual objects using self-supervised learning. To this end, we introduce a model that uses attention to localize and group sound sources, and optical flow to aggregate…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Triantafyllos Afouras , Andrew Owens , Joon Son Chung , Andrew Zisserman

Audio source separation aims to separate a mixture into target sources. Previous audio source separation systems usually conduct one-step inference, which does not fully explore the separation ability of models. In this work, we reveal that…

Sound · Computer Science 2025-05-27 Yongyi Zang , Jingyi Li , Qiuqiang Kong

We study the ability of Wasserstein Generative Adversarial Network (WGAN) to generate missing audio content which is, in context, (statistically similar) to the sound and the neighboring borders. We deal with the challenge of audio…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-18 P. P. Ebner , A. Eltelt

Generative Adversarial Networks (GANs) have been used to model the underlying probability distribution of sample based datasets. GANs are notoriuos for training difficulties and their dependence on arbitrary hyperparameters. One recent…

Machine Learning · Computer Science 2019-10-03 Thomas Pinetz , Daniel Soukup , Thomas Pock

Object density reconstruction from projections containing scattered radiation and noise is of critical importance in many applications. Existing scatter correction and density reconstruction methods may not provide the high accuracy needed…

Image and Video Processing · Electrical Eng. & Systems 2022-04-28 Zhishen Huang , Marc Klasky , Trevor Wilcox , Saiprasad Ravishankar

The recommender systems have long been investigated in the literature. Recently, users' implicit feedback like `click' or `browse' are considered to be able to enhance the recommendation performance. Therefore, a number of attempts have…

Information Retrieval · Computer Science 2019-04-09 Jingbin Zhong , Xiaofeng Zhang