English
Related papers

Related papers: Maximum Discrepancy Generative Regularization and …

200 papers

Generative Adversarial Networks (GANs) have been shown to be powerful and flexible priors when solving inverse problems. One challenge of using them is overcoming representation error, the fundamental limitation of the network in…

Machine Learning · Computer Science 2022-04-12 Sean Gunn , Jorio Cocola , Paul Hand

This paper first presents a theory for generative adversarial methods that does not rely on the traditional minimax formulation. It shows that with a strong discriminator, a good generator can be learned so that the KL divergence between…

Machine Learning · Statistics 2018-06-11 Rie Johnson , Tong Zhang

Nonnegative matrix factorization (NMF) is widely used for clustering with strong interpretability. Among general NMF problems, symmetric NMF is a special one that plays an important role in graph clustering where each element measures the…

Machine Learning · Computer Science 2023-11-07 Mengyuan Zhang , Kai Liu

There has been a recent critical need to study fairness and bias in machine learning (ML) algorithms. Since there is clearly no one-size-fits-all solution to fairness, ML methods should be developed alongside bias mitigation strategies that…

Machine Learning · Computer Science 2026-03-06 Lara Kassab , Erin George , Deanna Needell , Haowen Geng , Nika Jafar Nia , Aoxi Li

In this work, we consider nonnegative matrix factorization (NMF) with a regularization that promotes small volume of the convex hull spanned by the basis matrix. We present highly efficient algorithms for three different volume…

Numerical Analysis · Computer Science 2020-01-14 M. S. Ang , Nicolas Gillis

Symmetric nonnegative matrix factorization (NMF), a special but important class of the general NMF, is demonstrated to be useful for data analysis and in particular for various clustering tasks. Unfortunately, designing fast algorithms for…

Machine Learning · Computer Science 2018-11-15 Zhihui Zhu , Xiao Li , Kai Liu , Qiuwei Li

Nonnegative Matrix Factorization (NMF) is a powerful tool for decomposing mixtures of audio signals in the Time-Frequency (TF) domain. In applications such as source separation, the phase recovery for each extracted component is a major…

Sound · Computer Science 2016-11-17 Paul Magron , Roland Badeau , Bertrand David

Considering a mixed signal composed of various audio sources and recorded with a single microphone, we consider on this paper the blind audio source separation problem which consists in isolating and extracting each of the sources. To…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Valentin Leplat , Nicolas Gillis , Man Shun Ang

Deep generative models can learn to generate realistic-looking images, but many of the most effective methods are adversarial and involve a saddlepoint optimization, which requires a careful balancing of training between a generator network…

Machine Learning · Statistics 2020-02-18 Akash Srivastava , Kai Xu , Michael U. Gutmann , Charles Sutton

Non-negative matrix factorization (NMF) has become a popular method for representing meaningful data by extracting a non-negative basis feature from an observed non-negative data matrix. Some of the unique features of this method in…

Optimization and Control · Mathematics 2022-11-15 Sajad Fathi Hafshejani , Zahra Moaberfard

Non-negative matrix factorization (NMF) is a fundamental non-convex optimization problem with numerous applications in Machine Learning (music analysis, document clustering, speech-source separation etc). Despite having received extensive…

Machine Learning · Computer Science 2020-03-20 Ioannis Panageas , Stratis Skoulakis , Antonios Varvitsiotis , Xiao Wang

We propose a new variant of nonnegative matrix factorization (NMF), combining separability and sparsity assumptions. Separability requires that the columns of the first NMF factor are equal to columns of the input matrix, while sparsity…

Machine Learning · Computer Science 2020-06-16 Nicolas Nadisic , Arnaud Vandaele , Jeremy E. Cohen , Nicolas Gillis

While Generative Adversarial Networks (GANs) are fundamental to many generative modelling applications, they suffer from numerous issues. In this work, we propose a principled framework to simultaneously mitigate two fundamental issues in…

Machine Learning · Computer Science 2020-11-24 Kwot Sin Lee , Ngoc-Trung Tran , Ngai-Man Cheung

Nonnegative matrix factorization (NMF) has become a very popular technique in machine learning because it automatically extracts meaningful features through a sparse and part-based representation. However, NMF has the drawback of being…

Machine Learning · Statistics 2012-12-07 Nicolas Gillis

Although many techniques have been applied to matrix factorization (MF), they may not fully exploit the feature structure. In this paper, we incorporate the grouping effect into MF and propose a novel method called Robust Matrix…

Machine Learning · Computer Science 2021-07-09 Haiyan Jiang , Shuyu Li , Luwei Zhang , Haoyi Xiong , Dejing Dou

We propose a method to optimize the representation and distinguishability of samples from two probability distributions, by maximizing the estimated power of a statistical test based on the maximum mean discrepancy (MMD). This optimized MMD…

Proposed in 2014, Generative Adversarial Networks (GAN) initiated a fresh interest in generative modelling. They immediately achieved state-of-the-art in image synthesis, image-to-image translation, text-to-image generation, image…

Information Retrieval · Computer Science 2022-01-21 Ervin Dervishaj , Paolo Cremonesi

We present a novel method and analysis to train generative adversarial networks (GAN) in a stable manner. As shown in recent analysis, training is often undermined by the probability distribution of the data being zero on neighborhoods of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Simon Jenni , Paolo Favaro

Nonnegative matrix factorization (NMF) is a popular method used to reduce dimensionality in data sets whose elements are nonnegative. It does so by decomposing the data set of interest, $\mathbf{X}$, into two lower rank nonnegative matrices…

Methodology · Statistics 2021-07-05 Phillip Shreeves , Jeffrey L. Andrews , Xinchen Deng , Ramie Ali-Adeeb , Andrew Jirasek

This paper describes a versatile method that accelerates multichannel source separation methods based on full-rank spatial modeling. A popular approach to multichannel source separation is to integrate a spatial model with a source model…

Sound · Computer Science 2019-03-11 Kouhei Sekiguchi , Aditya Arie Nugraha , Yoshiaki Bando , Kazuyoshi Yoshii