English
Related papers

Related papers: Generative Moment Matching Networks

200 papers

Generative adversarial networks (GANs) generate data based on minimizing a divergence between two distributions. The choice of that divergence is therefore critical. We argue that the divergence must take into account the hypothesis set and…

Machine Learning · Computer Science 2019-11-07 Ben Adlam , Corinna Cortes , Mehryar Mohri , Ningshan Zhang

The Generative Adversarial Network (GAN) has achieved great success in generating realistic (real-valued) synthetic data. However, convergence issues and difficulties dealing with discrete data hinder the applicability of GAN to text. We…

Machine Learning · Statistics 2017-11-21 Yizhe Zhang , Zhe Gan , Kai Fan , Zhi Chen , Ricardo Henao , Dinghan Shen , Lawrence Carin

Developments in deep generative models have allowed for tractable learning of high-dimensional data distributions. While the employed learning procedures typically assume that training data is drawn i.i.d. from the distribution of interest,…

Machine Learning · Computer Science 2017-05-24 Ari Seff , Alex Beatson , Daniel Suo , Han Liu

We propose a gradient flow procedure for generative modeling by transporting particles from an initial source distribution to a target distribution, where the gradient field on the particles is given by a noise-adaptive Wasserstein Gradient…

Machine Learning · Computer Science 2024-05-14 Alexandre Galashov , Valentin de Bortoli , Arthur Gretton

We propose MAD-GAN, an intuitive generalization to the Generative Adversarial Networks (GANs) and its conditional variants to address the well known problem of mode collapse. First, MAD-GAN is a multi-agent GAN architecture incorporating…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Arnab Ghosh , Viveka Kulharia , Vinay Namboodiri , Philip H. S. Torr , Puneet K. Dokania

We explore a data-driven approach for learning to optimize neural networks. We construct a dataset of neural network checkpoints and train a generative model on the parameters. In particular, our model is a conditional diffusion transformer…

Machine Learning · Computer Science 2022-09-27 William Peebles , Ilija Radosavovic , Tim Brooks , Alexei A. Efros , Jitendra Malik

Generative adversarial networks (GANs) have achieved significant success in generating real-valued data. However, the discrete nature of text hinders the application of GAN to text-generation tasks. Instead of using the standard GAN…

Computation and Language · Computer Science 2020-08-13 Liqun Chen , Shuyang Dai , Chenyang Tao , Dinghan Shen , Zhe Gan , Haichao Zhang , Yizhe Zhang , Lawrence Carin

We present a new "learning-to-learn"-type approach that enables rapid learning of concepts from small-to-medium sized training sets and is primarily designed for web-initialized image retrieval. At the core of our approach is a deep…

Computer Vision and Pattern Recognition · Computer Science 2017-10-30 A. Vakhitov , A. Kuzmin , V. Lempitsky

In recent years, Generative Adversarial Networks (GANs) have drawn a lot of attentions for learning the underlying distribution of data in various applications. Despite their wide applicability, training GANs is notoriously difficult. This…

Machine Learning · Computer Science 2019-04-23 Babak Barazandeh , Meisam Razaviyayn , Maziar Sanjabi

Graph generative models are a highly active branch of machine learning. Given the steady development of new models of ever-increasing complexity, it is necessary to provide a principled way to evaluate and compare them. In this paper, we…

Machine Learning · Computer Science 2022-03-21 Leslie O'Bray , Max Horn , Bastian Rieck , Karsten Borgwardt

Generative Adversarial Networks (GANs) have been shown to produce realistically looking synthetic images with remarkable success, yet their performance seems less impressive when the training set is highly diverse. In order to provide a…

Machine Learning · Computer Science 2018-08-31 Matan Ben-Yosef , Daphna Weinshall

Generative Adversarial Networks (GANs) are a powerful framework for deep generative modeling. Posed as a two-player minimax problem, GANs are typically trained end-to-end on real-valued data and can be used to train a generator of…

Machine Learning · Statistics 2017-11-15 Anirudh Goyal , Nan Rosemary Ke , Alex Lamb , R Devon Hjelm , Chris Pal , Joelle Pineau , Yoshua Bengio

Generative Adversarial Networks (GANs) are a recent advancement in unsupervised machine learning. They are a cat-and-mouse game between two neural networks: [1] a discriminator network which learns to validate whether a sample is real or…

Cosmology and Nongalactic Astrophysics · Physics 2020-06-23 Olivia Curtis , Tereasa G. Brainerd

Generative Adversarial Networks (GAN) (Goodfellow et al., 2014) are an effective method for training generative models of complex data such as natural images. However, they are notoriously hard to train and can suffer from the problem of…

A generative adversarial network (GAN) is a class of machine learning frameworks designed by Goodfellow et al. in 2014. In the GAN framework, the generative model is pitted against an adversary: a discriminative model that learns to…

Machine Learning · Computer Science 2022-10-13 Lan V. Truong

Generative Adversarial Networks have become one of the most studied frameworks for unsupervised learning due to their intuitive formulation. They have also been shown to be capable of generating convincing examples in limited domains, such…

Machine Learning · Computer Science 2016-12-14 Daniel Jiwoong Im , He Ma , Chris Dongjoo Kim , Graham Taylor

Training even moderately-sized generative models with differentially-private stochastic gradient descent (DP-SGD) is difficult: the required level of noise for reasonable levels of privacy is simply too large. We advocate instead building…

Machine Learning · Statistics 2023-07-21 Fredrik Harder , Milad Jalali Asadabadi , Danica J. Sutherland , Mijung Park

Generative source separation methods such as non-negative matrix factorization (NMF) or auto-encoders, rely on the assumption of an output probability density. Generative Adversarial Networks (GANs) can learn data distributions without…

Sound · Computer Science 2017-10-31 Cem Subakan , Paris Smaragdis

We present variational generative adversarial networks, a general learning framework that combines a variational auto-encoder with a generative adversarial network, for synthesizing images in fine-grained categories, such as faces of a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Jianmin Bao , Dong Chen , Fang Wen , Houqiang Li , Gang Hua

Perceptual features (PFs) have been used with great success in tasks such as transfer learning, style transfer, and super-resolution. However, the efficacy of PFs as key source of information for learning generative models is not well…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Cicero Nogueira dos Santos , Youssef Mroueh , Inkit Padhi , Pierre Dognin