English
Related papers

Related papers: On the Discrimination-Generalization Tradeoff in G…

200 papers

Generative adversarial networks (GANs) are a learning framework that rely on training a discriminator to estimate a measure of difference between a target and generated distributions. GANs, as normally formulated, rely on the generated…

Machine Learning · Statistics 2018-02-23 R Devon Hjelm , Athul Paul Jacob , Tong Che , Adam Trischler , Kyunghyun Cho , Yoshua Bengio

We show that training of generative adversarial network (GAN) may not have good generalization properties; e.g., training may appear successful but the trained distribution may be far from target distribution in standard metrics. However,…

Machine Learning · Computer Science 2017-08-03 Sanjeev Arora , Rong Ge , Yingyu Liang , Tengyu Ma , Yi Zhang

Generative adversarial networks (GANs) are powerful generative models, but usually suffer from instability and generalization problem which may lead to poor generations. Most existing works focus on stabilizing the training of the…

Machine Learning · Computer Science 2020-04-29 Shufei Zhang , Zhuang Qian , Kaizhu Huang , Jimin Xiao , Yuan He

Generative adversarial networks are a novel method for statistical inference that have achieved much empirical success; however, the factors contributing to this success remain ill-understood. In this work, we attempt to analyze generative…

Machine Learning · Computer Science 2018-09-13 Shuang Liu , Kamalika Chaudhuri

Training generative adversarial networks is unstable in high-dimensions as the true data distribution tends to be concentrated in a small fraction of the ambient space. The discriminator is then quickly able to classify nearly all generated…

Machine Learning · Computer Science 2018-06-26 Behnam Neyshabur , Srinadh Bhojanapalli , Ayan Chakrabarti

Generative adversarial networks (GANs) are a family of generative models that do not minimize a single training criterion. Unlike other generative models, the data distribution is learned via a game between a generator (the generative…

Generative adversarial networks (GANs) have been shown to produce realistic samples from high-dimensional distributions, but training them is considered hard. A possible explanation for training instabilities is the inherent imbalance…

Machine Learning · Statistics 2018-07-12 Mehdi S. M. Sajjadi , Giambattista Parascandolo , Arash Mehrjou , Bernhard Schölkopf

We present a novel method and analysis to train generative adversarial networks (GAN) in a stable manner. As shown in recent analysis, training is often undermined by the probability distribution of the data being zero on neighborhoods of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Simon Jenni , Paolo Favaro

Generative adversarial networks (GAN) approximate a target data distribution by jointly optimizing an objective function through a "two-player game" between a generator and a discriminator. Despite their empirical success, however, two very…

Machine Learning · Computer Science 2017-05-30 Shuang Liu , Olivier Bousquet , Kamalika Chaudhuri

Generative adversarial networks (GANs) are emerging machine learning models for generating synthesized data similar to real data by jointly training a generator and a discriminator. In many applications, data and computational resources are…

Machine Learning · Computer Science 2021-07-20 Jinke Ren , Chonghe Liu , Guanding Yu , Dongning Guo

Generative Adversarial Networks (GANs) are a class of generative algorithms that have been shown to produce state-of-the art samples, especially in the domain of image creation. The fundamental principle of GANs is to approximate the…

Machine Learning · Statistics 2018-03-22 G. Biau , B. Cadre , M. Sangnier , U. Tanielian

Generative Adversarial Networks (GANs) are widely used models to learn complex real-world distributions. In GANs, the training of the generator usually stops when the discriminator can no longer distinguish the generator's output from the…

Machine Learning · Computer Science 2021-02-19 Yuanzhi Li , Zehao Dou

Generative adversarial networks (GANs) are pow- erful generative models based on providing feed- back to a generative network via a discriminator network. However, the discriminator usually as- sesses individual samples. This prevents the…

Machine Learning · Computer Science 2018-06-20 Thomas Lucas , Corentin Tallec , Jakob Verbeek , Yann Ollivier

Training Generative Adversarial Networks (GANs) remains a challenging problem. The discriminator trains the generator by learning the distribution of real/generated data. However, the distribution of generated data changes throughout the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Wentian Zhang , Haozhe Liu , Bing Li , Jinheng Xie , Yawen Huang , Yuexiang Li , Yefeng Zheng , Bernard Ghanem

We develop a novel method for training of GANs for unsupervised and class conditional generation of images, called Linear Discriminant GAN (LD-GAN). The discriminator of an LD-GAN is trained to maximize the linear separability between…

Machine Learning · Statistics 2017-07-26 Zhun Sun , Mete Ozay , Takayuki Okatani

We propose a novel theoretical framework of analysis for Generative Adversarial Networks (GANs). We reveal a fundamental flaw of previous analyses which, by incorrectly modeling GANs' training scheme, are subject to ill-defined…

Generative adversarial networks (GANs) learn a target probability distribution by optimizing a generator and a discriminator with minimax objectives. This paper addresses the question of whether such optimization actually provides the…

Machine Learning · Computer Science 2024-04-11 Yuhta Takida , Masaaki Imaizumi , Takashi Shibuya , Chieh-Hsin Lai , Toshimitsu Uesaka , Naoki Murata , Yuki Mitsufuji

Generative Adversarial Networks (GANs) are a widely-used tool for generative modeling of complex data. Despite their empirical success, the training of GANs is not fully understood due to the min-max optimization of the generator and…

Machine Learning · Computer Science 2022-08-23 Evan Becker , Parthe Pandit , Sundeep Rangan , Alyson K. Fletcher

Generative Adversarial Networks (GANs) are one of the most popular tools for learning complex high dimensional distributions. However, generalization properties of GANs have not been well understood. In this paper, we analyze the…

Machine Learning · Computer Science 2019-02-12 Hoang Thanh-Tung , Truyen Tran , Svetha Venkatesh

Generative Adversarial Networks (GANs) have proven to be a powerful framework for learning to draw samples from complex distributions. However, GANs are also notoriously difficult to train, with mode collapse and oscillations a common…

Machine Learning · Statistics 2018-11-28 Kevin J Liang , Chunyuan Li , Guoyin Wang , Lawrence Carin
‹ Prev 1 2 3 10 Next ›