English
Related papers

Related papers: Instability and Local Minima in GAN Training with …

200 papers

Generative adversarial networks (GANs) are a class of deep generative models which aim to learn a target distribution in an unsupervised fashion. While they were successfully applied to many problems, training a GAN is a notoriously…

Machine Learning · Computer Science 2019-05-15 Karol Kurach , Mario Lucic , Xiaohua Zhai , Marcin Michalski , Sylvain Gelly

While Generative Adversarial Networks (GANs) have demonstrated promising performance on multiple vision tasks, their learning dynamics are not yet well understood, both in theory and in practice. To address this issue, we study GAN dynamics…

Machine Learning · Computer Science 2018-06-05 Jerry Li , Aleksander Madry , John Peebles , Ludwig Schmidt

Auto-encoding generative adversarial networks (GANs) combine the standard GAN algorithm, which discriminates between real and model-generated data, with a reconstruction loss given by an auto-encoder. Such models aim to prevent mode…

Machine Learning · Statistics 2017-10-24 Mihaela Rosca , Balaji Lakshminarayanan , David Warde-Farley , Shakir Mohamed

Generative adversarial networks (GANs) have proven effective in modeling distributions of high-dimensional data. However, their training instability is a well-known hindrance to convergence, which results in practical challenges in their…

Machine Learning · Computer Science 2022-09-28 Alessandro Ferrero , Shireen Elhabian , Ross Whitaker

Despite the success of Generative Adversarial Networks (GANs), mode collapse remains a serious issue during GAN training. To date, little work has focused on understanding and quantifying which modes have been dropped by a model. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-10-28 David Bau , Jun-Yan Zhu , Jonas Wulff , William Peebles , Hendrik Strobelt , Bolei Zhou , Antonio Torralba

Generative Adversarial Networks (GANs) are a type of generative model which have received much attention due to their ability to model complex real-world data. Despite their recent successes, the process of training GANs remains…

Machine Learning · Computer Science 2020-03-26 Maciej Wiatrak , Stefano V. Albrecht , Andrew Nystrom

Generative adversarial networks (GAN) have been effective for learning generative models for real-world data. However, existing GANs (GAN and its variants) tend to suffer from training problems such as instability and mode collapse. In this…

Machine Learning · Computer Science 2018-03-05 Chaoyue Wang , Chang Xu , Xin Yao , Dacheng Tao

Conditional generative adversarial networks (cGANs) have demonstrated remarkable success due to their class-wise controllability and superior quality for complex generation tasks. Typical cGANs solve the joint distribution matching problem…

Machine Learning · Computer Science 2024-09-20 Kyeongbo Kong , Kyunghun Kim , Suk-Ju Kang

Generative adversarial training can be generally understood as minimizing certain moment matching loss defined by a set of discriminator functions, typically neural networks. The discriminator set should be large enough to be able to…

Machine Learning · Computer Science 2018-02-27 Pengchuan Zhang , Qiang Liu , Dengyong Zhou , Tao Xu , Xiaodong He

While Generative Adversarial Networks (GANs) have empirically produced impressive results on learning complex real-world distributions, recent works have shown that they suffer from lack of diversity or mode collapse. The theoretical work…

Machine Learning · Computer Science 2019-07-02 Yu Bai , Tengyu Ma , Andrej Risteski

In this article, we introduce a new mode for training Generative Adversarial Networks (GANs). Rather than minimizing the distance of evidence distribution $\tilde{p}(x)$ and the generative distribution $q(x)$, we minimize the distance of…

Machine Learning · Computer Science 2018-10-30 Jianlin Su

The Generative Models have gained considerable attention in the field of unsupervised learning via a new and practical framework called Generative Adversarial Networks (GAN) due to its outstanding data generation capability. Many models of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Abdul Jabbar , Xi Li , Bourahla Omar

Generative Adversarial Networks (GANs) can successfully approximate a probability distribution and produce realistic samples. However, open questions such as sufficient convergence conditions and mode collapse still persist. In this paper,…

Machine Learning · Computer Science 2019-03-13 Thang Doan , Joao Monteiro , Isabela Albuquerque , Bogdan Mazoure , Audrey Durand , Joelle Pineau , R Devon Hjelm

This paper first presents a theory for generative adversarial methods that does not rely on the traditional minimax formulation. It shows that with a strong discriminator, a good generator can be learned so that the KL divergence between…

Machine Learning · Statistics 2018-06-11 Rie Johnson , Tong Zhang

Dual discriminator generative adversarial networks (D2 GANs) were introduced to mitigate the problem of mode collapse in generative adversarial networks. In D2 GANs, two discriminators are employed alongside a generator: one discriminator…

Machine Learning · Computer Science 2025-07-24 Penukonda Naga Chandana , Tejas Srivastava , Gowtham R. Kurri , V. Lalitha

Generative Adversarial Networks (GANs) are a class of generative algorithms that have been shown to produce state-of-the art samples, especially in the domain of image creation. The fundamental principle of GANs is to approximate the…

Machine Learning · Statistics 2018-03-22 G. Biau , B. Cadre , M. Sangnier , U. Tanielian

Generative adversarial nets (GANs) have been widely studied during the recent development of deep learning and unsupervised learning. With an adversarial training mechanism, GAN manages to train a generative model to fit the underlying…

Information Retrieval · Computer Science 2018-06-12 Weinan Zhang

Training Generative Adversarial Networks (GANs) remains a challenging problem. The discriminator trains the generator by learning the distribution of real/generated data. However, the distribution of generated data changes throughout the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Wentian Zhang , Haozhe Liu , Bing Li , Jinheng Xie , Yawen Huang , Yuexiang Li , Yefeng Zheng , Bernard Ghanem

The training of Generative Adversarial Networks is a difficult task mainly due to the nature of the networks. One such issue is when the generator and discriminator start oscillating, rather than converging to a fixed point. Another case…

Machine Learning · Statistics 2018-02-08 Alexey Chaplygin , Joshua Chacksfield

Generative adversarial networks, or GANs, commonly display unstable behavior during training. In this work, we develop a principled theoretical framework for understanding the stability of various types of GANs. In particular, we derive…

Machine Learning · Computer Science 2020-02-12 Casey Chu , Kentaro Minami , Kenji Fukumizu