English
Related papers

Related papers: Instability and Local Minima in GAN Training with …

200 papers

We propose a novel theoretical framework of analysis for Generative Adversarial Networks (GANs). We reveal a fundamental flaw of previous analyses which, by incorrectly modeling GANs' training scheme, are subject to ill-defined…

Generative neural samplers are probabilistic models that implement sampling using feedforward neural networks: they take a random input vector and produce a sample from a probability distribution defined by the network weights. These models…

Machine Learning · Statistics 2016-06-03 Sebastian Nowozin , Botond Cseke , Ryota Tomioka

Training generative adversarial networks (GAN) using too little data typically leads to discriminator overfitting, causing training to diverge. We propose an adaptive discriminator augmentation mechanism that significantly stabilizes…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Tero Karras , Miika Aittala , Janne Hellsten , Samuli Laine , Jaakko Lehtinen , Timo Aila

Generative Adversarial Networks (GANs) are performant generative methods yielding high-quality samples. However, under certain circumstances, the training of GANs can lead to mode collapse or mode dropping, i.e. the generative models not…

Machine Learning · Computer Science 2021-04-28 Hannes De Meulemeester , Joachim Schreurs , Michaël Fanuel , Bart De Moor , Johan A. K. Suykens

Generative adversarial networks (GANs) have shown great success in applications such as image generation and inpainting. However, they typically require large datasets, which are often not available, especially in the context of prediction…

Machine Learning · Computer Science 2020-01-31 Daniel Stoller , Sebastian Ewert , Simon Dixon

We introduce Kernel Density Discrimination GAN (KDD GAN), a novel method for generative adversarial learning. KDD GAN formulates the training as a likelihood ratio optimization problem where the data distributions are written explicitly via…

Machine Learning · Computer Science 2021-07-14 Abdelhak Lemkhenter , Adam Bielski , Alp Eren Sari , Paolo Favaro

This work studies training generative adversarial networks under the federated learning setting. Generative adversarial networks (GANs) have achieved advancement in various real-world applications, such as image editing, style transfer,…

Machine Learning · Computer Science 2020-07-21 Chenyou Fan , Ping Liu

Generative Adversarial Networks (GANs) have made great progress in synthesizing realistic images in recent years. However, they are often trained on image datasets with either too few samples or too many classes belonging to different data…

Machine Learning · Computer Science 2020-10-16 Shichang Tang

Generative networks are fundamentally different in their aim and methods compared to CNNs for classification, segmentation, or object detection. They have initially not been meant to be an image analysis tool, but to produce naturally…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Markus Wenzel

Generative Adversarial Networks (GAN) are trained to generate sample images of interest distribution. To this end, generator network of GAN learns implicit distribution of real data set from the classification with candidate generated…

Machine Learning · Computer Science 2020-11-17 Gahye Lee , Seungkyu Lee

Recent work has shown local convergence of GAN training for absolutely continuous data and generator distributions. In this paper, we show that the requirement of absolute continuity is necessary: we describe a simple yet prototypical…

Machine Learning · Computer Science 2018-08-01 Lars Mescheder , Andreas Geiger , Sebastian Nowozin

We propose in this paper a novel approach to tackle the problem of mode collapse encountered in generative adversarial network (GAN). Our idea is intuitive but proven to be very effective, especially in addressing some key limitations of…

Machine Learning · Computer Science 2017-09-13 Tu Dinh Nguyen , Trung Le , Hung Vu , Dinh Phung

We consider the problem of training generative models with a Generative Adversarial Network (GAN). Although GANs can accurately model complex distributions, they are known to be difficult to train due to instabilities caused by a difficult…

Machine Learning · Computer Science 2017-06-13 Paulina Grnarova , Kfir Y. Levy , Aurelien Lucchi , Thomas Hofmann , Andreas Krause

Generative Adversarial Network (GAN) is a current focal point of research. The body of knowledge is fragmented, leading to a trial-error method while selecting an appropriate GAN for a given scenario. We provide a comprehensive summary of…

Machine Learning · Computer Science 2021-05-18 Tanya Motwani , Manojkumar Parmar

The Generative Adversarial Network (GAN) has achieved great success in generating realistic (real-valued) synthetic data. However, convergence issues and difficulties dealing with discrete data hinder the applicability of GAN to text. We…

Machine Learning · Statistics 2017-11-21 Yizhe Zhang , Zhe Gan , Kai Fan , Zhi Chen , Ricardo Henao , Dinghan Shen , Lawrence Carin

This paper studies generative adversarial networks (GANs) from the perspective of statistical inference. A GAN is a popular machine learning method in which the parameters of two neural networks, a generator and a discriminator, are…

Statistics Theory · Mathematics 2023-12-06 Mika Meitz

Generative adversarial networks are a novel method for statistical inference that have achieved much empirical success; however, the factors contributing to this success remain ill-understood. In this work, we attempt to analyze generative…

Machine Learning · Computer Science 2018-09-13 Shuang Liu , Kamalika Chaudhuri

Generative Adversarial Networks (GANs) have become a widely popular framework for generative modelling of high-dimensional datasets. However their training is well-known to be difficult. This work presents a rigorous statistical analysis of…

Machine Learning · Statistics 2017-10-17 Mathieu Sinn , Ambrish Rawat

Generative adversarial networks (GANs) are powerful tools for learning generative models. In practice, the training may suffer from lack of convergence. GANs are commonly viewed as a two-player zero-sum game between two neural networks.…

Machine Learning · Computer Science 2018-07-13 Hao Ge , Yin Xia , Xu Chen , Randall Berry , Ying Wu

Generative Adversarial Networks (GANs) were intuitively and attractively explained under the perspective of game theory, wherein two involving parties are a discriminator and a generator. In this game, the task of the discriminator is to…

Machine Learning · Computer Science 2017-11-07 Trung Le , Tu Dinh Nguyen , Dinh Phung