English
Related papers

Related papers: Smoothness and Stability in GANs

200 papers

Since their inception in 2014, Generative Adversarial Networks (GANs) have rapidly emerged as powerful tools for generating realistic and diverse data across various domains, including computer vision and other applied areas. Consisting of…

Machine Learning · Computer Science 2025-02-18 Tanujit Chakraborty , Ujjwal Reddy K S , Shraddha M. Naik , Madhurima Panja , Bayapureddy Manvitha

In this paper we study the stability properties of aggregation graph neural networks (Agg-GNNs) considering perturbations of the underlying graph. An Agg-GNN is a hybrid architecture where information is defined on the nodes of a graph, but…

Machine Learning · Computer Science 2023-08-24 Alejandro Parada-Mayorga , Zhiyang Wang , Fernando Gama , Alejandro Ribeiro

Generative Adversarial Networks (GANs) are an arrange of two neural networks -- the generator and the discriminator -- that are jointly trained to generate artificial data, such as images, from random inputs. The quality of these generated…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Manel Mateos , Alejandro González , Xavier Sevillano

Generative adversarial networks (GANs) are one of the most powerful generative models, but always require a large and balanced dataset to train. Traditional GANs are not applicable to generate minority-class images in a highly imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Gaofeng Huang , Amir H. Jafari

Motivated by the pursuit of a systematic computational and algorithmic understanding of Generative Adversarial Networks (GANs), we present a simple yet unified non-asymptotic local convergence theory for smooth two-player games, which…

Machine Learning · Statistics 2020-07-27 Tengyuan Liang , James Stokes

Recently, generative machine-learning models have gained popularity in physics, driven by the goal of improving the efficiency of Markov chain Monte Carlo techniques and of exploring their potential in capturing experimental data…

Statistical Mechanics · Physics 2021-09-03 Japneet Singh , Vipul Arora , Vinay Gupta , Mathias S. Scheurer

Generative Adversarial Networks (GANs) have proven to be a powerful framework for learning to draw samples from complex distributions. However, GANs are also notoriously difficult to train, with mode collapse and oscillations a common…

Machine Learning · Statistics 2018-11-28 Kevin J Liang , Chunyuan Li , Guoyin Wang , Lawrence Carin

The two key players in Generative Adversarial Networks (GANs), the discriminator and generator, are usually parameterized as deep neural networks (DNNs). On many generative tasks, GANs achieve state-of-the-art performance but are often…

Machine Learning · Computer Science 2019-01-31 Babajide O. Ayinde , Keishin Nishihama , Jacek M. Zurada

Generative Adversarial Networks are a new family of generative models, frequently used for generating photorealistic images. The theory promises for the GAN to eventually reach an equilibrium where generator produces pictures…

Machine Learning · Computer Science 2018-11-16 Ilya Kamenshchikov , Matthias Krauledat

In this paper we propose a conditioning trick, called difference departure from normality, applied on the generator network in response to instability issues during GAN training. We force the generator to get closer to the departure from…

Since their invention, generative adversarial networks (GANs) have become a popular approach for learning to model a distribution of real (unlabeled) data. Convergence problems during training are overcome by Wasserstein GANs which minimize…

Machine Learning · Statistics 2018-03-06 Henning Petzka , Asja Fischer , Denis Lukovnicov

Conditional generative adversarial networks (cGAN) have led to large improvements in the task of conditional image generation, which lies at the heart of computer vision. The major focus so far has been on performance improvement, while…

Machine Learning · Computer Science 2019-03-14 Grigorios G. Chrysos , Jean Kossaifi , Stefanos Zafeiriou

Generative Adversarial Nets (GANs) are very successful at modeling distributions from given samples, even in the high-dimensional case. However, their formulation is also known to be hard to optimize and often not stable. While this is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Ishan Deshpande , Ziyu Zhang , Alexander Schwing

Despite being impactful on a variety of problems and applications, the generative adversarial nets (GANs) are remarkably difficult to train. This issue is formally analyzed by \cite{arjovsky2017towards}, who also propose an alternative…

Computer Vision and Pattern Recognition · Computer Science 2018-03-06 Xiang Wei , Boqing Gong , Zixia Liu , Wei Lu , Liqiang Wang

To improve the stability of GAN training we need to understand why they can produce realistic samples. Presently, this is attributed to properties of the divergence obtained under an optimal discriminator. This argument has a fundamental…

Machine Learning · Computer Science 2020-11-03 Florian Schäfer , Hongkai Zheng , Anima Anandkumar

Generative Adversarial Networks (GANs) are powerful models able to synthesize data samples closely resembling the distribution of real data, yet the diversity of those generated samples is limited due to the so-called mode collapse…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Jan Dubiński , Kamil Deja , Sandro Wenzel , Przemysław Rokita , Tomasz Trzciński

Generative adversarial network (GAN) is a framework for generating fake data using a set of real examples. However, GAN is unstable in the training stage. In order to stabilize GANs, the noise injection has been used to enlarge the overlap…

Machine Learning · Computer Science 2022-08-02 Kensuke Nakamura , Simon Korman , Byung-Woo Hong

We propose a new approach to train the Generative Adversarial Nets (GANs) with a mixture of generators to overcome the mode collapsing problem. The main intuition is to employ multiple generators, instead of using a single one as in the…

Machine Learning · Computer Science 2017-10-31 Quan Hoang , Tu Dinh Nguyen , Trung Le , Dinh Phung

This paper analyzes the training process of GANs via stochastic differential equations (SDEs). It first establishes SDE approximations for the training of GANs under stochastic gradient algorithms, with precise error bound analysis. It then…

Machine Learning · Computer Science 2025-09-23 Haoyang Cao , Xin Guo

Generative adversarial networks (GANs) have made impressive advances in image generation, but they often require large-scale training data to avoid degradation caused by discriminator overfitting. To tackle this issue, we investigate the…

Machine Learning · Computer Science 2024-08-22 Jian Wang , Xin Lan , Yuxin Tian , Jiancheng Lv