English
Related papers

Related papers: Sample weighting as an explanation for mode collap…

200 papers

Adversarial training (AT) is proved to reliably improve network's robustness against adversarial data. However, current AT with a pre-specified perturbation budget has limitations in learning a robust network. Firstly, applying a…

Machine Learning · Computer Science 2022-10-05 Chaojian Yu , Dawei Zhou , Li Shen , Jun Yu , Bo Han , Mingming Gong , Nannan Wang , Tongliang Liu

We propose a novel training procedure for improving the performance of generative adversarial networks (GANs), especially to bidirectional GANs. First, we enforce that the empirical distribution of the inverse inference network matches the…

Machine Learning · Statistics 2020-05-26 Pablo Sánchez-Martín , Pablo M. Olmos , Fernando Perez-Cruz

Mode collapse is a significant unsolved issue of generative adversarial networks. In this work, we examine the causes of mode collapse from a novel perspective. Due to the nonuniform sampling in the training process, some sub-distributions…

Machine Learning · Computer Science 2024-01-22 Yanxiang Gong , Zhiwei Xie , Guozhen Duan , Zheng Ma , Mei Xie

Generative adversarial networks (GANs) learn a deep generative model that is able to synthesise novel, high-dimensional data samples. New data samples are synthesised by passing latent samples, drawn from a chosen prior distribution,…

Computer Vision and Pattern Recognition · Computer Science 2018-02-16 Antonia Creswell , Anil A Bharath

Training generative adversarial networks (GAN) using too little data typically leads to discriminator overfitting, causing training to diverge. We propose an adaptive discriminator augmentation mechanism that significantly stabilizes…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Tero Karras , Miika Aittala , Janne Hellsten , Samuli Laine , Jaakko Lehtinen , Timo Aila

Although Generative Adversarial Networks achieve state-of-the-art results on a variety of generative tasks, they are regarded as highly unstable and prone to miss modes. We argue that these bad behaviors of GANs are due to the very…

Machine Learning · Computer Science 2017-03-03 Tong Che , Yanran Li , Athul Paul Jacob , Yoshua Bengio , Wenjie Li

Generative adversarial networks (GANs) have an enormous potential impact on digital content creation, e.g., photo-realistic digital avatars, semantic content editing, and quality enhancement of speech and images. However, the performance of…

Artificial Intelligence · Computer Science 2021-09-01 Pavel Andreev , Alexander Fritzler , Dmitry Vetrov

Generative adversarial networks (GANs) learn a target probability distribution by optimizing a generator and a discriminator with minimax objectives. This paper addresses the question of whether such optimization actually provides the…

Machine Learning · Computer Science 2024-04-11 Yuhta Takida , Masaaki Imaizumi , Takashi Shibuya , Chieh-Hsin Lai , Toshimitsu Uesaka , Naoki Murata , Yuki Mitsufuji

We study the effect of the stochastic gradient noise on the training of generative adversarial networks (GANs) and show that it can prevent the convergence of standard game optimization methods, while the batch version converges. We address…

Machine Learning · Statistics 2020-06-29 Tatjana Chavdarova , Gauthier Gidel , François Fleuret , Simon Lacoste-Julien

Many existing conditional Generative Adversarial Networks (cGANs) are limited to conditioning on pre-defined and fixed class-level semantic labels or attributes. We propose an open set GAN architecture (OpenGAN) that is conditioned…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Luke Ditria , Benjamin J. Meyer , Tom Drummond

The training of deep neural networks is inherently a nonconvex optimization problem, yet standard approaches such as stochastic gradient descent (SGD) require simultaneous updates to all parameters, often leading to unstable convergence and…

Machine Learning · Computer Science 2025-08-07 Chengcheng Yan , Jiawei Xu , Zheng Peng , Qingsong Wang

Deep generative models based on Generative Adversarial Networks (GANs) have demonstrated impressive sample quality but in order to work they require a careful choice of architecture, parameter initialization, and selection of…

Machine Learning · Computer Science 2017-11-08 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

A myriad of recent literary works has leveraged generative adversarial networks (GANs) to generate unseen evasion samples. The purpose is to annex the generated data with the original train set for adversarial training to improve the…

Cryptography and Security · Computer Science 2022-08-09 Rizwan Hamid Randhawa , Nauman Aslam , Mohammad Alauthman , Husnain Rafiq

The key to overcome class imbalance problems is to capture the distribution of minority class accurately. Generative Adversarial Networks (GANs) have shown some potentials to tackle class imbalance problems due to their capability of…

Machine Learning · Computer Science 2020-08-06 Jingyu Hao , Chengjia Wang , Heye Zhang , Guang Yang

GAN is a deep-learning based generative approach to generate contents such as images, languages and speeches. Recently, studies have shown that GAN can also be applied to generative adversarial attack examples to fool the machine-learning…

Machine Learning · Computer Science 2019-11-15 Feng Chen , Yunkai Shang , Bo Xu , Jincheng Hu

We introduce the Probabilistic Generative Adversarial Network (PGAN), a new GAN variant based on a new kind of objective function. The central idea is to integrate a probabilistic model (a Gaussian Mixture Model, in our case) into the GAN…

Machine Learning · Computer Science 2017-08-08 Hamid Eghbal-zadeh , Gerhard Widmer

Generative adversarial network (GAN) has greatly improved the quality of unsupervised image generation. Previous GAN-based methods often require a large amount of high-quality training data while producing a small number (e.g., tens) of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Chunpeng Wu , Wei Wen , Yiran Chen , Hai Li

Adaptive methods are a crucial component widely used for training generative adversarial networks (GANs). While there has been some work to pinpoint the "marginal value of adaptive methods" in standard tasks, it remains unclear why they are…

Machine Learning · Computer Science 2022-10-11 Samy Jelassi , David Dobre , Arthur Mensch , Yuanzhi Li , Gauthier Gidel

Projected Gradient Descent (PGD) is a strong and widely used first-order adversarial attack, yet its computational cost scales poorly, as all training samples undergo identical iterative inner-loop optimization despite contributing…

Machine Learning · Computer Science 2025-12-29 Youran Ye , Dejin Wang , Ajinkya Bhandare

Generative adversarial networks (GANs) are widely used for distribution learning, yet their classical formulations remain theoretically fragile, with ill-posed objectives, unstable training dynamics, and limited interpretability. In this…

Machine Learning · Computer Science 2025-12-29 Angshul Majumdar