中文
相关论文

相关论文: Sample weighting as an explanation for mode collap…

200 篇论文

Adversarial training (AT) is proved to reliably improve network's robustness against adversarial data. However, current AT with a pre-specified perturbation budget has limitations in learning a robust network. Firstly, applying a…

机器学习 · 计算机科学 2022-10-05 Chaojian Yu , Dawei Zhou , Li Shen , Jun Yu , Bo Han , Mingming Gong , Nannan Wang , Tongliang Liu

We propose a novel training procedure for improving the performance of generative adversarial networks (GANs), especially to bidirectional GANs. First, we enforce that the empirical distribution of the inverse inference network matches the…

机器学习 · 统计学 2020-05-26 Pablo Sánchez-Martín , Pablo M. Olmos , Fernando Perez-Cruz

Mode collapse is a significant unsolved issue of generative adversarial networks. In this work, we examine the causes of mode collapse from a novel perspective. Due to the nonuniform sampling in the training process, some sub-distributions…

机器学习 · 计算机科学 2024-01-22 Yanxiang Gong , Zhiwei Xie , Guozhen Duan , Zheng Ma , Mei Xie

Generative adversarial networks (GANs) learn a deep generative model that is able to synthesise novel, high-dimensional data samples. New data samples are synthesised by passing latent samples, drawn from a chosen prior distribution,…

计算机视觉与模式识别 · 计算机科学 2018-02-16 Antonia Creswell , Anil A Bharath

Training generative adversarial networks (GAN) using too little data typically leads to discriminator overfitting, causing training to diverge. We propose an adaptive discriminator augmentation mechanism that significantly stabilizes…

计算机视觉与模式识别 · 计算机科学 2020-10-08 Tero Karras , Miika Aittala , Janne Hellsten , Samuli Laine , Jaakko Lehtinen , Timo Aila

Although Generative Adversarial Networks achieve state-of-the-art results on a variety of generative tasks, they are regarded as highly unstable and prone to miss modes. We argue that these bad behaviors of GANs are due to the very…

机器学习 · 计算机科学 2017-03-03 Tong Che , Yanran Li , Athul Paul Jacob , Yoshua Bengio , Wenjie Li

Generative adversarial networks (GANs) have an enormous potential impact on digital content creation, e.g., photo-realistic digital avatars, semantic content editing, and quality enhancement of speech and images. However, the performance of…

人工智能 · 计算机科学 2021-09-01 Pavel Andreev , Alexander Fritzler , Dmitry Vetrov

Generative adversarial networks (GANs) learn a target probability distribution by optimizing a generator and a discriminator with minimax objectives. This paper addresses the question of whether such optimization actually provides the…

We study the effect of the stochastic gradient noise on the training of generative adversarial networks (GANs) and show that it can prevent the convergence of standard game optimization methods, while the batch version converges. We address…

机器学习 · 统计学 2020-06-29 Tatjana Chavdarova , Gauthier Gidel , François Fleuret , Simon Lacoste-Julien

Many existing conditional Generative Adversarial Networks (cGANs) are limited to conditioning on pre-defined and fixed class-level semantic labels or attributes. We propose an open set GAN architecture (OpenGAN) that is conditioned…

计算机视觉与模式识别 · 计算机科学 2020-03-19 Luke Ditria , Benjamin J. Meyer , Tom Drummond

The training of deep neural networks is inherently a nonconvex optimization problem, yet standard approaches such as stochastic gradient descent (SGD) require simultaneous updates to all parameters, often leading to unstable convergence and…

机器学习 · 计算机科学 2025-08-07 Chengcheng Yan , Jiawei Xu , Zheng Peng , Qingsong Wang

Deep generative models based on Generative Adversarial Networks (GANs) have demonstrated impressive sample quality but in order to work they require a careful choice of architecture, parameter initialization, and selection of…

机器学习 · 计算机科学 2017-11-08 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

A myriad of recent literary works has leveraged generative adversarial networks (GANs) to generate unseen evasion samples. The purpose is to annex the generated data with the original train set for adversarial training to improve the…

密码学与安全 · 计算机科学 2022-08-09 Rizwan Hamid Randhawa , Nauman Aslam , Mohammad Alauthman , Husnain Rafiq

The key to overcome class imbalance problems is to capture the distribution of minority class accurately. Generative Adversarial Networks (GANs) have shown some potentials to tackle class imbalance problems due to their capability of…

机器学习 · 计算机科学 2020-08-06 Jingyu Hao , Chengjia Wang , Heye Zhang , Guang Yang

GAN is a deep-learning based generative approach to generate contents such as images, languages and speeches. Recently, studies have shown that GAN can also be applied to generative adversarial attack examples to fool the machine-learning…

机器学习 · 计算机科学 2019-11-15 Feng Chen , Yunkai Shang , Bo Xu , Jincheng Hu

We introduce the Probabilistic Generative Adversarial Network (PGAN), a new GAN variant based on a new kind of objective function. The central idea is to integrate a probabilistic model (a Gaussian Mixture Model, in our case) into the GAN…

机器学习 · 计算机科学 2017-08-08 Hamid Eghbal-zadeh , Gerhard Widmer

Generative adversarial network (GAN) has greatly improved the quality of unsupervised image generation. Previous GAN-based methods often require a large amount of high-quality training data while producing a small number (e.g., tens) of…

计算机视觉与模式识别 · 计算机科学 2019-09-26 Chunpeng Wu , Wei Wen , Yiran Chen , Hai Li

Adaptive methods are a crucial component widely used for training generative adversarial networks (GANs). While there has been some work to pinpoint the "marginal value of adaptive methods" in standard tasks, it remains unclear why they are…

机器学习 · 计算机科学 2022-10-11 Samy Jelassi , David Dobre , Arthur Mensch , Yuanzhi Li , Gauthier Gidel

Projected Gradient Descent (PGD) is a strong and widely used first-order adversarial attack, yet its computational cost scales poorly, as all training samples undergo identical iterative inner-loop optimization despite contributing…

机器学习 · 计算机科学 2025-12-29 Youran Ye , Dejin Wang , Ajinkya Bhandare

Generative adversarial networks (GANs) are widely used for distribution learning, yet their classical formulations remain theoretically fragile, with ill-posed objectives, unstable training dynamics, and limited interpretability. In this…

机器学习 · 计算机科学 2025-12-29 Angshul Majumdar