English
Related papers

Related papers: GraN-GAN: Piecewise Gradient Normalization for Gen…

200 papers

Generative adversarial networks (GANs) have made impressive advances in image generation, but they often require large-scale training data to avoid degradation caused by discriminator overfitting. To tackle this issue, we investigate the…

Machine Learning · Computer Science 2024-08-22 Jian Wang , Xin Lan , Yuxin Tian , Jiancheng Lv

Despite the success of generative adversarial networks (GANs) for image generation, the trade-off between visual quality and image diversity remains a significant issue. This paper achieves both aims simultaneously by improving the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Duhyeon Bang , Hyunjung Shim

Generative Adversarial Networks (GANs) have achieved remarkable results in the task of generating realistic natural images. In most successful applications, GAN models share two common aspects: solving a challenging saddle point…

Machine Learning · Statistics 2019-05-21 Piotr Bojanowski , Armand Joulin , David Lopez-Paz , Arthur Szlam

We introduce Kernel Density Discrimination GAN (KDD GAN), a novel method for generative adversarial learning. KDD GAN formulates the training as a likelihood ratio optimization problem where the data distributions are written explicitly via…

Machine Learning · Computer Science 2021-07-14 Abdelhak Lemkhenter , Adam Bielski , Alp Eren Sari , Paolo Favaro

Generative Adversarial Networks (GANs) are a powerful framework for deep generative modeling. Posed as a two-player minimax problem, GANs are typically trained end-to-end on real-valued data and can be used to train a generator of…

Machine Learning · Statistics 2017-11-15 Anirudh Goyal , Nan Rosemary Ke , Alex Lamb , R Devon Hjelm , Chris Pal , Joelle Pineau , Yoshua Bengio

In this paper, we study the convergence of generative adversarial networks (GANs) from the perspective of the informativeness of the gradient of the optimal discriminative function. We show that GANs without restriction on the…

Machine Learning · Computer Science 2019-06-25 Zhiming Zhou , Jiadong Liang , Yuxuan Song , Lantao Yu , Hongwei Wang , Weinan Zhang , Yong Yu , Zhihua Zhang

Training of Generative Adversarial Networks (GANs) is notoriously fragile, requiring to maintain a careful balance between the generator and the discriminator in order to perform well. To mitigate this issue we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Dan Zhang , Anna Khoreva

Generative Adversarial Networks (GANs) are known to be difficult to train, despite considerable research effort. Several regularization techniques for stabilizing training have been proposed, but they introduce non-trivial computational…

Machine Learning · Computer Science 2020-02-20 Han Zhang , Zizhao Zhang , Augustus Odena , Honglak Lee

We introduce the Probabilistic Generative Adversarial Network (PGAN), a new GAN variant based on a new kind of objective function. The central idea is to integrate a probabilistic model (a Gaussian Mixture Model, in our case) into the GAN…

Machine Learning · Computer Science 2017-08-08 Hamid Eghbal-zadeh , Gerhard Widmer

One of the challenges in the study of generative adversarial networks is the instability of its training. In this paper, we propose a novel weight normalization technique called spectral normalization to stabilize the training of the…

Machine Learning · Computer Science 2018-02-19 Takeru Miyato , Toshiki Kataoka , Masanori Koyama , Yuichi Yoshida

Generative adversarial networks (GANs) are a class of deep generative models which aim to learn a target distribution in an unsupervised fashion. While they were successfully applied to many problems, training a GAN is a notoriously…

Machine Learning · Computer Science 2019-05-15 Karol Kurach , Mario Lucic , Xiaohua Zhai , Marcin Michalski , Sylvain Gelly

We propose two new techniques for training Generative Adversarial Networks (GANs). Our objectives are to alleviate mode collapse in GAN and improve the quality of the generated samples. First, we propose neighbor embedding, a manifold…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

Generative adversarial networks (GAN) have shown remarkable results in image generation tasks. High fidelity class-conditional GAN methods often rely on stabilization techniques by constraining the global Lipschitz continuity. Such…

Machine Learning · Computer Science 2020-08-11 Jiachen Zhong , Xuanqing Liu , Cho-Jui Hsieh

Generative adversarial networks (GANs) are a class of machine-learning models that use adversarial training to generate new samples with the same (potentially very complex) statistics as the training samples. One major form of training…

Disordered Systems and Neural Networks · Physics 2022-12-12 Steven Durr , Youssef Mroueh , Yuhai Tu , Shenshen Wang

In this paper, we aim to understand the generalization properties of generative adversarial networks (GANs) from a new perspective of privacy protection. Theoretically, we prove that a differentially private learning algorithm used for…

Machine Learning · Computer Science 2019-09-26 Bingzhe Wu , Shiwan Zhao , ChaoChao Chen , Haoyang Xu , Li Wang , Xiaolu Zhang , Guangyu Sun , Jun Zhou

Recent years have witnessed the rapid progress of generative adversarial networks (GANs). However, the success of the GAN models hinges on a large amount of training data. This work proposes a regularization approach for training robust GAN…

Machine Learning · Computer Science 2021-04-08 Hung-Yu Tseng , Lu Jiang , Ce Liu , Ming-Hsuan Yang , Weilong Yang

We propose a principled method for gradient-based regularization of the critic of GAN-like models trained by adversarially optimizing the kernel of a Maximum Mean Discrepancy (MMD). We show that controlling the gradient of the critic is…

Machine Learning · Statistics 2021-01-15 Michael Arbel , Danica J. Sutherland , Mikołaj Bińkowski , Arthur Gretton

We present a continual learning approach for generative adversarial networks (GANs), by designing and leveraging parameter-efficient feature map transformations. Our approach is based on learning a set of global and task-specific…

Machine Learning · Computer Science 2021-08-02 Sakshi Varshney , Vinay Kumar Verma , Srijith P K , Lawrence Carin , Piyush Rai

The training of artificial neural networks (ANNs) is nowadays a highly relevant algorithmic procedure with many applications in science and industry. Roughly speaking, ANNs can be regarded as iterated compositions between affine linear…

Optimization and Control · Mathematics 2022-07-14 Simon Eberle , Arnulf Jentzen , Adrian Riekert , Georg Weiss

Generative adversarial networks (GANs) have an enormous potential impact on digital content creation, e.g., photo-realistic digital avatars, semantic content editing, and quality enhancement of speech and images. However, the performance of…

Artificial Intelligence · Computer Science 2021-09-01 Pavel Andreev , Alexander Fritzler , Dmitry Vetrov