English
Related papers

Related papers: Smoothness and Stability in GANs

200 papers

Generative adversarial networks (GANs) are successful deep generative models. GANs are based on a two-player minimax game. However, the objective function derived in the original motivation is changed to obtain stronger gradients when…

Machine Learning · Statistics 2016-11-10 Masatoshi Uehara , Issei Sato , Masahiro Suzuki , Kotaro Nakayama , Yutaka Matsuo

Generative networks are fundamentally different in their aim and methods compared to CNNs for classification, segmentation, or object detection. They have initially not been meant to be an image analysis tool, but to produce naturally…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Markus Wenzel

Generative Adversarial Networks (GANs) are known to be difficult to train, despite considerable research effort. Several regularization techniques for stabilizing training have been proposed, but they introduce non-trivial computational…

Machine Learning · Computer Science 2020-02-20 Han Zhang , Zizhao Zhang , Augustus Odena , Honglak Lee

We introduce a novel framework for adversarial training where the target distribution is annealed between the uniform distribution and the data distribution. We posited a conjecture that learning under continuous annealing in the…

Machine Learning · Statistics 2017-05-23 Arash Mehrjou , Bernhard Schölkopf , Saeed Saremi

Generative Adversarial Network (GAN) is a current focal point of research. The body of knowledge is fragmented, leading to a trial-error method while selecting an appropriate GAN for a given scenario. We provide a comprehensive summary of…

Machine Learning · Computer Science 2021-05-18 Tanya Motwani , Manojkumar Parmar

The training process of generative adversarial networks (GANs) is unstable and does not converge globally. In this paper, we examine the stability of GANs from the perspective of control theory and propose a universal higher-order…

Machine Learning · Computer Science 2023-06-21 Tianjiao Luo , Ziyu Zhu , Jianfei Chen , Jun Zhu

Generative adversarial networks (GANs) provide an algorithmic framework for constructing generative models with several appealing properties: they do not require a likelihood function to be specified, only a generating procedure; they…

Machine Learning · Statistics 2017-02-28 Shakir Mohamed , Balaji Lakshminarayanan

Conditional Generative Adversarial Networks are known to be difficult to train, especially when the conditions are continuous and high-dimensional. To partially alleviate this difficulty, we propose a simple generator regularization term on…

Machine Learning · Computer Science 2021-03-30 Yufeng Zheng , Yunkai Zhang , Zeyu Zheng

Generative adversarial networks (GANs), modeled as a zero-sum game between a generator (G) and a discriminator (D), allow generating synthetic data with formal guarantees. Noting that D is a classifier, we begin by reformulating the GAN…

Machine Learning · Computer Science 2023-10-30 Monica Welfert , Gowtham R. Kurri , Kyle Otstot , Lalitha Sankar

It is well known that the generative adversarial nets (GANs) are remarkably difficult to train. The recently proposed Wasserstein GAN (WGAN) creates principled research directions towards addressing these issues. But we found in practice…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Lijun Zhang , Yujin Zhang , Yongbin Gao

Generative adversary networks (GANs) suffer from training pathologies such as instability and mode collapse. These pathologies mainly arise from a lack of diversity in their adversarial interactions. Evolutionary generative adversarial…

Neural and Evolutionary Computing · Computer Science 2019-05-31 Jamal Toutouh , Erik Hemberg , Una-May O'Reilly

We present a mathematically well founded approach for the synthetic modeling of turbulent flows using generative adversarial networks (GAN). Based on the analysis of chaotic, deterministic systems in terms of ergodicity, we outline a…

Fluid Dynamics · Physics 2022-03-23 Claudia Drygala , Benjamin Winhart , Francesca di Mare , Hanno Gottschalk

This paper studies generative adversarial networks (GANs) from the perspective of statistical inference. A GAN is a popular machine learning method in which the parameters of two neural networks, a generator and a discriminator, are…

Statistics Theory · Mathematics 2023-12-06 Mika Meitz

In this paper, we investigate the underlying factor that leads to failure and success in the training of GANs. We study the property of the optimal discriminative function and show that in many GANs, the gradient from the optimal…

Machine Learning · Computer Science 2018-12-27 Zhiming Zhou , Yuxuan Song , Lantao Yu , Hongwei Wang , Jiadong Liang , Weinan Zhang , Zhihua Zhang , Yong Yu

Generative adversarial network (GAN) has gotten wide re-search interest in the field of deep learning. Variations of GAN have achieved competitive results on specific tasks. However, the stability of training and diversity of generated…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Haoxuan You , Zhicheng Jiao , Haojun Xu , Jie Li , Ying Wang , Xinbo Gao

Generative Adversarial Networks (GANs) have been widely applied in different scenarios thanks to the development of deep neural networks. The original GAN was proposed based on the non-parametric assumption of the infinite capacity of…

Machine Learning · Computer Science 2022-11-04 Ziqiang Li , Muhammad Usman , Rentuo Tao , Pengfei Xia , Chaoyue Wang , Huanhuan Chen , Bin Li

Conditional generative adversarial networks (cGANs) have demonstrated remarkable success due to their class-wise controllability and superior quality for complex generation tasks. Typical cGANs solve the joint distribution matching problem…

Machine Learning · Computer Science 2024-09-20 Kyeongbo Kong , Kyunghun Kim , Suk-Ju Kang

Despite its short history, Generative Adversarial Network (GAN) has been extensively studied and used for various tasks, including its original purpose, i.e., synthetic sample generation. However, applying GAN to different data types with…

Image and Video Processing · Electrical Eng. & Systems 2020-05-20 Minhyeok Lee , Junhee Seok

Generative adversarial networks (GANs) have achieved remarkable progress in recent years, but the continuously growing scale of models makes them challenging to deploy widely in practical applications. In particular, for real-time…

Machine Learning · Computer Science 2021-03-19 Liang Hou , Zehuan Yuan , Lei Huang , Huawei Shen , Xueqi Cheng , Changhu Wang

Generative adversarial networks (GANs) learn a target probability distribution by optimizing a generator and a discriminator with minimax objectives. This paper addresses the question of whether such optimization actually provides the…

Machine Learning · Computer Science 2024-04-11 Yuhta Takida , Masaaki Imaizumi , Takashi Shibuya , Chieh-Hsin Lai , Toshimitsu Uesaka , Naoki Murata , Yuki Mitsufuji