English
Related papers

Related papers: Non-saturating GAN training as divergence minimiza…

200 papers

Generative Adversarial Networks (GANs) have shown remarkable results in modeling complex distributions, but their evaluation remains an unsettled issue. Evaluations are essential for: (i) relative assessment of different models and (ii)…

Generative adversarial networks (GANs) have drawn enormous attention due to the simple yet effective training mechanism and superior image generation quality. With the ability to generate photo-realistic high-resolution (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Ming Liu , Yuxiang Wei , Xiaohe Wu , Wangmeng Zuo , Lei Zhang

Generative adversarial networks (GANs) are pow- erful generative models based on providing feed- back to a generative network via a discriminator network. However, the discriminator usually as- sesses individual samples. This prevents the…

Machine Learning · Computer Science 2018-06-20 Thomas Lucas , Corentin Tallec , Jakob Verbeek , Yann Ollivier

Generative Adversarial Nets (GANs) are very successful at modeling distributions from given samples, even in the high-dimensional case. However, their formulation is also known to be hard to optimize and often not stable. While this is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Ishan Deshpande , Ziyu Zhang , Alexander Schwing

While Generative Adversarial Networks (GANs) are fundamental to many generative modelling applications, they suffer from numerous issues. In this work, we propose a principled framework to simultaneously mitigate two fundamental issues in…

Machine Learning · Computer Science 2020-11-24 Kwot Sin Lee , Ngoc-Trung Tran , Ngai-Man Cheung

Generative adversarial networks (GANs) have an enormous potential impact on digital content creation, e.g., photo-realistic digital avatars, semantic content editing, and quality enhancement of speech and images. However, the performance of…

Artificial Intelligence · Computer Science 2021-09-01 Pavel Andreev , Alexander Fritzler , Dmitry Vetrov

Generative Adversarial Networks (GANs) have become one of the dominant methods for deep generative modeling. Despite their demonstrated success on multiple vision tasks, GANs are difficult to train and much research has been dedicated…

Neural and Evolutionary Computing · Computer Science 2018-09-05 Abdullah Al-Dujaili , Tom Schmiedlechner , and Erik Hemberg , Una-May O'Reilly

Generative adversarial networks (GANs) have proven effective in modeling distributions of high-dimensional data. However, their training instability is a well-known hindrance to convergence, which results in practical challenges in their…

Machine Learning · Computer Science 2022-09-28 Alessandro Ferrero , Shireen Elhabian , Ross Whitaker

Generative adversarial network (GAN) is a framework for generating fake data using a set of real examples. However, GAN is unstable in the training stage. In order to stabilize GANs, the noise injection has been used to enlarge the overlap…

Machine Learning · Computer Science 2022-08-02 Kensuke Nakamura , Simon Korman , Byung-Woo Hong

Despite the dramatic success in image generation, Generative Adversarial Networks (GANs) still face great challenges in synthesizing sequences of discrete elements, in particular human language. The difficulty in generator training arises…

Computation and Language · Computer Science 2023-02-24 Yekun Chai , Qiyue Yin , Junge Zhang

Generative adversarial networks (GANs) have been remarkably successful in learning complex high dimensional real word distributions and generating realistic samples. However, they provide limited control over the generation process.…

Machine Learning · Computer Science 2020-10-27 Arunava Chakraborty , Rahul Ragesh , Mahir Shah , Nipun Kwatra

Despite the accomplishments of Generative Adversarial Networks (GANs) in modeling data distributions, training them remains a challenging task. A contributing factor to this difficulty is the non-intuitive nature of the GAN loss curves,…

Machine Learning · Computer Science 2021-07-13 Sahil Sidheekh , Aroof Aimen , Narayanan C. Krishnan

Generative adversarial networks (GANs) are one of the most popular approaches when it comes to training generative models, among which variants of Wasserstein GANs are considered superior to the standard GAN formulation in terms of learning…

Machine Learning · Computer Science 2020-01-06 Dávid Terjék

A recent technical breakthrough in the domain of machine learning is the discovery and the multiple applications of Generative Adversarial Networks (GANs). Those generative models are computationally demanding, as a GAN is composed of two…

Machine Learning · Computer Science 2021-04-14 Corentin Hardy , Erwan Le Merrer , Bruno Sericola

Since its invention, Generative adversarial networks (GANs) have shown outstanding results in many applications. Generative Adversarial Networks are powerful yet, resource-hungry deep-learning models. Their main difference from ordinary…

Machine Learning · Computer Science 2021-08-17 Dina Tantawy , Mohamed Zahran , Amr Wassal

Despite the successes in capturing continuous distributions, the application of generative adversarial networks (GANs) to discrete settings, like natural language tasks, is rather restricted. The fundamental reason is the difficulty of…

Artificial Intelligence · Computer Science 2017-02-28 Tong Che , Yanran Li , Ruixiang Zhang , R Devon Hjelm , Wenjie Li , Yangqiu Song , Yoshua Bengio

Wasserstein GANs are based on the idea of minimising the Wasserstein distance between a real and a generated distribution. We provide an in-depth mathematical analysis of differences between the theoretical setup and the reality of training…

Machine Learning · Statistics 2021-10-06 Jan Stanczuk , Christian Etmann , Lisa Maria Kreusser , Carola-Bibiane Schönlieb

Semi-supervised learning methods based on generative adversarial networks (GANs) obtained strong empirical results, but it is not clear 1) how the discriminator benefits from joint training with a generator, and 2) why good semi-supervised…

Machine Learning · Computer Science 2017-11-06 Zihang Dai , Zhilin Yang , Fan Yang , William W. Cohen , Ruslan Salakhutdinov

Scalability has driven recent advances in generative modeling, yet its principles remain underexplored for adversarial learning. We investigate the scalability of Generative Adversarial Networks (GANs) through two design choices that have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Sangeek Hyun , MinKyu Lee , Jae-Pil Heo

Generative Adversarial Networks (GANs) are a powerful class of generative models in the deep learning community. Current practice on large-scale GAN training utilizes large models and distributed large-batch training strategies, and is…

Optimization and Control · Mathematics 2020-10-21 Mingrui Liu , Wei Zhang , Youssef Mroueh , Xiaodong Cui , Jerret Ross , Tianbao Yang , Payel Das