English
Related papers

Related papers: Taming GANs with Lookahead-Minmax

200 papers

We propose a second order gradient based method with ADAM and RMSprop for the training of generative adversarial networks. The proposed method is fastest to obtain similar accuracy when compared to prominent second order methods. Unlike…

Machine Learning · Computer Science 2023-04-21 Sachin Kumar Danisetty , Santhosh Reddy Mylaram , Pawan Kumar

In this paper, we study a large-scale multi-agent minimax optimization problem, which models many interesting applications in statistical learning and game theory, including Generative Adversarial Networks (GANs). The overall objective is a…

Machine Learning · Computer Science 2023-06-07 Zhenyu Sun , Ermin Wei

In the past few years, Generative Adversarial Networks (GANs) have dramatically advanced our ability to represent and parameterize high-dimensional, non-linear image manifolds. As a result, they have been widely adopted across a variety of…

Computer Vision and Pattern Recognition · Computer Science 2020-05-01 Rushil Anirudh , Jayaraman J. Thiagarajan , Bhavya Kailkhura , Timo Bremer

Despite the growing interest in generative adversarial networks (GANs), training GANs remains a challenging problem, both from a theoretical and a practical standpoint. To address this challenge, in this paper, we propose a novel way to…

Machine Learning · Computer Science 2018-11-27 Qunwei Li , Bhavya Kailkhura , Rushil Anirudh , Yi Zhou , Yingbin Liang , Pramod Varshney

Generative adversarial network (GAN) has greatly improved the quality of unsupervised image generation. Previous GAN-based methods often require a large amount of high-quality training data while producing a small number (e.g., tens) of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Chunpeng Wu , Wei Wen , Yiran Chen , Hai Li

We study the problem of multimodal generative modelling of images based on generative adversarial networks (GANs). Despite the success of existing methods, they often ignore the underlying structure of vision data or its multimodal…

Machine Learning · Computer Science 2019-11-07 Lili Pan , Shen Cheng , Jian Liu , Yazhou Ren , Zenglin Xu

Softmax GAN is a novel variant of Generative Adversarial Network (GAN). The key idea of Softmax GAN is to replace the classification loss in the original GAN with a softmax cross-entropy loss in the sample space of one single batch. In the…

Machine Learning · Computer Science 2020-06-26 Min Lin

Since the advent of generative adversarial networks (GANs), various loss functions have been developed and combined to constitute the overall training objective function, in order to improve model performance or for specific learning tasks.…

Image and Video Processing · Electrical Eng. & Systems 2020-06-30 Jingwen Su , Hujun Yin

Despite the success of generative adversarial networks (GANs) for image generation, the trade-off between visual quality and image diversity remains a significant issue. This paper achieves both aims simultaneously by improving the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Duhyeon Bang , Hyunjung Shim

Recent work introduced progressive network growing as a promising way to ease the training for large GANs, but the model design and architecture-growing strategy still remain under-explored and needs manual design for different image data.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Lanlan Liu , Yuting Zhang , Jia Deng , Stefano Soatto

As machine learning continues to develop, and data misuse scandals become more prevalent, individuals are becoming increasingly concerned about their personal information and are advocating for the right to remove their data. Machine…

Machine Learning · Computer Science 2023-08-22 Hui Sun , Tianqing Zhu , Wenhan Chang , Wanlei Zhou

We study the problem of alleviating the instability issue in the GAN training procedure via new architecture design. The discrepancy between the minimax and maximin objective values could serve as a proxy for the difficulties that the…

Machine Learning · Computer Science 2018-11-21 Hongyang Zhang , Susu Xu , Jiantao Jiao , Pengtao Xie , Ruslan Salakhutdinov , Eric P. Xing

Deep neural networks have been shown to perform well in many classical machine learning problems, especially in image classification tasks. However, researchers have found that neural networks can be easily fooled, and they are surprisingly…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Huaxia Wang , Chun-Nam Yu

The Generative Adversarial Network (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. It has many applications in statistics such as nonparametric clustering and nonparametric…

Machine Learning · Statistics 2023-06-26 Sehwan Kim , Qifan Song , Faming Liang

Generative adversary networks (GANs) suffer from training pathologies such as instability and mode collapse. These pathologies mainly arise from a lack of diversity in their adversarial interactions. Evolutionary generative adversarial…

Neural and Evolutionary Computing · Computer Science 2019-05-31 Jamal Toutouh , Erik Hemberg , Una-May O'Reilly

Generating multiple categories of texts is a challenging task and draws more and more attention. Since generative adversarial nets (GANs) have shown competitive results on general text generation, they are extended for category text…

Computation and Language · Computer Science 2019-11-21 Zhiyue Liu , Jiahai Wang , Zhiwei Liang

Generative adversarial networks (GANs) have been extremely effective in approximating complex distributions of high-dimensional, input data samples, and substantial progress has been made in understanding and improving GAN performance in…

Machine Learning · Computer Science 2018-05-01 Daniel Jiwoong Im , He Ma , Graham Taylor , Kristin Branson

Generative adversarial networks (GANs) have shown great success in applications such as image generation and inpainting. However, they typically require large datasets, which are often not available, especially in the context of prediction…

Machine Learning · Computer Science 2020-01-31 Daniel Stoller , Sebastian Ewert , Simon Dixon

Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only…

Machine Learning · Computer Science 2017-12-27 Ishaan Gulrajani , Faruk Ahmed , Martin Arjovsky , Vincent Dumoulin , Aaron Courville

Generative adversarial networks (GANs) have made impressive advances in image generation, but they often require large-scale training data to avoid degradation caused by discriminator overfitting. To tackle this issue, we investigate the…

Machine Learning · Computer Science 2024-08-22 Jian Wang , Xin Lan , Yuxin Tian , Jiancheng Lv