English
Related papers

Related papers: Accelerated WGAN update strategy with loss change …

200 papers

Generative Adversarial Networks (GAN) (Goodfellow et al., 2014) are an effective method for training generative models of complex data such as natural images. However, they are notoriously hard to train and can suffer from the problem of…

We propose EAGLE update rule, a novel optimization method that accelerates loss convergence during the early stages of training by leveraging both current and previous step parameter and gradient values. The update algorithm estimates…

Machine Learning · Computer Science 2025-02-04 Takumi Fujimoto , Hiroaki Nishi

Generative adversarial network (GAN) has become one of the most important neural network models for classical unsupervised machine learning. A variety of discriminator loss functions have been developed to train GAN's discriminators and…

Machine Learning · Computer Science 2021-05-31 Vasily Zadorozhnyy , Qiang Cheng , Qiang Ye

We introduce the Probabilistic Generative Adversarial Network (PGAN), a new GAN variant based on a new kind of objective function. The central idea is to integrate a probabilistic model (a Gaussian Mixture Model, in our case) into the GAN…

Machine Learning · Computer Science 2017-08-08 Hamid Eghbal-zadeh , Gerhard Widmer

We deconstruct the performance of GANs into three components: 1. Formulation: we propose a perturbation view of the population target of GANs. Building on this interpretation, we show that GANs can be viewed as a generalization of the…

Machine Learning · Computer Science 2019-05-21 Banghua Zhu , Jiantao Jiao , David Tse

Generative Adversarial Networks (GANs) have become a powerful framework to learn generative models that arise across a wide variety of domains. While there has been a recent surge in the development of numerous GAN architectures with…

Information Theory · Computer Science 2019-08-13 Jaewoong Cho , Changho Suh

This paper proposes a novel fault diagnosis approach based on generative adversarial networks (GAN) for imbalanced industrial time series where normal samples are much larger than failure cases. We combine a well-designed feature extractor…

Machine Learning · Computer Science 2022-06-17 Wenqian Jiang , Cheng Cheng , Beitong Zhou , Guijun Ma , Ye Yuan

Generative Adversarial Networks (GANs) have extended deep learning to complex generation and translation tasks across different data modalities. However, GANs are notoriously difficult to train: Mode collapse and other instabilities in the…

Neural and Evolutionary Computing · Computer Science 2021-10-29 Santiago Gonzalez , Mohak Kant , Risto Miikkulainen

Generative Adversarial Networks (GANs) produce systematically better quality samples when class label information is provided., i.e. in the conditional GAN setup. This is still observed for the recently proposed Wasserstein GAN formulation…

Machine Learning · Statistics 2018-05-18 Guillermo L. Grinblat , Lucas C. Uzal , Pablo M. Granitto

In this paper, we propose a new approach to train Generative Adversarial Networks (GANs) where we deploy a double-oracle framework using the generator and discriminator oracles. GAN is essentially a two-player zero-sum game between the…

Machine Learning · Computer Science 2022-04-27 Aye Phyu Phyu Aung , Xinrun Wang , Runsheng Yu , Bo An , Senthilnath Jayavelu , Xiaoli Li

Generative Adversarial Networks (GANs) can produce high-quality samples, but do not provide an estimate of the probability density around the samples. However, it has been noted that maximizing the log-likelihood within an energy-based…

Machine Learning · Computer Science 2023-10-03 Omri Ben-Dov , Pravir Singh Gupta , Victoria Abrevaya , Michael J. Black , Partha Ghosh

When researchers develop new econometric methods it is common practice to compare the performance of the new methods to those of existing methods in Monte Carlo studies. The credibility of such Monte Carlo studies is often limited because…

Econometrics · Economics 2020-07-23 Susan Athey , Guido Imbens , Jonas Metzger , Evan Munro

We propose a stable method to train Wasserstein generative adversarial networks. In order to enhance stability, we consider two objective functions using the $c$-transform based on Kantorovich duality which arises in the theory of optimal…

Machine Learning · Computer Science 2021-10-28 Dohyun Kwon , Yeoneung Kim , Guido Montúfar , Insoon Yang

Standard formulations of GANs, where a continuous function deforms a connected latent space, have been shown to be misspecified when fitting different classes of images. In particular, the generator will necessarily sample some low-quality…

Machine Learning · Computer Science 2021-10-20 Thibaut Issenhuth , Ugo Tanielian , David Picard , Jeremie Mary

We study two important concepts in adversarial deep learning---adversarial training and generative adversarial network (GAN). Adversarial training is the technique used to improve the robustness of discriminator by combining adversarial…

Machine Learning · Computer Science 2019-04-17 Xuanqing Liu , Cho-Jui Hsieh

We propose a stable, parallel approach to train Wasserstein Conditional Generative Adversarial Neural Networks (W-CGANs) under the constraint of a fixed computational budget. Differently from previous distributed GANs training techniques,…

Artificial Intelligence · Computer Science 2022-08-26 Massimiliano Lupo Pasini , Junqi Yin

Although GAN-based methods have received many achievements in the last few years, they have not been entirelysuccessful in generating discrete data. The most crucial challenge of these methods is the difficulty of passing the gradientfrom…

Machine Learning · Computer Science 2020-10-16 Ehsan Montahaei , Danial Alihosseini , Mahdieh Soleymani Baghshah

High-resolution (HR) precipitation prediction is essential for reducing damage from stationary and localized heavy rainfall; however, HR precipitation forecasts using process-driven numerical weather prediction models remains challenging.…

Machine Learning · Computer Science 2026-05-19 Kenta Shiraishi , Yuka Muto , Atsushi Okazaki , Shunji Kotsuki

We propose in this paper a novel approach to tackle the problem of mode collapse encountered in generative adversarial network (GAN). Our idea is intuitive but proven to be very effective, especially in addressing some key limitations of…

Machine Learning · Computer Science 2017-09-13 Tu Dinh Nguyen , Trung Le , Hung Vu , Dinh Phung

One of the biggest issues facing the use of machine learning in medical imaging is the lack of availability of large, labelled datasets. The annotation of medical images is not only expensive and time consuming but also highly dependent on…