中文
相关论文

相关论文: Stabilizing Training of Generative Adversarial Net…

200 篇论文

In this paper we propose and analyze a novel multilevel version of Stein variational gradient descent (SVGD). SVGD is a recent particle based variational inference method. For Bayesian inverse problems with computationally expensive…

数值分析 · 数学 2024-02-05 Simon Weissmann , Jakob Zech

Particle-based approximate Bayesian inference approaches such as Stein Variational Gradient Descent (SVGD) combine the flexibility and convergence guarantees of sampling methods with the computational benefits of variational inference. In…

机器学习 · 计算机科学 2021-07-30 Lauro Langosco di Langosco , Vincent Fortuin , Heiko Strathmann

Generative Adversarial Networks (GANs) are known to be difficult to train, despite considerable research effort. Several regularization techniques for stabilizing training have been proposed, but they introduce non-trivial computational…

机器学习 · 计算机科学 2020-02-20 Han Zhang , Zizhao Zhang , Augustus Odena , Honglak Lee

We study the effect of the stochastic gradient noise on the training of generative adversarial networks (GANs) and show that it can prevent the convergence of standard game optimization methods, while the batch version converges. We address…

机器学习 · 统计学 2020-06-29 Tatjana Chavdarova , Gauthier Gidel , François Fleuret , Simon Lacoste-Julien

A generative adversarial network (GAN) has been a representative backbone model in generative artificial intelligence (AI) because of its powerful performance in capturing intricate data-generating processes. However, the GAN training is…

机器学习 · 统计学 2025-08-21 Jinwon Sohn , Qifan Song

The Generative Models have gained considerable attention in the field of unsupervised learning via a new and practical framework called Generative Adversarial Networks (GAN) due to its outstanding data generation capability. Many models of…

计算机视觉与模式识别 · 计算机科学 2020-06-11 Abdul Jabbar , Xi Li , Bourahla Omar

Generative adversarial networks (GANs) have been shown to produce realistic samples from high-dimensional distributions, but training them is considered hard. A possible explanation for training instabilities is the inherent imbalance…

Generative adversarial networks have achieved remarkable performance on various tasks but suffer from training instability. Despite many training strategies proposed to improve training stability, this issue remains as a challenge. In this…

计算机视觉与模式识别 · 计算机科学 2020-11-17 Faqiang Liu , Mingkun Xu , Guoqi Li , Jing Pei , Luping Shi , Rong Zhao

Generative Adversarial Networks (GANs) have shown remarkable performance in image generation. However, GAN training suffers from the problem of instability. One of the main approaches to address this problem is to modify the loss function,…

机器学习 · 计算机科学 2024-03-19 Iu Yahiro , Takashi Ishida , Naoto Yokoya

Generative Adversarial Networks (GANs), as a framework for estimating generative models via an adversarial process, have attracted huge attention and have proven to be powerful in a variety of tasks. However, training GANs is well known for…

机器学习 · 计算机科学 2017-11-09 Zi-Yi Dou

We present a deep learning model for data-driven simulations of random dynamical systems without a distributional assumption. The deep learning model consists of a recurrent neural network, which aims to learn the time marching structure,…

机器学习 · 计算机科学 2022-04-12 Kyongmin Yeo , Zan Li , Wesley M. Gifford

Generative adversary networks (GANs) suffer from training pathologies such as instability and mode collapse. These pathologies mainly arise from a lack of diversity in their adversarial interactions. Evolutionary generative adversarial…

神经与进化计算 · 计算机科学 2019-05-31 Jamal Toutouh , Erik Hemberg , Una-May O'Reilly

Generative adversarial networks (GANs) are powerful generative models, but usually suffer from instability and generalization problem which may lead to poor generations. Most existing works focus on stabilizing the training of the…

机器学习 · 计算机科学 2020-04-29 Shufei Zhang , Zhuang Qian , Kaizhu Huang , Jimin Xiao , Yuan He

Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only…

机器学习 · 计算机科学 2017-12-27 Ishaan Gulrajani , Faruk Ahmed , Martin Arjovsky , Vincent Dumoulin , Aaron Courville

The Generative Adversarial Networks (GANs) have demonstrated impressive performance for data synthesis, and are now used in a wide range of computer vision tasks. In spite of this success, they gained a reputation for being difficult to…

机器学习 · 统计学 2017-12-07 Tatjana Chavdarova , François Fleuret

Generative Adversarial Networks (GANs) have become a widely popular framework for generative modelling of high-dimensional datasets. However their training is well-known to be difficult. This work presents a rigorous statistical analysis of…

机器学习 · 统计学 2017-10-17 Mathieu Sinn , Ambrish Rawat

One of the training strategies of generative models is to minimize the Jensen--Shannon divergence between the model distribution and the data distribution. Since data distribution is unknown, generative adversarial networks (GANs) formulate…

机器学习 · 计算机科学 2023-02-22 Hiroki Naganuma , Hideaki Iiduka

We propose two new techniques for training Generative Adversarial Networks (GANs). Our objectives are to alleviate mode collapse in GAN and improve the quality of the generated samples. First, we propose neighbor embedding, a manifold…

计算机视觉与模式识别 · 计算机科学 2018-11-06 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

Stein Variational Gradient Descent (SVGD) is an important alternative to the Langevin-type algorithms for sampling from probability distributions of the form $\pi(x) \propto \exp(-V(x))$. In the existing theory of Langevin-type algorithms…

统计理论 · 数学 2022-06-02 Lukang Sun , Avetik Karagulyan , Peter Richtarik

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

机器学习 · 统计学 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton