中文
相关论文

相关论文: On the regularization of Wasserstein GANs

200 篇论文

We introduce Primal-Dual Wasserstein GAN, a new learning algorithm for building latent variable models of the data distribution based on the primal and the dual formulations of the optimal transport (OT) problem. We utilize the primal…

机器学习 · 统计学 2018-05-25 Mevlana Gemici , Zeynep Akata , Max Welling

Training generative adversarial networks (GANs) is known to be difficult, especially for financial time series. This paper first analyzes the well-posedness problem in GANs minimax games and the convexity issue in GANs objective functions.…

机器学习 · 统计学 2021-12-28 Othmane Mounjid , Xin Guo

While deep learning in the form of recurrent neural networks (RNNs) has caused a significant improvement in neural language modeling, the fact that they are extremely prone to overfitting is still a mainly unresolved issue. In this paper we…

计算与语言 · 计算机科学 2022-11-18 Sajad Movahedi , Azadeh Shakery

Non-saturating generative adversarial network (GAN) training is widely used and has continued to obtain groundbreaking results. However so far this approach has lacked strong theoretical justification, in contrast to alternatives such as…

机器学习 · 计算机科学 2020-10-19 Matt Shannon , Ben Poole , Soroosh Mariooryad , Tom Bagby , Eric Battenberg , David Kao , Daisy Stanton , RJ Skerry-Ryan

Generative adversarial networks (GANs) are a machine learning framework comprising a generative model for sampling from a target distribution and a discriminative model for evaluating the proximity of a sample to the target distribution.…

量子物理 · 物理学 2021-07-22 Daniel Herr , Benjamin Obert , Matthias Rosenkranz

We are interested in the design of generative networks. The training of these mathematical structures is mostly performed with the help of adversarial (min-max) optimization problems. We propose a simple methodology for constructing such…

机器学习 · 计算机科学 2021-07-16 Kalliopi Basioti , George V. Moustakides

The generative adversarial network (GAN) aims to approximate an unknown distribution via a parameterized neural network (NN). While GANs have been widely applied in reinforcement and semi-supervised learning as well as computer vision…

机器学习 · 计算机科学 2026-02-06 Yu-Jui Huang , Hsin-Hua Shen , Yu-Chih Huang , Wan-Yi Lin , Shih-Chun Lin

Generative adversarial networks (GANs) and normalizing flows are both approaches to density estimation that use deep neural networks to transform samples from an uninformative prior distribution to an approximation of the data distribution.…

机器学习 · 计算机科学 2021-12-15 Tianci Liu , Jeffrey Regier

Generative adversarial network (GAN) is a minimax game between a generator mimicking the true model and a discriminator distinguishing the samples produced by the generator from the real training samples. Given an unconstrained…

机器学习 · 计算机科学 2018-10-30 Farzan Farnia , David Tse

The empirical success of Generative Adversarial Networks (GANs) caused an increasing interest in theoretical research. The statistical literature is mainly focused on Wasserstein GANs and generalizations thereof, which especially allow for…

统计理论 · 数学 2024-07-30 Lea Kunkel , Mathias Trabs

We introduce a new method for training generative adversarial networks by applying the Wasserstein-2 metric proximal on the generators. The approach is based on Wasserstein information geometry. It defines a parametrization invariant…

机器学习 · 计算机科学 2021-02-16 Alex Tong Lin , Wuchen Li , Stanley Osher , Guido Montufar

Exciting new work on the generalization bounds for neural networks (NN) given by Neyshabur et al. , Bartlett et al. closely depend on two parameter-depenedent quantities: the Lipschitz constant upper-bound and the stable rank (a softer…

机器学习 · 统计学 2020-02-21 Amartya Sanyal , Philip H. S. Torr , Puneet K. Dokania

A popular heuristic for improved performance in Generative adversarial networks (GANs) is to use some form of gradient penalty on the discriminator. This gradient penalty was originally motivated by a Wasserstein distance formulation.…

机器学习 · 计算机科学 2020-11-25 Alexia Jolicoeur-Martineau , Ioannis Mitliagkas

Network Embedding is the task of learning continuous node representations for networks, which has been shown effective in a variety of tasks such as link prediction and node classification. Most of existing works aim to preserve different…

机器学习 · 计算机科学 2019-09-02 Quanyu Dai , Xiao Shen , Liang Zhang , Qiang Li , Dan Wang

Modern generative adversarial networks (GANs) predominantly use piecewise linear activation functions in discriminators (or critics), including ReLU and LeakyReLU. Such models learn piecewise linear mappings, where each piece handles a…

机器学习 · 计算机科学 2022-04-14 Vineeth S. Bhaskara , Tristan Aumentado-Armstrong , Allan Jepson , Alex Levinshtein

Wasserstein Generative Adversarial Networks (WGANs) can be used to generate realistic samples from complicated image distributions. The Wasserstein metric used in WGANs is based on a notion of distance between individual images, which…

计算机视觉与模式识别 · 计算机科学 2019-01-14 Jonas Adler , Sebastian Lunz

Deep generative models based on Generative Adversarial Networks (GANs) have demonstrated impressive sample quality but in order to work they require a careful choice of architecture, parameter initialization, and selection of…

机器学习 · 计算机科学 2017-11-08 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

Despite the growing prominence of generative adversarial networks (GANs), optimization in GANs is still a poorly understood topic. In this paper, we analyze the "gradient descent" form of GAN optimization i.e., the natural setting where we…

机器学习 · 计算机科学 2018-01-16 Vaishnavh Nagarajan , J. Zico Kolter

Despite the success of Lipschitz regularization in stabilizing GAN training, the exact reason of its effectiveness remains poorly understood. The direct effect of $K$-Lipschitz regularization is to restrict the $L2$-norm of the neural…

计算机视觉与模式识别 · 计算机科学 2020-08-26 Yipeng Qin , Niloy Mitra , Peter Wonka

Despite its short history, Generative Adversarial Network (GAN) has been extensively studied and used for various tasks, including its original purpose, i.e., synthetic sample generation. However, applying GAN to different data types with…

图像与视频处理 · 电气工程与系统科学 2020-05-20 Minhyeok Lee , Junhee Seok