English
Related papers

Related papers: About exchanging expectation and supremum for cond…

200 papers

We study quantitatively the overparametrization limit of the original Wasserstein-GAN algorithm. Effectively, we show that the algorithm is a stochastic discretization of a system of continuity equations for the parameter distributions of…

Analysis of PDEs · Mathematics 2024-05-30 M. G. Delgadino , Bruno B. Suassuna , Rene Cabrera

We study a model for adversarial classification based on distributionally robust chance constraints. We show that under Wasserstein ambiguity, the model aims to minimize the conditional value-at-risk of the distance to misclassification,…

Machine Learning · Computer Science 2021-11-05 Nam Ho-Nguyen , Stephen J. Wright

A popular heuristic for improved performance in Generative adversarial networks (GANs) is to use some form of gradient penalty on the discriminator. This gradient penalty was originally motivated by a Wasserstein distance formulation.…

Machine Learning · Computer Science 2020-11-25 Alexia Jolicoeur-Martineau , Ioannis Mitliagkas

In this paper, we study a physics-informed algorithm for Wasserstein Generative Adversarial Networks (WGANs) for uncertainty quantification in solutions of partial differential equations. By using groupsort activation functions in…

Numerical Analysis · Mathematics 2022-08-10 Yihang Gao , Michael K. Ng

It is well known that the generative adversarial nets (GANs) are remarkably difficult to train. The recently proposed Wasserstein GAN (WGAN) creates principled research directions towards addressing these issues. But we found in practice…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Lijun Zhang , Yujin Zhang , Yongbin Gao

Limited availability of labeled-data makes any supervised learning problem challenging. Alternative learning settings like semi-supervised and universum learning alleviate the dependency on labeled data, but still require a large amount of…

Machine Learning · Computer Science 2022-09-22 Sauptik Dhar , Javad Heydari , Samarth Tripathi , Unmesh Kurup , Mohak Shah

Generative adversarial networks (GANs) are a widely used framework for learning generative models. Wasserstein GANs (WGANs), one of the most successful variants of GANs, require solving a minmax optimization problem to global optimality,…

Machine Learning · Computer Science 2020-07-03 Qi Lei , Jason D. Lee , Alexandros G. Dimakis , Constantinos Daskalakis

Generative Adversarial Networks (GANs) are commonly used for modeling complex distributions of data. Both the generators and discriminators of GANs are often modeled by neural networks, posing a non-transparent optimization problem which is…

Machine Learning · Computer Science 2022-03-22 Arda Sahiner , Tolga Ergen , Batu Ozturkler , Burak Bartan , John Pauly , Morteza Mardani , Mert Pilanci

Zhang et al. introduced a novel modification of Goldstein's classical subgradient method, with an efficiency guarantee of $O(\varepsilon^{-4})$ for minimizing Lipschitz functions. Their work, however, makes use of a nonstandard subgradient…

Optimization and Control · Mathematics 2022-02-17 Damek Davis , Dmitriy Drusvyatskiy , Yin Tat Lee , Swati Padmanabhan , Guanghao Ye

Wasserstein GAN(WGAN) is a model that minimizes the Wasserstein distance between a data distribution and sample distribution. Recent studies have proposed stabilizing the training process for the WGAN and implementing the Lipschitz…

Machine Learning · Computer Science 2018-10-08 Cheolhyeong Kim , Seungtae Park , Hyung Ju Hwang

The expected supremum of a Gaussian process indexed by the image of an index set under a function class is bounded in terms of separate properties of the index set and the function class. The bound is relevant to the estimation of nonlinear…

Machine Learning · Computer Science 2014-11-12 Andreas Maurer

We study the capabilities of GANs and Wasserstein GANs equipped with Transformer encoders to generate sensible and challenging training data for symbolic reasoning domains. We conduct experiments on two problem domains where Transformers…

Machine Learning · Computer Science 2023-05-08 Jens U. Kreber , Christopher Hahn

Studied here are Wasserstein generative adversarial networks (WGANs) with GroupSort neural networks as their discriminators. It is shown that the error bound of the approximation for the target distribution depends on the width and depth…

Machine Learning · Computer Science 2023-07-03 Yihang Gao , Michael K. Ng , Mingjie Zhou

While Generative Adversarial Networks (GANs) have empirically produced impressive results on learning complex real-world distributions, recent works have shown that they suffer from lack of diversity or mode collapse. The theoretical work…

Machine Learning · Computer Science 2019-07-02 Yu Bai , Tengyu Ma , Andrej Risteski

Generative adversarial network (GAN) is a minimax game between a generator mimicking the true model and a discriminator distinguishing the samples produced by the generator from the real training samples. Given an unconstrained…

Machine Learning · Computer Science 2018-10-30 Farzan Farnia , David Tse

In inverse problems, many conditional generative models approximate the posterior measure by minimizing a distance between the joint measure and its learned approximation. While this approach also controls the distance between the posterior…

Machine Learning · Computer Science 2025-08-28 Jannis Chemseddine , Paul Hagemann , Gabriele Steidl , Christian Wald

We propose an approach to fair classification that enforces independence between the classifier outputs and sensitive information by minimizing Wasserstein-1 distances. The approach has desirable theoretical properties and is robust to…

Machine Learning · Statistics 2019-07-30 Ray Jiang , Aldo Pacchiano , Tom Stepleton , Heinrich Jiang , Silvia Chiappa

The classical Gaussian concentration inequality for Lipschitz functions is adapted to a setting where the classical assumptions (i.e. Lipschitz and Gaussian) are not met. The theory is more direct than much of the existing theory designed…

Probability · Mathematics 2022-05-16 Daniel J. Fresen

Wasserstein GANs are based on the idea of minimising the Wasserstein distance between a real and a generated distribution. We provide an in-depth mathematical analysis of differences between the theoretical setup and the reality of training…

Machine Learning · Statistics 2021-10-06 Jan Stanczuk , Christian Etmann , Lisa Maria Kreusser , Carola-Bibiane Schönlieb

Necessary and sufficient conditions for Lipschitzness of the Lempert and Green functions are found in terms of their boundary behaviors.

Complex Variables · Mathematics 2010-06-23 Nikolai Nikolov , Peter Pflug , Pascal J. Thomas