English
Related papers

Related papers: Robust W-GAN-Based Estimation Under Wasserstein Co…

200 papers

Since their invention, generative adversarial networks (GANs) have become a popular approach for learning to model a distribution of real (unlabeled) data. Convergence problems during training are overcome by Wasserstein GANs which minimize…

Machine Learning · Statistics 2018-03-06 Henning Petzka , Asja Fischer , Denis Lukovnicov

Generative adversarial nets (GANs) and variational auto-encoders have significantly improved our distribution modeling capabilities, showing promise for dataset augmentation, image-to-image translation and feature learning. However, to…

Consider the problem of simultaneous estimation of location and variance matrix under Huber's contaminated Gaussian model. First, we study minimum $f$-divergence estimation at the population level, corresponding to a generative adversarial…

Statistics Theory · Mathematics 2022-08-09 Ziyue Wang , Zhiqiang Tan

Generative adversarial networks (GANs) have enjoyed much success in learning high-dimensional distributions. Learning objectives approximately minimize an $f$-divergence ($f$-GANs) or an integral probability metric (Wasserstein GANs)…

Machine Learning · Computer Science 2020-06-19 Jiaming Song , Stefano Ermon

Issued from Optimal Transport, the Wasserstein distance has gained importance in Machine Learning due to its appealing geometrical properties and the increasing availability of efficient approximations. In this work, we consider the problem…

Machine Learning · Statistics 2022-02-21 Guillaume Staerman , Pierre Laforgue , Pavlo Mozharovskyi , Florence d'Alché-Buc

Wasserstein GAN(WGAN) is a model that minimizes the Wasserstein distance between a data distribution and sample distribution. Recent studies have proposed stabilizing the training process for the WGAN and implementing the Lipschitz…

Machine Learning · Computer Science 2018-10-08 Cheolhyeong Kim , Seungtae Park , Hyung Ju Hwang

We study a model for adversarial classification based on distributionally robust chance constraints. We show that under Wasserstein ambiguity, the model aims to minimize the conditional value-at-risk of the distance to misclassification,…

Machine Learning · Computer Science 2021-11-05 Nam Ho-Nguyen , Stephen J. Wright

Wasserstein-GANs have been introduced to address the deficiencies of generative adversarial networks (GANs) regarding the problems of vanishing gradients and mode collapse during the training, leading to improved convergence behaviour and…

Machine Learning · Computer Science 2019-12-17 Jan Müller , Reinhard Klein , Michael Weinmann

Performativity means that the deployment of a predictive model incentivizes agents to strategically adapt their behavior, thereby inducing a model-dependent distribution shift. Practitioners often repeatedly retrain the model on data…

Optimization and Control · Mathematics 2026-02-09 Siyi Wang , Zifan Wang , Karl H. Johansson

As opposed to standard empirical risk minimization (ERM), distributionally robust optimization aims to minimize the worst-case risk over a larger ambiguity set containing the original empirical distribution of the training data. In this…

Machine Learning · Computer Science 2021-01-06 Jaeho Lee , Maxim Raginsky

This paper presents a novel Wasserstein distributionally robust control and state estimation algorithm for partially observable linear stochastic systems, where the probability distributions of disturbances and measurement noises are…

Systems and Control · Electrical Eng. & Systems 2024-06-05 Minhyuk Jang , Astghik Hakobyan , Insoon Yang

We introduce Primal-Dual Wasserstein GAN, a new learning algorithm for building latent variable models of the data distribution based on the primal and the dual formulations of the optimal transport (OT) problem. We utilize the primal…

Machine Learning · Statistics 2018-05-25 Mevlana Gemici , Zeynep Akata , Max Welling

This paper proposes a distributionally robust approach to logistic regression. We use the Wasserstein distance to construct a ball in the space of probability distributions centered at the uniform distribution on the training samples. If…

Optimization and Control · Mathematics 2015-12-02 Soroosh Shafieezadeh-Abadeh , Peyman Mohajerin Esfahani , Daniel Kuhn

Generative Adversarial Nets (GANs) are very successful at modeling distributions from given samples, even in the high-dimensional case. However, their formulation is also known to be hard to optimize and often not stable. While this is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Ishan Deshpande , Ziyu Zhang , Alexander Schwing

This paper primarily considers the robust estimation problem under Wasserstein distance constraints on the parameter and noise distributions in the linear measurement model with additive noise, which can be formulated as an…

Signal Processing · Electrical Eng. & Systems 2025-10-06 Xiao Ding , Enbin Song , Dunbiao Niu , Zhujun Cao , Qingjiang Shi

Wasserstein Generative Adversarial Networks (WGANs) can be used to generate realistic samples from complicated image distributions. The Wasserstein metric used in WGANs is based on a notion of distance between individual images, which…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Jonas Adler , Sebastian Lunz

We study stochastic optimization problems with chance and risk constraints, where in the latter, risk is quantified in terms of the conditional value-at-risk (CVaR). We consider the distributionally robust versions of these problems, where…

Optimization and Control · Mathematics 2020-12-17 Ashish Cherukuri , Ashish R. Hota

Generative adversarial networks (GANs) are an exciting alternative to algorithms for solving density estimation problems---using data to assess how likely samples are to be drawn from the same distribution. Instead of explicitly computing…

Machine Learning · Computer Science 2017-09-20 Christopher Grimm , Yuhang Song , Michael L. Littman

Wasserstein distributionally robust optimization offers a framework for model fitting in machine learning under potential shifts in the data distribution. We study a regularized variant of this problem in which entropic smoothing produces a…

Optimization and Control · Mathematics 2026-05-28 Tam Le

In many applications in statistics and machine learning, the availability of data samples from multiple possibly heterogeneous sources has become increasingly prevalent. On the other hand, in distributionally robust optimization, we seek…

Machine Learning · Statistics 2022-05-31 Tim Tsz-Kit Lau , Han Liu