English
Related papers

Related papers: Wasserstein GANs are Minimax Optimal Distribution …

200 papers

We are interested in the approximation in Wasserstein distance with index $\rho\ge 1$ of a probability measure $\mu$ on the real line with finite moment of order $\rho$ by the empirical measure of $N$ deterministic points. The minimal error…

Probability · Mathematics 2021-05-07 Oumaima Bencheikh , Benjamin Jourdain

Flow Matching has recently gained attention in generative modeling as a simple and flexible alternative to diffusion models. While existing statistical guarantees adapt tools from the analysis of diffusion models, we take a different…

Machine Learning · Statistics 2026-03-18 Lea Kunkel , Mathias Trabs

We study the Wasserstein natural gradient in parametric statistical models with continuous sample spaces. Our approach is to pull back the $L^2$-Wasserstein metric tensor in the probability density space to a parameter space, equipping the…

Optimization and Control · Mathematics 2024-08-20 Yifan Chen , Wuchen Li

The unequal representation of different groups in a sample population can lead to discrimination of minority groups when machine learning models make automated decisions. To address these issues, fairness-aware machine learning jointly…

Machine Learning · Computer Science 2023-11-22 Xuan Zhao , Simone Fabbrizzi , Paula Reyero Lobo , Siamak Ghodsi , Klaus Broelemann , Steffen Staab , Gjergji Kasneci

We study policy gradient methods for continuous-action, entropy-regularized reinforcement learning through the lens of Wasserstein geometry. Starting from a Wasserstein proximal update, we derive Wasserstein Proximal Policy Gradient (WPPG)…

Machine Learning · Computer Science 2026-03-04 Zhaoyu Zhu , Shuhan Zhang , Rui Gao , Shuang Li

GANs excel at learning high dimensional distributions, but they can update generator parameters in directions that do not correspond to the steepest descent direction of the objective. Prominent examples of problematic update directions…

Machine Learning · Computer Science 2018-06-08 Calvin Seward , Thomas Unterthiner , Urs Bergmann , Nikolay Jetchev , Sepp Hochreiter

Generative adversarial networks (GANs) are powerful generative models, but usually suffer from instability and generalization problem which may lead to poor generations. Most existing works focus on stabilizing the training of the…

Machine Learning · Computer Science 2020-04-29 Shufei Zhang , Zhuang Qian , Kaizhu Huang , Jimin Xiao , Yuan He

For $\ell\colon \mathbb{R}^d \to [0,\infty)$ we consider the sequence of probability measures $\left(\mu_n\right)_{n \in \mathbb{N}}$, where $\mu_n$ is determined by a density that is proportional to $\exp(-n\ell)$. We allow for infinitely…

Probability · Mathematics 2023-12-11 Mareike Hasenpflug , Daniel Rudolf , Björn Sprungk

Let $\pi\in \Pi(\mu,\nu)$ be a coupling between two probability measures $\mu$ and $\nu$ on a Polish space. In this article we propose and study a class of nonparametric measures of association between $\mu$ and $\nu$, which we call…

Statistics Theory · Mathematics 2021-11-05 Johannes Wiesel

In this paper, we investigate the underlying factor that leads to failure and success in the training of GANs. We study the property of the optimal discriminative function and show that in many GANs, the gradient from the optimal…

Machine Learning · Computer Science 2018-12-27 Zhiming Zhou , Yuxuan Song , Lantao Yu , Hongwei Wang , Jiadong Liang , Weinan Zhang , Zhihua Zhang , Yong Yu

We propose a new formulation and learning strategy for computing the Wasserstein geodesic between two probability distributions in high dimensions. By applying the method of Lagrange multipliers to the dynamic formulation of the optimal…

Machine Learning · Computer Science 2021-06-08 Shu Liu , Shaojun Ma , Yongxin Chen , Hongyuan Zha , Haomin Zhou

We provide upper bounds of the expected Wasserstein distance between a probability measure and its empirical version, generalizing recent results for finite dimensional Euclidean spaces and bounded functional spaces. Such a generalization…

Statistics Theory · Mathematics 2020-01-29 Jing Lei

We present new algorithms to compute the mean of a set of empirical probability measures under the optimal transport metric. This mean, known as the Wasserstein barycenter, is the measure that minimizes the sum of its Wasserstein distances…

Machine Learning · Statistics 2014-06-18 Marco Cuturi , Arnaud Doucet

We develop a discrete optimal transport framework for analyzing simulated annealing algorithms on finite state spaces. Building on the discrete Wasserstein metric introduced by Maas (J. Funct. Anal., 2011), we define a generalized discrete…

Data Structures and Algorithms · Computer Science 2026-05-08 Yuchen He , Tianhui Jiang , Sihan Wang , Chihao Zhang

Wasserstein distributionally robust optimization offers a framework for model fitting in machine learning under potential shifts in the data distribution. We study a regularized variant of this problem in which entropic smoothing produces a…

Optimization and Control · Mathematics 2026-05-28 Tam Le

In the recent years Generative Adversarial Networks (GANs) have demonstrated significant progress in generating authentic looking data. In this work we introduce our simple method to exploit the advancements in well established image-based…

Machine Learning · Computer Science 2019-10-31 Eoin Brophy , Zhengwei Wang , Tomas E. Ward

Semi-supervision in Machine Learning can be used in searches for new physics where the signal plus background regions are not labelled. This strongly reduces model dependency in the search for signals Beyond the Standard Model. This…

High Energy Physics - Phenomenology · Physics 2022-02-04 Thabang Lebese , Xifeng Ruan

We propose a new method for smoothly interpolating probability measures using the geometry of optimal transport. To that end, we reduce this problem to the classical Euclidean setting, allowing us to directly leverage the extensive toolbox…

Wasserstein Discriminant Analysis (WDA) is a new supervised method that can improve classification of high-dimensional data by computing a suitable linear map onto a lower dimensional subspace. Following the blueprint of classical Linear…

Machine Learning · Statistics 2018-09-21 Rémi Flamary , Marco Cuturi , Nicolas Courty , Alain Rakotomamonjy

We study the convergence rate of the optimal quantization for a probability measure sequence $(\mu_{n})_{n\in\mathbb{N}^{*}}$ on $\mathbb{R}^{d}$ converging in the Wasserstein distance in two aspects: the first one is the convergence rate…

Statistics Theory · Mathematics 2020-02-20 Yating Liu , Gilles Pagès