English
Related papers

Related papers: On the Existence of Optimal Transport Gradient for…

200 papers

Optimal transport (OT) and Gromov-Wasserstein (GW) alignment are powerful frameworks for geometrically driven matching of probability distributions, yet their large-scale usage is hampered by high statistical and computational costs.…

Statistics Theory · Mathematics 2026-02-04 Tao Wang , Ziv Goldfeld

Since their invention, generative adversarial networks (GANs) have become a popular approach for learning to model a distribution of real (unlabeled) data. Convergence problems during training are overcome by Wasserstein GANs which minimize…

Machine Learning · Statistics 2018-03-06 Henning Petzka , Asja Fischer , Denis Lukovnicov

This paper addresses the practical challenge in Entropic Optimal Transport (EOT) where the underlying ground cost function is typically latent and unobserved. Rather than assuming a fixed geometric cost, we adopt a data-driven approach…

Optimization and Control · Mathematics 2026-05-13 Antoine Debouchage , Xiaozhen Wang , Zhenjie Ren , Francois Buet-Golfouse

In this note, I review entropy-regularized Monge-Kantorovich problem in Optimal Transport, and derive the gradients of several popular algorithms popular in Computational Optimal Transport, including the Sinkhorn algorithms, Wasserstein…

Optimization and Control · Mathematics 2025-12-04 Fangzhou Xie

Optimal Transport is a foundational mathematical theory that connects optimization, partial differential equations, and probability. It offers a powerful framework for comparing probability distributions and has recently become an important…

Machine Learning · Statistics 2025-05-13 Gabriel Peyré

We investigate the training and performance of generative adversarial networks using the Maximum Mean Discrepancy (MMD) as critic, termed MMD GANs. As our main theoretical contribution, we clarify the situation with bias in GAN loss…

Machine Learning · Statistics 2021-01-15 Mikołaj Bińkowski , Danica J. Sutherland , Michael Arbel , Arthur Gretton

In this work, we show the intrinsic relations between optimal transportation and convex geometry, especially the variational approach to solve Alexandrov problem: constructing a convex polytope with prescribed face normals and volumes. This…

Machine Learning · Computer Science 2017-12-20 Na Lei , Kehua Su , Li Cui , Shing-Tung Yau , David Xianfeng Gu

The analysis of parametric and non-parametric uncertainties of very large dynamical systems requires the construction of a stochastic model of said system. Linear approaches relying on random matrix theory and principal componant analysis…

Machine Learning · Statistics 2023-02-02 Hamza Boukraichi , Nissrine Akkari , Fabien Casenave , David Ryckelynck

We present a novel method for efficiently computing optimal transport maps and Wasserstein barycenters in high-dimensional spaces. Our approach uses conditional normalizing flows to approximate the input distributions as invertible…

Machine Learning · Statistics 2025-05-29 Gabriele Visentin , Patrick Cheridito

We provide statistical theory for conditional and unconditional Wasserstein generative adversarial networks (WGANs) in the framework of dependent observations. We prove upper bounds for the excess Bayes risk of the WGAN estimators with…

Statistics Theory · Mathematics 2020-11-09 Moritz Haas , Stefan Richter

We propose a new equilibrium enforcing method paired with a loss derived from the Wasserstein distance for training auto-encoder based Generative Adversarial Networks. This method balances the generator and discriminator during training.…

Machine Learning · Computer Science 2017-06-02 David Berthelot , Thomas Schumm , Luke Metz

Semidiscrete optimal transport is a challenging generalization of the classical transportation problem in linear programming. The goal is to design a joint distribution for two random variables (one continuous, one discrete) with fixed…

Econometrics · Economics 2026-01-22 Yinchu Zhu , Ilya O. Ryzhov

We consider the optimization problem of minimizing a functional defined over a family of probability distributions, where the objective functional is assumed to possess a variational form. Such a distributional optimization problem arises…

Machine Learning · Computer Science 2024-04-02 Zhuoran Yang , Yufeng Zhang , Yongxin Chen , Zhaoran Wang

In [Q. Liao et al., Commun. Math. Sci., 20(2022)], a linear-time Sinkhorn algorithm is developed based on dynamic programming, which significantly reduces the computational complexity involved in solving optimal transport problems. However,…

Optimization and Control · Mathematics 2025-03-25 Ziyuan Lyu , Zihao Wang , Hao Wu , Shuai Yang

Optimal Transport (OT) distances such as Wasserstein have been used in several areas such as GANs and domain adaptation. OT, however, is very sensitive to outliers (samples with large noise) in the data since in its objective function,…

Machine Learning · Computer Science 2020-10-13 Yogesh Balaji , Rama Chellappa , Soheil Feizi

We consider the fundamental problem of sampling the optimal transport coupling between given source and target distributions. In certain cases, the optimal transport plan takes the form of a one-to-one mapping from the source support to the…

Machine Learning · Computer Science 2025-10-28 Mara Daniels , Tyler Maunu , Paul Hand

Inspired by ideas from optimal transport theory we present Trust the Critics (TTC), a new algorithm for generative modelling. This algorithm eliminates the trainable generator from a Wasserstein GAN; instead, it iteratively modifies the…

Machine Learning · Computer Science 2021-12-01 Tristan Milne , Étienne Bilocq , Adrian Nachman

We propose and study the problem of distribution-preserving lossy compression. Motivated by recent advances in extreme image compression which allow to maintain artifact-free reconstructions even at very low bitrates, we propose to optimize…

Machine Learning · Computer Science 2018-10-30 Michael Tschannen , Eirikur Agustsson , Mario Lucic

Generative Adversarial Networks are a popular method for learning distributions from data by modeling the target distribution as a function of a known distribution. The function, often referred to as the generator, is optimized to minimize…

Machine Learning · Computer Science 2021-11-03 Daria Reshetova , Yikun Bai , Xiugang Wu , Ayfer Ozgur

Generative modelling is often cast as minimizing a similarity measure between a data distribution and a model distribution. Recently, a popular choice for the similarity measure has been the Wasserstein metric, which can be expressed in the…

Machine Learning · Computer Science 2019-10-10 Anton Mallasto , Guido Montúfar , Augusto Gerolin