English
Related papers

Related papers: Wasserstein-2 Generative Networks

200 papers

We propose a new algorithm that uses an auxiliary neural network to express the potential of the optimal transport map between two data distributions. In the sequel, we use the aforementioned map to train generative networks. Unlike WGANs,…

Machine Learning · Computer Science 2020-04-21 Vaios Laschos , Jan Tinapp , Klaus Obermayer

Generative Adversarial Networks (GANs) are one of the most practical methods for learning data distributions. A popular GAN formulation is based on the use of Wasserstein distance as a metric between probability distributions.…

Machine Learning · Computer Science 2018-05-23 Maziar Sanjabi , Jimmy Ba , Meisam Razaviyayn , Jason D. Lee

Wasserstein barycenters provide a geometric notion of the weighted average of probability measures based on optimal transport. In this paper, we present a scalable algorithm to compute Wasserstein-2 barycenters given sample access to the…

Machine Learning · Computer Science 2022-01-02 Alexander Korotin , Lingxiao Li , Justin Solomon , Evgeny Burnaev

This paper provides a simple procedure to fit generative networks to target distributions, with the goal of a small Wasserstein distance (or other optimal transport costs). The approach is based on two principles: (a) if the source…

Machine Learning · Computer Science 2019-06-12 Yucheng Chen , Matus Telgarsky , Chao Zhang , Bolton Bailey , Daniel Hsu , Jian Peng

We propose a stable method to train Wasserstein generative adversarial networks. In order to enhance stability, we consider two objective functions using the $c$-transform based on Kantorovich duality which arises in the theory of optimal…

Machine Learning · Computer Science 2021-10-28 Dohyun Kwon , Yeoneung Kim , Guido Montúfar , Insoon Yang

We introduce a new method for training generative adversarial networks by applying the Wasserstein-2 metric proximal on the generators. The approach is based on Wasserstein information geometry. It defines a parametrization invariant…

Machine Learning · Computer Science 2021-02-16 Alex Tong Lin , Wuchen Li , Stanley Osher , Guido Montufar

It was recently shown that under smoothness conditions, the squared Wasserstein distance between two distributions could be efficiently computed with appealing statistical error upper bounds. However, rather than the distance itself, the…

Machine Learning · Statistics 2021-12-30 Boris Muzellec , Adrien Vacher , Francis Bach , François-Xavier Vialard , Alessandro Rudi

We provide a framework to approximate the 2-Wasserstein distance and the optimal transport map, amenable to efficient training as well as statistical and geometric analysis. With the quadratic cost and considering the Kantorovich dual form…

Optimization and Control · Mathematics 2019-02-20 Amirhossein Taghvaei , Amin Jalali

Wasserstein Barycenter is a principled approach to represent the weighted mean of a given set of probability distributions, utilizing the geometry induced by optimal transport. In this work, we present a novel scalable algorithm to…

Machine Learning · Computer Science 2021-11-30 Jiaojiao Fan , Amirhossein Taghvaei , Yongxin Chen

With the discovery of Wasserstein GANs, Optimal Transport (OT) has become a powerful tool for large-scale generative modeling tasks. In these tasks, OT cost is typically used as the loss for training GANs. In contrast to this approach, we…

Machine Learning · Computer Science 2022-03-08 Litu Rout , Alexander Korotin , Evgeny Burnaev

We propose a family of relaxations of the optimal transport problem which regularize the problem by introducing an additional minimization step over a small region around one of the underlying transporting measures. The type of…

Machine Learning · Statistics 2019-06-11 Saied Mahdian , Jose Blanchet , Peter Glynn

Computing optimal transport maps between high-dimensional and continuous distributions is a challenging problem in optimal transport (OT). Generative adversarial networks (GANs) are powerful generative models which have been successfully…

Machine Learning · Computer Science 2019-06-25 Jacob Leygonie , Jennifer She , Amjad Almahairi , Sai Rajeswar , Aaron Courville

Making sense of Wasserstein distances between discrete measures in high-dimensional settings remains a challenge. Recent work has advocated a two-step approach to improve robustness and facilitate the computation of optimal transport, using…

Machine Learning · Computer Science 2019-09-04 François-Pierre Paty , Marco Cuturi

Suppose we are given two metric spaces and a family of continuous transformations from one to the other. Given a probability distribution on each of these two spaces - namely the source and the target measures - the Wasserstein alignment…

Probability · Mathematics 2025-03-11 Soumik Pal , Bodhisattva Sen , Ting-Kam Leonard Wong

Despite the recent popularity of neural network-based solvers for optimal transport (OT), there is no standard quantitative way to evaluate their performance. In this paper, we address this issue for quadratic-cost transport --…

Machine Learning · Computer Science 2021-10-26 Alexander Korotin , Lingxiao Li , Aude Genevay , Justin Solomon , Alexander Filippov , Evgeny Burnaev

In this work, we propose a novel generalized Wasserstein-2 distance approach for efficiently training stochastic neural networks to reconstruct random field models, where the target random variable comprises both continuous and categorical…

Machine Learning · Computer Science 2025-07-08 Mingtao Xia , Qijing Shen

Conventional full-waveform inversion (FWI) using the least-squares norm ($L^2$) as a misfit function is known to suffer from cycle skipping. This increases the risk of computing a local rather than the global minimum of the misfit. In our…

Geophysics · Physics 2017-05-12 Yunan Yang , Björn Engquist , Junzhe Sun , Brittany D. Froese

We study Benamou's domain decomposition algorithm for optimal transport in the entropy regularized setting. The key observation is that the regularized variant converges to the globally optimal solution under very mild assumptions. We prove…

Optimization and Control · Mathematics 2021-11-23 Mauro Bonafini , Bernhard Schmitzer

Learning algorithms for implicit generative models can optimize a variety of criteria that measure how the data distribution differs from the implicit model distribution, including the Wasserstein distance, the Energy distance, and the…

Machine Learning · Statistics 2019-08-23 Leon Bottou , Martin Arjovsky , David Lopez-Paz , Maxime Oquab

The mathematical forces at work behind Generative Adversarial Networks raise challenging theoretical issues. Motivated by the important question of characterizing the geometrical properties of the generated distributions, we provide a…

Machine Learning · Statistics 2023-10-06 Arthur Stéphanovitch , Ugo Tanielian , Benoît Cadre , Nicolas Klutchnikoff , Gérard Biau
‹ Prev 1 2 3 10 Next ›