English
Related papers

Related papers: Wasserstein Variational Inference

200 papers

Gromov-Wasserstein distance has found many applications in machine learning due to its ability to compare measures across metric spaces and its invariance to isometric transformations. However, in certain applications, this invariance…

Machine Learning · Computer Science 2023-07-20 Pinar Demetci , Quang Huy Tran , Ievgen Redko , Ritambhara Singh

In many applications in statistics and machine learning, the availability of data samples from multiple possibly heterogeneous sources has become increasingly prevalent. On the other hand, in distributionally robust optimization, we seek…

Machine Learning · Statistics 2022-05-31 Tim Tsz-Kit Lau , Han Liu

Particle-based variational inference methods (ParVIs) have gained attention in the Bayesian inference literature, for their capacity to yield flexible and accurate approximations. We explore ParVIs from the perspective of Wasserstein…

Machine Learning · Statistics 2019-07-17 Chang Liu , Jingwei Zhuo , Pengyu Cheng , Ruiyi Zhang , Jun Zhu , Lawrence Carin

We propose a stable method to train Wasserstein generative adversarial networks. In order to enhance stability, we consider two objective functions using the $c$-transform based on Kantorovich duality which arises in the theory of optimal…

Machine Learning · Computer Science 2021-10-28 Dohyun Kwon , Yeoneung Kim , Guido Montúfar , Insoon Yang

Inference networks of traditional Variational Autoencoders (VAEs) are typically amortized, resulting in relatively inaccurate posterior approximation compared to instance-wise variational optimization. Recent semi-amortized approaches were…

Machine Learning · Computer Science 2020-11-18 Minyoung Kim , Vladimir Pavlovic

We introduce the observable Wasserstein distance, a framework for deriving lower bounds on the Wasserstein distance between probability measures on Polish metric spaces, designed to bypass the computational intractability of exact optimal…

Metric Geometry · Mathematics 2026-05-12 Edivaldo Lopes dos Santos , Leandro Vicente Mauri , Washington Mio , Tom Needham

To quantify the dependence between two random vectors of possibly different dimensions, we propose to rely on the properties of the 2-Wasserstein distance. We first propose two coefficients that are based on the Wasserstein distance between…

Statistics Theory · Mathematics 2021-10-19 Gilles Mordant , Johan Segers

This work establishes a framework for solving inverse boundary problems with the geodesic based quadratic Wasserstein distance ($W_{2}$). A general form of the Fr\'echet gradient is systematically derived by optimal transportation (OT)…

Numerical Analysis · Mathematics 2022-10-31 Gang Bao , Yixuan Zhang

A new method for learning variational autoencoders (VAEs) is developed, based on Stein variational gradient descent. A key advantage of this approach is that one need not make parametric assumptions about the form of the encoder…

Machine Learning · Computer Science 2017-11-20 Yunchen Pu , Zhe Gan , Ricardo Henao , Chunyuan Li , Shaobo Han , Lawrence Carin

While statistical modeling of distributional data has gained increased attention, the case of multivariate distributions has been somewhat neglected despite its relevance in various applications. This is because the Wasserstein distance,…

Methodology · Statistics 2025-10-21 Han Chen , Yidong Zhou , Hans-Georg Müller

Wasserstein Gradient Flows (WGF) with respect to specific functionals have been widely used in the machine learning literature. Recently, neural networks have been adopted to approximate certain intractable parts of the underlying…

Machine Learning · Computer Science 2024-01-26 Huminhao Zhu , Fangyikang Wang , Chao Zhang , Hanbin Zhao , Hui Qian

We establish the first mathematically rigorous link between Bayesian, variational Bayesian, and ensemble methods. A key step towards this it to reformulate the non-convex optimisation problem typically encountered in deep learning as a…

Machine Learning · Statistics 2023-10-24 Veit David Wild , Sahra Ghalebikesabi , Dino Sejdinovic , Jeremias Knoblauch

Variational inference methods often focus on the problem of efficient model optimization, with little emphasis on the choice of the approximating posterior. In this paper, we review and implement the various methods that enable us to…

Machine Learning · Statistics 2017-07-11 Siddhartha Saxena , Shibhansh Dohare , Jaivardhan Kapoor

Wasserstein barycenters correspond to optimal solutions of transportation problems for several marginals, and as such have a wide range of applications ranging from economics to statistics and computer science. When the marginal probability…

Optimization and Control · Mathematics 2015-08-11 Ethan Anderes , Steffen Borgwardt , Jacob Miller

Generative Adversarial Networks (GANs) have been impactful on many problems and applications but suffer from unstable training. The Wasserstein GAN (WGAN) leverages the Wasserstein distance to avoid the caveats in the minmax two-player…

Machine Learning · Statistics 2021-09-14 Yao Chen , Qingyi Gao , Xiao Wang

In this paper we study generative modeling via autoencoders while using the elegant geometric properties of the optimal transport (OT) problem and the Wasserstein distances. We introduce Sliced-Wasserstein Autoencoders (SWAE), which are…

Machine Learning · Computer Science 2018-06-28 Soheil Kolouri , Phillip E. Pope , Charles E. Martin , Gustavo K. Rohde

We study Fokker--Planck equations with symmetric, positive definite mobility matrices capturing diffusion in heterogeneous environments. A weighted Wasserstein metric is introduced for which these equations are gradient flows. This metric…

Optimization and Control · Mathematics 2025-05-19 Hailiang Liu , Athanasios E. Tzavaras

A common feature of methods for analyzing samples of probability density functions is that they respect the geometry inherent to the space of densities. Once a metric is specified for this space, the Fr\'echet mean is typically used to…

Methodology · Statistics 2018-12-20 Alexander Petersen , Hans-Georg Müller

We propose a new formulation and learning strategy for computing the Wasserstein geodesic between two probability distributions in high dimensions. By applying the method of Lagrange multipliers to the dynamic formulation of the optimal…

Machine Learning · Computer Science 2021-06-08 Shu Liu , Shaojun Ma , Yongxin Chen , Hongyuan Zha , Haomin Zhou

We propose a unified data-driven framework based on inverse optimal transport that can learn adaptive, nonlinear interaction cost function from noisy and incomplete empirical matching matrix and predict new matching in various matching…

Machine Learning · Statistics 2018-11-01 Ruilin Li , Xiaojing Ye , Haomin Zhou , Hongyuan Zha