English
Related papers

Related papers: Continuous Regularized Wasserstein Barycenters

200 papers

We study first-order optimization algorithms for computing the barycenter of Gaussian distributions with respect to the optimal transport metric. Although the objective is geodesically non-convex, Riemannian GD empirically converges…

Optimization and Control · Mathematics 2023-11-01 Jason M. Altschuler , Sinho Chewi , Patrik Gerber , Austin J. Stromme

Aggregating data from multiple sources can be formalized as an Optimal Transport (OT) barycenter problem, which seeks to compute the average of probability distributions with respect to OT discrepancies. However, in real-world scenarios,…

Machine Learning · Statistics 2025-04-15 Milena Gazdieva , Jaemoo Choi , Alexander Kolesov , Jaewoong Choi , Petr Mokrov , Alexander Korotin

We consider the optimization problem of minimizing a functional defined over a family of probability distributions, where the objective functional is assumed to possess a variational form. Such a distributional optimization problem arises…

Machine Learning · Computer Science 2024-04-02 Zhuoran Yang , Yufeng Zhang , Yongxin Chen , Zhaoran Wang

The Wasserstein barycenter has been widely studied in various fields, including natural language processing, and computer vision. However, it requires a high computational cost to solve the Wasserstein barycenter problem because the…

Artificial Intelligence · Computer Science 2022-02-14 Yuki Takezawa , Ryoma Sato , Zornitsa Kozareva , Sujith Ravi , Makoto Yamada

We study the problem of quantifying how far an empirical distribution deviates from Gaussianity under the framework of optimal transport. By exploiting the cone geometry of the relative translation invariant quadratic Wasserstein space, we…

Machine Learning · Computer Science 2026-02-02 Binshuai Wang , Peng Wei

Inverse problems in physical or biological sciences often involve recovering an unknown parameter that is random. The sought-after quantity is a probability distribution of the unknown parameter, that produces data that aligns with…

Machine Learning · Statistics 2024-10-02 Qin Li , Maria Oprea , Li Wang , Yunan Yang

This paper is devoted to the stochastic approximation of entropically regularized Wasserstein distances between two probability measures, also known as Sinkhorn divergences. The semi-dual formulation of such regularized optimal…

Statistics Theory · Mathematics 2024-12-10 Bernard Bercu , Jérémie Bigot

The sliced Wasserstein barycenter (SWB) is a widely acknowledged method for efficiently generalizing the averaging operation within probability measure spaces. However, achieving marginal fairness SWB, ensuring approximately equal distances…

Machine Learning · Statistics 2025-02-05 Khai Nguyen , Hai Nguyen , Nhat Ho

The so-called \emph{simplified} Wasserstein barycenter problem, also known as the cheapest hub problem, consists in selecting one point from each of $k$ given sets, each set consisting of $n$ points, with the aim of minimizing the sum of…

Optimization and Control · Mathematics 2025-11-07 Woosuk L. Jung , Henry Wolkowicz

We propose the linear barycentric coding model (LBCM) which utilizes the linear optimal transport (LOT) metric for analysis and synthesis of probability measures. We provide a closed-form solution to the variational problem characterizing…

Machine Learning · Statistics 2025-04-09 Matthew Werenski , Brendan Mallery , Shuchin Aeron , James M. Murphy

Optimal transport (OT) provides powerful tools for comparing probability measures in various types. The Wasserstein distance which arises naturally from the idea of OT is widely used in many machine learning applications. Unfortunately,…

Optimization and Control · Mathematics 2021-06-03 Shu Liu , Haodong Sun , Hongyuan Zha

Various statistical tasks, including sampling or computing Wasserstein barycenters, can be reformulated as fixed-point problems for operators on probability distributions. Accelerating standard fixed-point iteration schemes provides a…

Optimization and Control · Mathematics 2026-01-30 Vitalii Aksenov , Martin Eigel , Mathias Oster

We consider robust variants of the standard optimal transport, named robust optimal transport, where marginal constraints are relaxed via Kullback-Leibler divergence. We show that Sinkhorn-based algorithms can approximate the optimal cost…

Machine Learning · Computer Science 2021-10-29 Khang Le , Huy Nguyen , Quang Nguyen , Tung Pham , Hung Bui , Nhat Ho

A generalization of the Wasserstein metric, the integrated transportation distance, establishes a novel distance between probability kernels of Markov systems. This metric serves as the foundation for an efficient approximation technique,…

Machine Learning · Computer Science 2023-12-07 Zhengqi Lin , Andrzej Ruszczynski

The clustering problem, and more generally, latent factor discovery --or latent space inference-- is formulated in terms of the Wasserstein barycenter problem from optimal transport. The objective proposed is the maximization of the…

Optimization and Control · Mathematics 2026-02-18 Hongkang Yang , Esteban G. Tabak

As the problem of minimizing functionals on the Wasserstein space encompasses many applications in machine learning, different optimization algorithms on $\mathbb{R}^d$ have received their counterpart analog on the Wasserstein space. We…

Optimization and Control · Mathematics 2024-11-20 Clément Bonet , Théo Uscidda , Adam David , Pierre-Cyril Aubin-Frankowski , Anna Korba

Multi-marginal optimal transport enables one to compare multiple probability measures, which increasingly finds application in multi-task learning problems. One practical limitation of multi-marginal transport is computational scalability…

Divide-and-conquer based methods for Bayesian inference provide a general approach for tractable posterior inference when the sample size is large. These methods divide the data into smaller subsets, sample from the posterior distribution…

Methodology · Statistics 2018-06-21 Sanvesh Srivastava , Cheng Li , David B. Dunson

As a natural approach to modeling system safety conditions, chance constraint (CC) seeks to satisfy a set of uncertain inequalities individually or jointly with high probability. Although a joint CC offers stronger reliability certificate,…

Optimization and Control · Mathematics 2022-04-04 Haoming Shen , Ruiwei Jiang

We study the Wasserstein natural gradient in parametric statistical models with continuous sample spaces. Our approach is to pull back the $L^2$-Wasserstein metric tensor in the probability density space to a parameter space, equipping the…

Optimization and Control · Mathematics 2024-08-20 Yifan Chen , Wuchen Li