English
Related papers

Related papers: Variational Wasserstein Barycenters with c-Cyclica…

200 papers

Wasserstein distributionally robust optimization offers a framework for model fitting in machine learning under potential shifts in the data distribution. We study a regularized variant of this problem in which entropic smoothing produces a…

Optimization and Control · Mathematics 2026-05-28 Tam Le

Communication is one of the bottlenecks of distributed optimisation and learning. To overcome this bottleneck, we propose a novel quantization method that transforms a vector into a sample of components' indices drawn from a categorical…

Optimization and Control · Mathematics 2025-01-31 Dmitrii Pasechniuk , Pavel Dvurechensky , César A. Uribe , Alexander Gasnikov

In the machine learning and optimization community, there are two main approaches for the convex risk minimization problem, namely, the Stochastic Approximation (SA) and the Sample Average Approximation (SAA). In terms of oracle complexity…

Optimization and Control · Mathematics 2021-10-26 Darina Dvinskikh

Wasserstein distances are metrics on probability distributions inspired by the problem of optimal mass transportation. Roughly speaking, they measure the minimal effort required to reconfigure the probability mass of one distribution in…

Methodology · Statistics 2019-04-10 Victor M. Panaretos , Yoav Zemel

The topological patterns exhibited by many real-world networks motivate the development of topology-based methods for assessing the similarity of networks. However, extracting topological structure is difficult, especially for large and…

Machine Learning · Computer Science 2022-03-15 Tananun Songdechakraiwut , Bryan M. Krause , Matthew I. Banks , Kirill V. Nourski , Barry D. Van Veen

Particle-based variational inference offers a flexible way of approximating complex posterior distributions with a set of particles. In this paper we introduce a new particle-based variational inference method based on the theory of…

Machine Learning · Statistics 2019-05-16 Luca Ambrogioni , Umut Guclu , Marcel van Gerven

In this work clustering schemes for uncertain and structured data are considered relying on the notion of Wasserstein barycenters, accompanied by appropriate clustering indices based on the intrinsic geometry of the Wasserstein space where…

The sliced Wasserstein barycenter (SWB) is a widely acknowledged method for efficiently generalizing the averaging operation within probability measure spaces. However, achieving marginal fairness SWB, ensuring approximately equal distances…

Machine Learning · Statistics 2025-02-05 Khai Nguyen , Hai Nguyen , Nhat Ho

Divide-and-conquer based methods for Bayesian inference provide a general approach for tractable posterior inference when the sample size is large. These methods divide the data into smaller subsets, sample from the posterior distribution…

Methodology · Statistics 2018-06-21 Sanvesh Srivastava , Cheng Li , David B. Dunson

In this paper, based on the Fr{\'e}chet mean, we define a notion of barycenter corresponding to a usual notion of statistical mean. We prove the existence of Wasserstein barycenters of random distributions defined on a geodesic space (E,…

Statistics Theory · Mathematics 2016-02-15 Thibaut Le Gouic , Jean-Michel Loubes

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Machine Learning · Statistics 2024-11-05 Daniel Kuhn , Peyman Mohajerin Esfahani , Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh

The Wasserstein barycenter has been widely studied in various fields, including natural language processing, and computer vision. However, it requires a high computational cost to solve the Wasserstein barycenter problem because the…

Artificial Intelligence · Computer Science 2022-02-14 Yuki Takezawa , Ryoma Sato , Zornitsa Kozareva , Sujith Ravi , Makoto Yamada

We develop a class of barycenter problems based on mean field control problems in three dimensions with associated reactive-diffusion systems of unnormalized multi-species densities. This problem is the generalization of the Wasserstein…

Optimization and Control · Mathematics 2024-04-03 Arjun Vijaywargiya , Guosheng Fu , Stanley Osher , Wuchen Li

The optimal transportation problem defines a geometry of probability measures which leads to a definition for weighted averages (barycenters) of measures, finding application in the machine learning and computer vision communities as a…

Machine Learning · Statistics 2026-03-31 David Gentile , James M. Murphy

Optimal transport has recently proved to be a useful tool in various machine learning applications needing comparisons of probability measures. Among these, applications of distributionally robust optimization naturally involve Wasserstein…

Optimization and Control · Mathematics 2023-03-24 Waïss Azizian , Franck Iutzeler , Jérôme Malick

The Wasserstein distance received a lot of attention recently in the community of machine learning, especially for its principled way of comparing distributions. It has found numerous applications in several hard problems, such as domain…

Machine Learning · Statistics 2017-10-23 Nicolas Courty , Rémi Flamary , Mélanie Ducoffe

We propose an efficient federated dual decomposition algorithm for calculating the Wasserstein barycenter of several distributions, including choosing the support of the solution. The algorithm does not access local data and uses only…

Machine Learning · Computer Science 2025-07-29 Zhengqi Lin , Andrzej Ruszczyński

We develop a general theory to address a consensus-based combination of estimations in a parallelized or distributed estimation setting. Taking into account the possibility of very discrepant estimations, instead of a full consensus we…

Methodology · Statistics 2017-05-12 P. C. Álvarez-Esteban , E. del Barrio , J. A. Cuesta-Albertos , C. Matrán

Wasserstein dictionary learning is an unsupervised approach to learning a collection of probability distributions that generate observed distributions as Wasserstein barycentric combinations. Existing methods for Wasserstein dictionary…

Machine Learning · Computer Science 2022-10-24 Marshall Mueller , Shuchin Aeron , James M. Murphy , Abiy Tasissa

We consider stochastic programs where the distribution of the uncertain parameters is only observable through a finite training dataset. Using the Wasserstein metric, we construct a ball in the space of (multivariate and non-discrete)…

Optimization and Control · Mathematics 2017-06-14 Peyman Mohajerin Esfahani , Daniel Kuhn