English
Related papers

Related papers: The Barycenter Method for Direct Optimization

200 papers

Given a collection of probability measures, a practitioner sometimes needs to find an "average" distribution which adequately aggregates reference distributions. A theoretically appealing notion of such an average is the Wasserstein…

In many applications in statistics and machine learning, the availability of data samples from multiple possibly heterogeneous sources has become increasingly prevalent. On the other hand, in distributionally robust optimization, we seek…

Machine Learning · Statistics 2022-05-31 Tim Tsz-Kit Lau , Han Liu

Efficiently aggregating data from different sources is a challenging problem, particularly when samples from each source are distributed differently. These differences can be inherent to the inference task or present for other reasons:…

Machine Learning · Computer Science 2017-11-15 Matthew Staib , Sebastian Claici , Justin Solomon , Stefanie Jegelka

Computing the unregularized Wasserstein barycenter for measure-valued data is a challenging optimization task. Recent algorithms have been tailored to either discrete measures as point clouds or continuous measures discretized on regular…

Optimization and Control · Mathematics 2026-05-13 Peng Xu , Changbo Zhu , Xiaohui Chen

This paper studies the statistical estimation of exact Wasserstein barycenters. Existing non-asymptotic results for empirical barycenters exhibit a severe curse of dimensionality. Motivated by the semi-dual formulation of the barycenter…

Statistics Theory · Mathematics 2026-05-06 Pengtao Li , Changbo Zhu , Xiaohui Chen

We explore a robust version of the barycenter problem among $n$ centered Gaussian probability measures, termed Semi-Unbalanced Optimal Transport (SUOT)-based Barycenter, wherein the barycenter remains fixed while the others are relaxed…

Machine Learning · Computer Science 2024-10-11 Ngoc-Hai Nguyen , Dung Le , Hoang-Phi Nguyen , Tung Pham , Nhat Ho

Aggregating data from multiple sources can be formalized as an Optimal Transport (OT) barycenter problem, which seeks to compute the average of probability distributions with respect to OT discrepancies. However, in real-world scenarios,…

Machine Learning · Statistics 2025-04-15 Milena Gazdieva , Jaemoo Choi , Alexander Kolesov , Jaewoong Choi , Petr Mokrov , Alexander Korotin

We propose a new class of rigorous methods for derivative-free optimization with the aim of delivering efficient and robust numerical performance for functions of all types, from smooth to non-smooth, and under different noise regimes. To…

Optimization and Control · Mathematics 2022-10-31 Albert S. Berahas , Oumaima Sohab , Luis Nunes Vicente

The optimal transportation problem defines a geometry of probability measures which leads to a definition for weighted averages (barycenters) of measures, finding application in the machine learning and computer vision communities as a…

Machine Learning · Statistics 2026-03-31 David Gentile , James M. Murphy

We present a novel method for efficiently computing optimal transport maps and Wasserstein barycenters in high-dimensional spaces. Our approach uses conditional normalizing flows to approximate the input distributions as invertible…

Machine Learning · Statistics 2025-05-29 Gabriele Visentin , Patrick Cheridito

A novel class of derivative-free optimization algorithms is developed. The main idea is to utilize certain non-commutative maps in order to approximate the gradient of the objective function. Convergence properties of the novel algorithms…

Optimization and Control · Mathematics 2018-05-21 Jan Feiling , Amelie Zeller , Christian Ebenbauer

The problem of steering a particular class of $n$-dimensional continuous-time dynamical systems towards the minima of a function without gradient information is considered. We propose an hybrid controller, implementing a discrete-time…

Systems and Control · Electrical Eng. & Systems 2019-12-05 Alessandro Melis , Ricardo G. Sanfelice , Lorenzo Marconi

We develop an estimator-based stochastic fixed-point framework for approximately computing the 2-Wasserstein barycenter of continuous, non-parametric probability measures. Notably, we provide the first rigorous convergence analysis for…

Optimization and Control · Mathematics 2026-04-17 Zeyi Chen , Ariel Neufeld , Qikun Xiang

Wasserstein Barycenter is a principled approach to represent the weighted mean of a given set of probability distributions, utilizing the geometry induced by optimal transport. In this work, we present a novel scalable algorithm to…

Machine Learning · Computer Science 2021-11-30 Jiaojiao Fan , Amirhossein Taghvaei , Yongxin Chen

In this paper, we consider the problem of computing the barycenter of a set of probability distributions under the Sinkhorn divergence. This problem has recently found applications across various domains, including graphics, learning, and…

Machine Learning · Computer Science 2020-07-22 Zebang Shen , Zhenfu Wang , Alejandro Ribeiro , Hamed Hassani

We consider decentralized gradient-free optimization of minimizing Lipschitz continuous functions that satisfy neither smoothness nor convexity assumption. We propose two novel gradient-free algorithms, the Decentralized Gradient-Free…

Optimization and Control · Mathematics 2025-01-29 Zhenwei Lin , Jingfan Xia , Qi Deng , Luo Luo

We present new algorithms to compute the mean of a set of empirical probability measures under the optimal transport metric. This mean, known as the Wasserstein barycenter, is the measure that minimizes the sum of its Wasserstein distances…

Machine Learning · Statistics 2014-06-18 Marco Cuturi , Arnaud Doucet

Optimizing a function without using derivatives is a challenging paradigm, that precludes from using classical algorithms from nonlinear optimization, and may thus seem intractable other than by using heuristics. Nevertheless, the field of…

Optimization and Control · Mathematics 2025-06-06 K. J. Dzahini , F. Rinaldi , C. W. Royer , D. Zeffiro

In this thesis, we consider the Wasserstein barycenter problem of discrete probability measures from computational and statistical sides. The statistical focus is estimating the sample size of measures necessary to calculate an…

Optimization and Control · Mathematics 2021-10-26 Darina Dvinskikh

We consider smooth stochastic convex optimization problems in the context of algorithms which are based on directional derivatives of the objective function. This context can be considered as an intermediate one between derivative-free…

Optimization and Control · Mathematics 2020-09-22 Pavel Dvurechensky , Eduard Gorbunov , Alexander Gasnikov