English
Related papers

Related papers: The Barycenter Method for Direct Optimization: an …

200 papers

This paper studies the statistical estimation of exact Wasserstein barycenters. Existing non-asymptotic results for empirical barycenters exhibit a severe curse of dimensionality. Motivated by the semi-dual formulation of the barycenter…

Statistics Theory · Mathematics 2026-05-06 Pengtao Li , Changbo Zhu , Xiaohui Chen

We explore a robust version of the barycenter problem among $n$ centered Gaussian probability measures, termed Semi-Unbalanced Optimal Transport (SUOT)-based Barycenter, wherein the barycenter remains fixed while the others are relaxed…

Machine Learning · Computer Science 2024-10-11 Ngoc-Hai Nguyen , Dung Le , Hoang-Phi Nguyen , Tung Pham , Nhat Ho

In this thesis, we consider the Wasserstein barycenter problem of discrete probability measures from computational and statistical sides. The statistical focus is estimating the sample size of measures necessary to calculate an…

Optimization and Control · Mathematics 2021-10-26 Darina Dvinskikh

This paper presents an efficient algorithm for the progressive approximation of Wasserstein barycenters of persistence diagrams, with applications to the visual analysis of ensemble data. Given a set of scalar fields, our approach enables…

Graphics · Computer Science 2019-10-10 Jules Vidal , Joseph Budin , Julien Tierny

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

Optimization and Control · Mathematics 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

In many optimization problems arising from scientific, engineering and artificial intelligence applications, objective and constraint functions are available only as the output of a black-box or simulation oracle that does not provide…

Optimization and Control · Mathematics 2019-08-15 Jeffrey Larson , Matt Menickelly , Stefan M. Wild

This paper studies Bayesian ranking and selection (R&S) problems with correlated prior beliefs and continuous domains, i.e. Bayesian optimization (BO). Knowledge gradient methods [Frazier et al., 2008, 2009] have been widely studied for…

Machine Learning · Statistics 2017-07-28 Jian Wu , Peter I. Frazier

We consider the population Wasserstein barycenter problem for random probability measures supported on a finite set of points and generated by an online stream of data. This leads to a complicated stochastic optimization problem where the…

Optimization and Control · Mathematics 2021-12-06 Daniil Tiapkin , Alexander Gasnikov , Pavel Dvurechensky

This paper proposes a novel proximal-gradient algorithm for a decentralized optimization problem with a composite objective containing smooth and non-smooth terms. Specifically, the smooth and nonsmooth terms are dealt with by gradient and…

Optimization and Control · Mathematics 2021-02-02 Zhi Li , Wei Shi , Ming Yan

The problem of steering a particular class of $n$-dimensional continuous-time dynamical systems towards the minima of a function without gradient information is considered. We propose an hybrid controller, implementing a discrete-time…

Systems and Control · Electrical Eng. & Systems 2019-12-05 Alessandro Melis , Ricardo G. Sanfelice , Lorenzo Marconi

We develop an estimator-based stochastic fixed-point framework for approximately computing the 2-Wasserstein barycenter of continuous, non-parametric probability measures. Notably, we provide the first rigorous convergence analysis for…

Optimization and Control · Mathematics 2026-04-17 Zeyi Chen , Ariel Neufeld , Qikun Xiang

We consider decentralized gradient-free optimization of minimizing Lipschitz continuous functions that satisfy neither smoothness nor convexity assumption. We propose two novel gradient-free algorithms, the Decentralized Gradient-Free…

Optimization and Control · Mathematics 2025-01-29 Zhenwei Lin , Jingfan Xia , Qi Deng , Luo Luo

We study in this paper a variant of Wasserstein barycenter problem, which we refer to as tree-Wasserstein barycenter, by leveraging a specific class of ground metrics, namely tree metrics, for Wasserstein distance. Drawing on the tree…

Machine Learning · Statistics 2020-02-28 Tam Le , Viet Huynh , Nhat Ho , Dinh Phung , Makoto Yamada

The goal of this paper is to investigate an approach for derivative-free optimization that has not received sufficient attention in the literature and is yet one of the simplest to implement and parallelize. It consists of computing…

Optimization and Control · Mathematics 2021-02-22 Hao-Jun Michael Shi , Melody Qiming Xuan , Figen Oztoprak , Jorge Nocedal

We study first-order optimization algorithms for computing the barycenter of Gaussian distributions with respect to the optimal transport metric. Although the objective is geodesically non-convex, Riemannian GD empirically converges…

Optimization and Control · Mathematics 2023-11-01 Jason M. Altschuler , Sinho Chewi , Patrik Gerber , Austin J. Stromme

Novel coordinate descent (CD) methods are proposed for minimizing nonconvex functions consisting of three terms: (i) a continuously differentiable term, (ii) a simple convex term, and (iii) a concave and continuous term. First, by extending…

Optimization and Control · Mathematics 2019-09-15 Qi Deng , Chenghao Lan

We study the problem of zero-order optimization of a strongly convex function. The goal is to find the minimizer of the function by a sequential exploration of its values, under measurement noise. We study the impact of higher order…

Machine Learning · Computer Science 2022-11-28 Arya Akhavan , Massimiliano Pontil , Alexandre B. Tsybakov

In this work, multi-variable derivative-free optimization algorithms for unconstrained optimization problems are developed. A novel procedure for approximating the gradient of multi-variable objective functions based on non-commutative maps…

Optimization and Control · Mathematics 2021-11-17 Jan Feiling , Mohamed-Ali Belabbas , Christian Ebenbauer

Wasserstein barycenters have become popular due to their ability to represent the average of probability measures in a geometrically meaningful way. In this paper, we present an algorithm to approximate the Wasserstein-2 barycenters of…

Machine Learning · Computer Science 2023-01-10 Alexander Korotin , Vage Egiazarian , Lingxiao Li , Evgeny Burnaev

In this paper, we propose a new way to obtain optimal convergence rates for smooth stochastic (strong) convex optimization tasks. Our approach is based on results for optimization tasks where gradients have nonrandom noise. In contrast to…

Optimization and Control · Mathematics 2020-04-16 Darina Dvinskikh , Alexander Tyurin , Alexander Gasnikov , Sergey Omelchenko