English
Related papers

Related papers: Distributed Optimization with Quantization for Com…

200 papers

We develop a novel clustering method for distributional data, where each data point is regarded as a probability distribution on the real line. For distributional data, it has been challenging to develop a clustering method that utilizes…

Methodology · Statistics 2025-06-24 Ryo Okano , Masaaki Imaizumi

We propose a new distributed optimization algorithm for solving a class of constrained optimization problems in which (a) the objective function is separable (i.e., the sum of local objective functions of agents), (b) the optimization…

Optimization and Control · Mathematics 2021-06-16 Van Sy Mai , Richard J. La , Tao Zhang , Abdella Battou

We explore a robust version of the barycenter problem among $n$ centered Gaussian probability measures, termed Semi-Unbalanced Optimal Transport (SUOT)-based Barycenter, wherein the barycenter remains fixed while the others are relaxed…

Machine Learning · Computer Science 2024-10-11 Ngoc-Hai Nguyen , Dung Le , Hoang-Phi Nguyen , Tung Pham , Nhat Ho

We propose a communication- and computation-efficient distributed optimization algorithm using second-order information for solving empirical risk minimization (ERM) problems with a nonsmooth regularization term. Our algorithm is applicable…

Machine Learning · Computer Science 2019-12-16 Ching-pei Lee , Cong Han Lim , Stephen J. Wright

This short paper presents a general approach for computing robust Wasserstein barycenters of persistence diagrams. The classical method consists in computing assignment arithmetic means after finding the optimal transport plans between the…

Machine Learning · Computer Science 2026-01-22 Keanu Sisouk , Eloi Tanguy , Julie Delon , Julien Tierny

In this work we consider regularized Wasserstein barycenters (average in Wasserstein distance) in Fourier basis. We prove that random Fourier parameters of the barycenter converge to some Gaussian random vector by distribution. The…

Statistics Theory · Mathematics 2021-09-21 Nazar Buzun

The so-called \emph{simplified} Wasserstein barycenter problem, also known as the cheapest hub problem, consists in selecting one point from each of $k$ given sets, each set consisting of $n$ points, with the aim of minimizing the sum of…

Optimization and Control · Mathematics 2025-11-07 Woosuk L. Jung , Henry Wolkowicz

Scaling algorithms for entropic transport-type problems have become a very popular numerical method, encompassing Wasserstein barycenters, multi-marginal problems, gradient flows and unbalanced transport. However, a standard implementation…

Optimization and Control · Mathematics 2019-02-12 Bernhard Schmitzer

This article details a novel numerical scheme to approximate gradient flows for optimal transport (i.e. Wasserstein) metrics. These flows have proved useful to tackle theoretically and numerically non-linear diffusion equations that model…

Optimization and Control · Mathematics 2015-03-10 Gabriel Peyré

Motivated by the growing need for black-box optimization and data privacy, we introduce a collaborative Bayesian optimization (BO) framework that addresses both of these challenges. In this framework agents work collaboratively to optimize…

Machine Learning · Computer Science 2025-04-16 Donglin Zhan , Haoting Zhang , Rhonda Righter , Zeyu Zheng , James Anderson

We propose two distributed iterative algorithms that can be used to solve, in finite time, the distributed optimization problem over quadratic local cost functions in large-scale networks. The first algorithm exhibits synchronous operation…

This paper presents a concise overview of sensitivity-based methods for solving large-scale optimization problems in distributed fashion. The approach relies on sensitivities and primal decomposition to achieve coordination between the…

Optimization and Control · Mathematics 2025-12-10 Maximilian Pierer von Esch , Andreas Völz , Knut Graichen

In this paper, we propose and analyze an efficient Halpern-Peaceman-Rachford (HPR) algorithm for solving the Wasserstein barycenter problem (WBP) with fixed supports. While the Peaceman-Rachford (PR) splitting method itself may not be…

Optimization and Control · Mathematics 2022-11-29 Guojun Zhang , Yancheng Yuan , Defeng Sun

Combining the classical theory of optimal transport with modern operator splitting techniques, we develop a new numerical method for nonlinear, nonlocal partial differential equations, arising in models of porous media, materials science,…

Numerical Analysis · Mathematics 2021-02-09 Jose A. Carrillo , Katy Craig , Li Wang , Chaozhen Wei

The Wasserstein distance has emerged as a key metric to quantify distances between probability distributions, with applications in various fields, including machine learning, control theory, decision theory, and biological systems.…

Machine Learning · Computer Science 2026-02-10 Eduardo Figueiredo , Steven Adams , Luca Laurenti

A new method is proposed for the solution of the data-driven optimal transport barycenter problem and of the more general distributional barycenter problem that the article introduces. The method improves on previous approaches based on…

Optimization and Control · Mathematics 2021-04-30 Esteban G. Tabak , Giulio Trigila , Wenjun Zhao

In modern data science, it is common that large-scale data are stored and processed parallelly across a great number of locations. For reasons including confidentiality concerns, only limited data information from each parallel center is…

Methodology · Statistics 2022-07-14 Ziyan Yin

In the supervised learning domain, considering the recent prevalence of algorithms with high computational cost, the attention is steering towards simpler, lighter, and less computationally extensive training and inference approaches. In…

Machine Learning · Computer Science 2022-09-02 Antonello Rosato , Massimo Panella , Denis Kleyko

Distributed consensus in the Wasserstein metric space of probability measures on the real line is introduced in this work. Convergence of each agent's measure to a common measure is proven under a weak network connectivity condition. The…

Optimization and Control · Mathematics 2021-10-04 Adrian N. Bishop , Arnaud Doucet

In this paper, we present a distributed algorithm for solving convex, constraint-coupled, optimization problems over peer-to-peer networks. We consider a network of processors that aim to cooperatively minimize the sum of local cost…

Optimization and Control · Mathematics 2021-04-14 Andrea Camisa , Alessia Benevento , Giuseppe Notarstefano