English
Related papers

Related papers: Decentralised convex optimisation with probability…

200 papers

We study the decentralized distributed computation of discrete approximations for the regularized Wasserstein barycenter of a finite set of continuous probability measures distributedly stored over a network. We assume there is a network of…

Optimization and Control · Mathematics 2020-02-21 Pavel Dvurechensky , Darina Dvinskikh , Alexander Gasnikov , César A. Uribe , Angelia Nedić

We study the problem of the decentralized computation of entropy-regularized semi-discrete Wasserstein barycenters over a network. Building upon recent primal-dual approaches, we propose a sampling gradient quantization scheme that allows…

Optimization and Control · Mathematics 2020-10-28 Roman Krawtschenko , César A. Uribe , Alexander Gasnikov , Pavel Dvurechensky

Inspired by recent advances in distributed algorithms for approximating Wasserstein barycenters, we propose a novel distributed algorithm for this problem. The main novelty is that we consider time-varying computational networks, which are…

Optimization and Control · Mathematics 2023-07-26 Olga Yufereva , Michael Persiianov , Pavel Dvurechensky , Alexander Gasnikov , Dmitry Kovalev

Decentralized optimization methods enable on-device training of machine learning models without a central coordinator. In many scenarios communication between devices is energy demanding and time consuming and forms the bottleneck of the…

Optimization and Control · Mathematics 2020-11-04 Dmitry Kovalev , Anastasia Koloskova , Martin Jaggi , Peter Richtarik , Sebastian U. Stich

We consider distributed convex-concave saddle point problems over arbitrary connected undirected networks and propose a decentralized distributed algorithm for their solution. The local functions distributed across the nodes are assumed to…

Decentralized optimization is a common paradigm used in distributed signal processing and sensing as well as privacy-preserving and large-scale machine learning. It is assumed that several computational entities locally hold objective…

Optimization and Control · Mathematics 2023-01-12 Alexander Rogozin , Demyan Yarmoshik , Ksenia Kopylova , Alexander Gasnikov

Wasserstein barycenters provide a geometrically meaningful way to aggregate probability distributions, built on the theory of optimal transport. They are difficult to compute in practice, however, leading previous work to restrict their…

Machine Learning · Computer Science 2020-10-27 Lingxiao Li , Aude Genevay , Mikhail Yurochkin , Justin Solomon

We study distributed optimization problems over a network when the communication between the nodes is constrained, and so information that is exchanged between the nodes must be quantized. This imperfect communication poses a fundamental…

Optimization and Control · Mathematics 2018-10-30 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

We consider a distributionally robust second-order stochastic dominance constrained optimization problem. We require the dominance constraints hold with respect to all probability distributions in a Wasserstein ball centered at the…

Optimization and Control · Mathematics 2021-10-20 Yu Mei , Jia Liu , Zhiping Chen

We consider the problem of regularized regression in a network of communication-constrained devices. Each node has local data and objectives, and the goal is for the nodes to optimize a global objective. We develop a distributed…

Optimization and Control · Mathematics 2016-03-22 Neil McGlohon , Stacy Patterson

In this thesis, we consider the Wasserstein barycenter problem of discrete probability measures from computational and statistical sides. The statistical focus is estimating the sample size of measures necessary to calculate an…

Optimization and Control · Mathematics 2021-10-26 Darina Dvinskikh

In many applications in statistics and machine learning, the availability of data samples from multiple possibly heterogeneous sources has become increasingly prevalent. On the other hand, in distributionally robust optimization, we seek…

Machine Learning · Statistics 2022-05-31 Tim Tsz-Kit Lau , Han Liu

We consider the population Wasserstein barycenter problem for random probability measures supported on a finite set of points and generated by an online stream of data. This leads to a complicated stochastic optimization problem where the…

Optimization and Control · Mathematics 2021-12-06 Daniil Tiapkin , Alexander Gasnikov , Pavel Dvurechensky

Distributed nonconvex optimization underpins key functionalities of numerous distributed systems, ranging from power systems, smart buildings, cooperative robots, vehicle networks to sensor networks. Recently, it has also merged as a…

Optimization and Control · Mathematics 2024-03-18 Yanan Bo , Yongqiang Wang

We consider the problem of solving a distributed optimization problem using a distributed computing platform, where the communication in the network is limited: each node can only communicate with its neighbours and the channel has a…

Systems and Control · Computer Science 2015-04-10 Ye Pu , Melanie N. Zeilinger , Colin N. Jones

In this paper, we study unconstrained distributed optimization strongly convex problems, in which the exchange of information in the network is captured by a directed graph topology over digital channels that have limited capacity (and…

Systems and Control · Electrical Eng. & Systems 2023-09-12 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

We study efficient distributed algorithms for the fundamental problem of principal component analysis and leading eigenvector computation on the sphere, when the data are randomly distributed among a set of computational nodes. We propose a…

Optimization and Control · Mathematics 2021-10-28 Foivos Alimisis , Peter Davies , Bart Vandereycken , Dan Alistarh

This paper presents a family of algorithms for decentralized convex composite problems. We consider the setting of a network of agents that cooperatively minimize a global objective function composed of a sum of local functions plus a…

Optimization and Control · Mathematics 2023-02-14 Yichuan Li , Petros G. Voulgaris , Dusan M. Stipanovic , Nikolaos M. Freris

We propose a distributionally robust approach to learning hyperparameters for first-order methods in convex optimization. Given a dataset of problem instances, we minimize a Wasserstein distributionally robust version of the performance…

Machine Learning · Computer Science 2026-05-08 Vinit Ranjan , Jisun Park , Bartolomeo Stellato

In this paper, we develop an exact reformulation and a deterministic approximation for distributionally robust joint chance-constrained programmings (DRCCPs) with a general class of convex uncertain constraints under data-driven Wasserstein…

Optimization and Control · Mathematics 2022-09-07 Yining Gu , Yanjun Wang
‹ Prev 1 2 3 10 Next ›