English
Related papers

Related papers: Distributed Subgradient-based Multi-agent Optimiza…

200 papers

We develop and analyze an asynchronous algorithm for distributed convex optimization when the objective writes a sum of smooth functions, local to each worker, and a non-smooth function. Unlike many existing methods, our distributed…

Optimization and Control · Mathematics 2019-12-13 Konstantin Mishchenko , Franck Iutzeler , Jérôme Malick

We study distributed composite optimization over networks: agents minimize the sum of a smooth (strongly) convex function, the agents' sum-utility, plus a non-smooth (extended-valued) convex one. We propose a general algorithmic framework…

Optimization and Control · Mathematics 2019-10-23 Jinming Xu , Ying Sun , Ye Tian , Gesualdo Scutari

We consider solving a convex, possibly stochastic optimization problem over a randomly time-varying multi-agent network. Each agent has access to some local objective function, and it only has unbiased estimates of the gradients of the…

Optimization and Control · Mathematics 2016-11-29 Mingyi Hong , Tsung-Hui Chang

In numerous settings, agents lack sufficient data to directly learn a model. Collaborating with other agents may help, but it introduces a bias-variance trade-off, when local data distributions differ. A key challenge is for each agent to…

Machine Learning · Computer Science 2025-02-20 Franco Galante , Giovanni Neglia , Emilio Leonardi

This paper proposes a scalable distributed policy gradient method and proves its convergence to near-optimal solution in multi-agent linear quadratic networked systems. The agents engage within a specified network under local communication…

Multiagent Systems · Computer Science 2024-03-06 Yuzi Yan , Yuan Shen

The paper studies a distributed constrained optimization problem, where multiple agents connected in a network collectively minimize the sum of individual objective functions subject to a global constraint being an intersection of the local…

Optimization and Control · Mathematics 2016-03-08 Jinlong Lei , Han-Fu Chen , Hai-Tao Fang

We consider the problem of achieving average consensus among multiple agents, where the inter-agent communication network is depicted by a graph. We consider the discrete-time consensus protocol where each agent updates its value as a…

Systems and Control · Electrical Eng. & Systems 2021-11-30 Kiran Rokade , Rachel Kalpana Kalaimani

In this paper, we study distributed stochastic optimization to minimize a sum of smooth and strongly-convex local cost functions over a network of agents, communicating over a strongly-connected graph. Assuming that each agent has access to…

Machine Learning · Computer Science 2019-04-11 Ran Xin , Anit Kumar Sahu , Usman A. Khan , Soummya Kar

We consider distributed iterative algorithms for the averaging problem over time-varying topologies. Our focus is on the convergence time of such algorithms when complete (unquantized) information is available, and on the degradation of…

Optimization and Control · Mathematics 2009-01-14 Angelia Nedić , Alex Olshevsky , Asuman Ozdaglar , John Tsitsiklis

This paper proposes a novel proximal-gradient algorithm for a decentralized optimization problem with a composite objective containing smooth and non-smooth terms. Specifically, the smooth and nonsmooth terms are dealt with by gradient and…

Optimization and Control · Mathematics 2021-02-02 Zhi Li , Wei Shi , Ming Yan

Multi-agent distributed optimization over a network minimizes a global objective formed by a sum of local convex functions using only local computation and communication. We develop and analyze a quantized distributed algorithm based on the…

Optimization and Control · Mathematics 2016-11-17 Shengyu Zhu , Mingyi Hong , Biao Chen

We propose methods for distributed graph-based multi-task learning that are based on weighted averaging of messages from other machines. Uniform averaging or diminishing stepsize in these methods would yield consensus (single task)…

Machine Learning · Statistics 2018-02-13 Weiran Wang , Jialei Wang , Mladen Kolar , Nathan Srebro

In this work, we revisit a classical distributed gradient-descent algorithm, introducing an interesting class of perturbed multi-agent systems. The state of each subsystem represents a local estimate of a solution to the global optimization…

Optimization and Control · Mathematics 2025-09-04 Tarek Bazizi , Mohamed Maghenem , Paolo Frasca , Antonio Lorìa , Elena Panteley

In this paper, a class of convex feasibility problems (CFPs) are studied for multi-agent systems through local interactions. The objective is to search a feasible solution to the convex inequalities with some set constraints in a…

Systems and Control · Computer Science 2016-12-16 Kaihong Lu , Gangshan Jing , Long Wang

In this paper, we address the distributed optimization problem over unidirectional networks with possibly time-invariant heterogeneous bounded transmission delays. In particular, we propose a modified version of the Accelerated Distributed…

We study finite-time performance of a recently proposed distributed dual subgradient (DDSG) method for convex constrained multi-agent optimization problems. The algorithm enjoys performance guarantees on the last primal iterate, as opposed…

Optimization and Control · Mathematics 2023-07-28 Subhonmesh Bose , Hoa Dinh Nguyen , Haitian Liu , Ye Guo , Thinh T. Doan , Carolyn L. Beck

Quadratic programs arise in robotics, communications, smart grids, and many other applications. As these problems grow in size, finding solutions becomes much more computationally demanding, and new algorithms are needed to efficiently…

Optimization and Control · Mathematics 2019-03-21 Matthew Ubl , Matthew Hale

In this paper, a class of large-scale distributed nonsmooth convex optimization problem over time-varying multi-agent network is investigated. Specifically, the decision space which can be split into several blocks of convex set is…

Optimization and Control · Mathematics 2024-10-18 Zhan Yu , Daniel W. C. Ho

A variety of problems in distributed control involve a networked system of autonomous agents cooperating to carry out some complex task in a decentralized fashion, e.g., orienting a flock of drones, or aggregating data from a network of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-01 Bernadette Charron-Bost , Patrick Lambein-Monette

We present a multi-scale forward search algorithm for distributed agents to solve single-query shortest path planning problems. Each agent first builds a representation of its own search space of the common environment as a multi-resolution…

Multiagent Systems · Computer Science 2019-10-10 Jaein Lim , Panagiotis Tsiotras