English
Related papers

Related papers: A Multi-Agent Primal-Dual Strategy for Composite O…

200 papers

This paper studies distributed algorithms for the extended monotropic optimization problem, which is a general convex optimization problem with a certain separable structure. The considered objective function is the sum of local convex…

Optimization and Control · Mathematics 2016-08-04 Xianlin Zeng , Peng Yi , Yiguang Hong , Lihua Xie

In this paper, distributed convex optimization problem over non-directed dynamical networks is studied. Here, networked agents with single-integrator dynamics are supposed to rendezvous at a point that is the solution of a global convex…

Optimization and Control · Mathematics 2017-07-18 Amir Adibzadeh , Mohsen Zamani , Amir A. Suratgar , Mohammad B. Menhaj

In this paper, we propose the primal-dual method of multipliers (PDMM) for distributed optimization over a graph. In particular, we optimize a sum of convex functions defined over a graph, where every edge in the graph carries a linear…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-06 G. Zhang , R. Heusdens

In distributed machine learning, efficient training across multiple agents with different data distributions poses significant challenges. Even with a centralized coordinator, current algorithms that achieve optimal communication complexity…

Machine Learning · Computer Science 2024-08-13 Junchi Yang , Murat Yildirim , Qiu Feng

In the distributed optimization problem for a multi-agent system, each agent knows a local function and must find a minimizer of the sum of all agents' local functions by performing a combination of local gradient evaluations and…

Optimization and Control · Mathematics 2022-06-16 Bryan Van Scoy , Laurent Lessard

We consider the saddle point problem where the objective functions are abstract convex with respect to the class of quadratic functions. We propose primal-dual algorithms using the corresponding abstract proximal operator and investigate…

Optimization and Control · Mathematics 2026-01-13 Ewa Bednarczuk , The Hung Tran

Distributed multi-agent optimization finds many applications in distributed learning, control, estimation, etc. Most existing algorithms assume knowledge of first-order information of the objective and have been analyzed for convex…

Optimization and Control · Mathematics 2020-06-17 Yujie Tang , Junshan Zhang , Na Li

Decentralized optimization is a common paradigm used in distributed signal processing and sensing as well as privacy-preserving and large-scale machine learning. It is assumed that several computational entities locally hold objective…

Optimization and Control · Mathematics 2023-01-12 Alexander Rogozin , Demyan Yarmoshik , Ksenia Kopylova , Alexander Gasnikov

Using convex combination and linesearch techniques, we introduce a novel primal-dual algorithm for solving structured convex-concave saddle point problems with a generic smooth nonbilinear coupling term. Our adaptive linesearch strategy…

Optimization and Control · Mathematics 2024-01-17 Xiaokai Chang , Junfeng Yang , Hongchao Zhang

This paper considers decentralized optimization of convex functions with mixed affine equality constraints involving both local and global variables. Constraints on global variables may vary across different nodes in the network, while…

Optimization and Control · Mathematics 2026-02-05 Demyan Yarmoshik , Nhat Trung Nguyen , Alexander Rogozin , Alexander Gasnikov

We study distributed non-convex optimization on a time-varying multi-agent network. Each node has access to its own smooth local cost function, and the collective goal is to minimize the sum of these functions. We generalize the results…

Optimization and Control · Mathematics 2016-12-06 Tatiana Tatarenko , Behrouz Touri

The paper proves convergence to global optima for a class of distributed algorithms for nonconvex optimization in network-based multi-agent settings. Agents are permitted to communicate over a time-varying undirected graph. Each agent is…

Optimization and Control · Mathematics 2019-03-19 Brian Swenson , Soummya Kar , H. Vincent Poor , Jose' M. F. Moura

The goal of decentralized optimization over a network is to optimize a global objective formed by a sum of local (possibly nonsmooth) convex functions using only local computation and communication. It arises in various application domains,…

Optimization and Control · Mathematics 2015-03-17 John Duchi , Alekh Agarwal , Martin Wainwright

This paper studies the decentralized online convex optimization problem for heterogeneous linear multi-agent systems. Agents have access to their time-varying local cost functions related to their own outputs, and there are also…

Optimization and Control · Mathematics 2022-07-05 Yang Yu , Xiuxian Li , Li Li , Lihua Xie

Many realistic decision-making problems in networked scenarios, such as formation control and collaborative task offloading, often involve complicatedly entangled local decisions, which, however, have not been sufficiently investigated yet.…

Optimization and Control · Mathematics 2025-11-20 Dandan Wang , Xuyang Wu , Zichong Ou , Jie Lu

This paper presents a family of algorithms for decentralized convex composite problems. We consider the setting of a network of agents that cooperatively minimize a global objective function composed of a sum of local functions plus a…

Optimization and Control · Mathematics 2023-02-14 Yichuan Li , Petros G. Voulgaris , Dusan M. Stipanovic , Nikolaos M. Freris

During the past two decades, multi-agent optimization problems have drawn increased attention from the research community. When multiple objective functions are present among agents, many works optimize the sum of these objective functions.…

Multiagent Systems · Computer Science 2020-10-13 M. J. Blondin , M. T. Hale

This paper fully studies distributed optimal consensus problem in non-directed dynamical networks. We consider a group of networked agents that are supposed to rendezvous at the optimal point of a collective convex objective function. Each…

Optimization and Control · Mathematics 2017-12-22 Amir Adibzadeh , Amir A. Suratgar , Mohammad B. Menhaja , Mohsen Zamani

Distributed consensus optimization has received considerable attention in recent years; several distributed consensus-based algorithms have been proposed for (nonsmooth) convex and (smooth) nonconvex objective functions. However, the…

Optimization and Control · Mathematics 2019-11-05 Vyacheslav Kungurtsev

In this paper we propose an efficient distributed algorithm for solving loosely coupled convex optimization problems. The algorithm is based on a primal-dual interior-point method in which we use the alternating direction method of…

Optimization and Control · Mathematics 2015-02-10 Mariette Annergren , Sina Khoshfetrat Pakazad , Anders Hansson , Bo Wahlberg