English
Related papers

Related papers: Asynchronous Decentralized Optimization with Const…

200 papers

We study a distributed learning problem in which $n$ agents, each with potentially heterogeneous local data, collaboratively minimize the sum of their local cost functions via peer-to-peer communication. We propose a novel algorithm,…

Optimization and Control · Mathematics 2025-07-29 Runze You , Shi Pu

We present Asynchronous Stochastic Parallel Pose Graph Optimization (ASAPP), the first asynchronous algorithm for distributed pose graph optimization (PGO) in multi-robot simultaneous localization and mapping. By enabling robots to optimize…

Optimization and Control · Mathematics 2023-07-03 Yulun Tian , Alec Koppel , Amrit Singh Bedi , Jonathan P. How

In this paper, we consider a composite optimization problem with linear coupling constraints in a multi-agent network. In this problem, all the agents jointly optimize a global composite cost function which is the linear sum of individual…

Optimization and Control · Mathematics 2021-06-28 Jianzheng Wang , Guoqiang Hu

This paper considers a distributed optimization problem over a multi-agent network, in which the objective function is a sum of individual cost functions at the agents. We focus on the case when communication between the agents is described…

Optimization and Control · Mathematics 2017-11-01 Chenguang Xi , Van Sy Mai , Ran Xin , Eyad H. Abed , Usman A. Khan

Many large-scale constrained optimization problems can be formulated as bilevel distributed optimization tasks over undirected networks, where agents collaborate to minimize a global cost function while adhering to constraints, relying only…

Optimization and Control · Mathematics 2025-11-25 Ajay Tak , Mayank Baranwal

In this paper, we study convex optimization problems where agents of a network cooperatively minimize the global objective function which consists of multiple local objective functions. Different from most of the existing works, the local…

Optimization and Control · Mathematics 2024-10-30 Huaqing Li , Lifeng Zheng , Zheng Wang , Yu Yan , Liping Feng , Jing Guo

In this report, we study decentralized stochastic optimization to minimize a sum of smooth and strongly convex cost functions when the functions are distributed over a directed network of nodes. In contrast to the existing work, we use…

Machine Learning · Computer Science 2020-07-24 Muhammad I. Qureshi , Ran Xin , Soummya Kar , Usman A. Khan

This paper is concerned with a constrained optimization problem over a directed graph (digraph) of nodes, in which the cost function is a sum of local objectives, and each node only knows its local objective and constraints. To…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-24 Pei Xie , Keyou You , Shiji Song , Cheng Wu

In this paper, we propose Distributed Mirror Descent (DMD) algorithm for constrained convex optimization problems on a (strongly-)connected multi-agent network. We assume that each agent has a private objective function and a constraint…

Optimization and Control · Mathematics 2015-04-28 Chenguang Xi , Qiong Wu , Usman A. Khan

In this paper, we design two compressed decentralized algorithms for solving nonconvex stochastic optimization under two different scenarios. Both algorithms adopt a momentum technique to achieve fast convergence and a message-compression…

Machine Learning · Computer Science 2025-08-08 Wei Liu , Anweshit Panda , Ujwal Pandey , Christopher Brissette , Yikang Shen , George M. Slota , Naigang Wang , Jie Chen , Yangyang Xu

We present distributed algorithms that can be used by multiple agents to align their estimates with a particular value over a network with time-varying connectivity. Our framework is general in that this value can represent a consensus…

Optimization and Control · Mathematics 2010-04-20 Angelia Nedić , Asuman Ozdaglar , Pablo A. Parrilo

This paper studies the decentralized online convex optimization problem for heterogeneous linear multi-agent systems. Agents have access to their time-varying local cost functions related to their own outputs, and there are also…

Optimization and Control · Mathematics 2022-07-05 Yang Yu , Xiuxian Li , Li Li , Lihua Xie

In a Hilbert setting, for convex differentiable optimization, we develop a general framework for adaptive accelerated gradient methods. They are based on damped inertial dynamics where the coefficients are designed in a closed-loop way.…

Optimization and Control · Mathematics 2025-01-28 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen

We study distributed stochastic convex optimization under the delayed gradient model where the server nodes perform parameter updates, while the worker nodes compute stochastic gradients. We discuss, analyze, and experiment with a setup…

Machine Learning · Statistics 2015-08-21 Suvrit Sra , Adams Wei Yu , Mu Li , Alexander J. Smola

The distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of $n$ local cost functions by using local information exchange is considered. This problem is an important component of many machine…

Optimization and Control · Mathematics 2022-01-11 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson

In this paper, the distributed strongly convex optimization problem is studied with spatio-temporal compressed communication and equality constraints. For the case where each agent holds an distributed local equality constraint, a…

Systems and Control · Electrical Eng. & Systems 2025-03-05 Zihao Ren , Lei Wang , Zhengguang Wu , Guodong Shi

We investigate the distributed multi-agent sharing optimization problem in a directed graph, with a composite objective function consisting of a smooth function plus a convex (possibly non-smooth) function shared by all agents. While…

Optimization and Control · Mathematics 2024-06-21 Sajad Zandi , Mehdi Korki

In this paper, we propose a new framework to study distributed optimization problems with stochastic gradients by employing a multi-agent system with continuous-time dynamics. Here the goal of the agents is to cooperatively minimize the sum…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Jianhua Sun , Kaihong Lu , Xin Yu

In this paper, we consider the problem of optimally coordinating the response of a group of distributed energy resources (DERs) so they collectively meet the electric power demanded by a collection of loads, while minimizing the total…

Systems and Control · Electrical Eng. & Systems 2020-05-05 Madi Zholbaryssov , Christoforos N. Hadjicostis , Alejandro D. Dominguez-Garcia

This paper investigates a novel approach for solving the distributed optimization problem in which multiple agents collaborate to find the global decision that minimizes the sum of their individual cost functions. First, the $AB$/Push-Pull…

Optimization and Control · Mathematics 2023-06-23 Duong Thuy Anh Nguyen , Duong Tung Nguyen , Angelia Nedich