English
Related papers

Related papers: Decentralized ADMM with Compressed and Event-Trigg…

200 papers

We consider the problem of decentralized optimization where a collection of agents, each having access to a local cost function, communicate over a time-varying directed network and aim to minimize the sum of those functions. In practice,…

Systems and Control · Electrical Eng. & Systems 2021-09-01 Yiyue Chen , Abolfazl Hashemi , Haris Vikalo

This paper studies efficient distributed optimization methods for multi-agent networks. Specifically, we consider a convex optimization problem with a globally coupled linear equality constraint and local polyhedra constraints, and develop…

Systems and Control · Computer Science 2016-11-15 Tsung-Hui Chang

We consider constraint-coupled optimization problems in which agents of a network aim to cooperatively minimize the sum of local objective functions subject to individual constraints and a common linear coupling constraint. We propose a…

Optimization and Control · Mathematics 2019-07-26 Alessandro Falsone , Ivano Notarnicola , Giuseppe Notarstefano , Maria Prandini

We develop a new approach to tackle communication constraints in a distributed learning problem with a central server. We propose and analyze a new algorithm that performs bidirectional compression and achieves the same convergence rate as…

Machine Learning · Computer Science 2022-06-17 Constantin Philippenko , Aymeric Dieuleveut

The decentralized optimization paradigm assumes that each term of a finite-sum objective is privately stored by the corresponding agent. Agents are only allowed to communicate with their neighbors in the communication graph. We consider the…

Optimization and Control · Mathematics 2023-09-07 Demyan Yarmoshik , Alexander Rogozin , Alexander Gasnikov

Distributed optimization has attracted lots of attention in the operation of power systems in recent years, where a large area is decomposed into smaller control regions each solving a local optimization problem with periodic information…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-07 Junyao Guo , Gabriela Hug , Ozan Tonguz

Decentralized optimization and communication compression have exhibited their great potential in accelerating distributed machine learning by mitigating the communication bottleneck in practice. While existing decentralized algorithms with…

Machine Learning · Computer Science 2021-08-13 Yao Li , Xiaorui Liu , Jiliang Tang , Ming Yan , Kun Yuan

In a multi-agent network, we consider the problem of minimizing an objective function that is expressed as the sum of private convex and smooth functions, and a (possibly) non-differentiable convex regularizer. We propose a novel…

Optimization and Control · Mathematics 2021-09-30 Yichuan Li , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

We study the decentralized consensus and stochastic optimization problems with compressed communications over static directed graphs. We propose an iterative gradient-based algorithm that compresses messages according to a desired…

Optimization and Control · Mathematics 2022-04-19 Mohammad Taha Toghani , César A. Uribe

In this paper, we propose two communication efficient decentralized optimization algorithms over a general directed multi-agent network. The first algorithm, termed Compressed Push-Pull (CPP), combines the gradient tracking Push-Pull method…

Optimization and Control · Mathematics 2024-04-11 Zhuoqing Song , Lei Shi , Shi Pu , Ming Yan

The challenge of communication-efficient distributed optimization has attracted attention in recent years. In this paper, a communication efficient algorithm, called ordering-based alternating direction method of multipliers (OADMM) is…

Machine Learning · Computer Science 2022-02-08 Yicheng Chen , Rick S. Blum , Brian M. Sadler

Multi-agent distributed consensus optimization problems arise in many signal processing applications. Recently, the alternating direction method of multipliers (ADMM) has been used for solving this family of problems. ADMM based distributed…

Systems and Control · Computer Science 2015-06-18 Tsung-Hui Chang , Mingyi Hong , Xiangfeng Wang

In this paper, we propose a novel distributed alternating direction method of multipliers (ADMM) algorithm with synergetic communication and computation, called SCCD-ADMM, to reduce the total communication and computation cost of the…

Signal Processing · Electrical Eng. & Systems 2020-09-30 Zhuojun Tian , Zhaoyang Zhang , Jue Wang , Xiaoming Chen , Wei Wang , Huaiyu Dai

In this paper, the distributed strongly convex optimization problem is studied with spatio-temporal compressed communication and equality constraints. For the case where each agent holds an distributed local equality constraint, a…

Systems and Control · Electrical Eng. & Systems 2025-03-05 Zihao Ren , Lei Wang , Zhengguang Wu , Guodong Shi

Communication compression techniques are of growing interests for solving the decentralized optimization problem under limited communication, where the global objective is to minimize the average of local cost functions over a multi-agent…

Optimization and Control · Mathematics 2021-06-21 Yiwei Liao , Zhuorui Li , Kun Huang , Shi Pu

Communication compression techniques are of growing interests for solving the decentralized optimization problem under limited communication, where the global objective is to minimize the average of local cost functions over a multi-agent…

Optimization and Control · Mathematics 2022-05-26 Yiwei Liao , Zhuorui Li , Kun Huang , Shi Pu

This paper focuses on the distributed online convex optimization problem with time-varying inequality constraints over a network of agents, where each agent collaborates with its neighboring agents to minimize the cumulative network-wide…

Optimization and Control · Mathematics 2024-05-06 Kunpeng Zhang , Xinlei Yi , Yuzhe Li , Ming Cao , Tianyou Chai , Tao Yang

We address distributed learning problems, both nonconvex and convex, over undirected networks. In particular, we design a novel algorithm based on the distributed Alternating Direction Method of Multipliers (ADMM) to address the challenges…

Machine Learning · Computer Science 2026-03-23 Xiaoxing Ren , Nicola Bastianello , Karl H. Johansson , Thomas Parisini

We study distributed optimization in a cooperative multi-agent setting, where agents have to agree on the usage of shared resources and can communicate via a time-varying network to this purpose. Each agent has its own decision variables…

Optimization and Control · Mathematics 2017-04-20 Alessandro Falsone , Kostas Margellos , Simone Garatti , Maria Prandini

This paper focuses on a multi-agent zeroth-order online optimization problem in a federated learning setting for target tracking. The agents only sense their current distances to their targets and aim to maintain a minimum safe distance…

Machine Learning · Computer Science 2023-06-12 Ege C. Kaya , M. Berk Sahin , Abolfazl Hashemi