English
Related papers

Related papers: Walkman: A Communication-Efficient Random-Walk Alg…

200 papers

Decentralized learning algorithms empower interconnected devices to share data and computational resources to collaboratively train a machine learning model without the aid of a central coordinator. In the case of heterogeneous data…

Machine Learning · Computer Science 2023-01-16 Matteo Zecchin , Marios Kountouris , David Gesbert

In decentralized multi-robot navigation, ensuring safe and efficient movement with limited environmental awareness remains a challenge. While robots traditionally navigate based on local observations, this approach falters in complex…

Robotics · Computer Science 2024-06-27 Senthil Hariharan Arul , Amrit Singh Bedi , Dinesh Manocha

We report two decentralized multi-agent cooperative localization algorithms in which, to reduce the communication cost, inter-agent state estimate correlations are not maintained but accounted for implicitly. In our first algorithm, to…

Robotics · Computer Science 2019-07-23 Jianan Zhu , Solmaz S. Kia

We propose an algorithm for distributed optimization over time-varying communication networks. Our algorithm uses an optimized ratio between the number of rounds of communication and gradient evaluations to achieve fast convergence. The…

Optimization and Control · Mathematics 2020-01-08 Bryan Van Scoy , Laurent Lessard

We study distributed algorithms for solving global optimization problems in which the objective function is the sum of local objective functions of agents and the constraint set is given by the intersection of local constraint sets of…

Optimization and Control · Mathematics 2015-03-14 Ilan Lobel , Asuman Ozdaglar , Diego Feijer

The alternating direction method of multipliers (ADMM) has been recently recognized as a promising optimizer for large-scale machine learning models. However, there are very few results studying ADMM from the aspect of communication costs,…

Optimization and Control · Mathematics 2020-12-02 Yu Ye , Hao Chen , Ming Xiao , Mikael Skoglund , H. Vincent Poor

Decentralized optimization enables a network of agents to cooperatively optimize an overall objective function without a central coordinator and is gaining increased attention in domains as diverse as control, sensor networks, data mining,…

Optimization and Control · Mathematics 2023-12-27 Yongqiang Wang , Angelia Nedic

Recently, min-max optimization problems have received increasing attention due to their wide range of applications in machine learning (ML). However, most existing min-max solution techniques are either single-machine or distributed…

Machine Learning · Computer Science 2023-03-07 Zhuqing Liu , Xin Zhang , Songtao Lu , Jia Liu

This paper considers the decentralized consensus optimization problem defined over a network where each node holds a second-order differentiable local objective function. Our goal is to minimize the summation of local objective functions…

Optimization and Control · Mathematics 2020-08-25 Jiaojiao Zhang , Qing Ling , Anthony Man-Cho So

This paper proposes and analyzes a communication-efficient distributed optimization framework for general nonconvex nonsmooth signal processing and machine learning problems under an asynchronous protocol. At each iteration, worker machines…

Optimization and Control · Mathematics 2020-07-15 Jineng Ren , Jarvis Haupt

In this paper, we study the problem of reinforcement learning in multi-agent systems where communication among agents is limited. We develop a decentralized actor-critic learning framework in which each agent performs several local updates…

Machine Learning · Computer Science 2025-10-23 Xiaoxing Ren , Nicola Bastianello , Thomas Parisini , Andreas A. Malikopoulos

We consider distributed convex optimization problems that involve a separable objective function and nontrivial functional constraints, such as Linear Matrix Inequalities (LMIs). We propose a decentralized and computationally inexpensive…

Optimization and Control · Mathematics 2018-01-22 Soomin Lee , Michael M. Zavlanos

Predicting links in complex networks has been one of the essential topics within the realm of data mining and science discovery over the past few years. This problem remains an attempt to identify future, deleted, and redundant links using…

Social and Information Networks · Computer Science 2021-05-21 Kamal Berahmand , Elahe Nasiri , Saman Forouzandeh , Yuefeng Li

We present an algorithm for the problem of linear distributed estimation of a parameter in a network where a set of agents are successively taking measurements. The approach considers a roaming token in a network that carries the estimate,…

Systems and Control · Computer Science 2018-07-05 Lucas Balthazar , João Xavier , Bruno Sinopoli

We analyze the convergence of decentralized consensus algorithm with delayed gradient information across the network. The nodes in the network privately hold parts of the objective function and collaboratively solve for the consensus…

Optimization and Control · Mathematics 2018-01-17 Benjamin Sirb , Xiaojing Ye

In this paper we focus on the distributed quantized average consensus problem in open multi-agent systems consisting of dynamic directed communication links among active nodes. We propose three communication-efficient distributed algorithms…

Systems and Control · Electrical Eng. & Systems 2026-03-10 Jiaqi Hu , Karl H. Johansson , Apostolos I. Rikos

The paper studies decentralized optimization over networks, where agents minimize a composite objective consisting of the sum of smooth convex functions--the agents' losses--and an additional nonsmooth convex extended value function. We…

Optimization and Control · Mathematics 2025-08-05 Xiaokai Chen , Ilya Kuruzov , Gesualdo Scutari , Alexander Gasnikov

Decentralized optimization methods often entail information exchange between neighbors. Transmission failures can happen due to network congestion, hardware/software issues, communication outage, and other factors. In this paper, we…

Machine Learning · Computer Science 2024-01-05 Wenjing Yan , Xuanyu Cao

In this paper, we consider decentralized optimization problems where agents have individual cost functions to minimize subject to subspace constraints that require the minimizers across the network to lie in low-dimensional subspaces. This…

Optimization and Control · Mathematics 2023-08-01 Roula Nassif , Stefan Vlaski , Marco Carpentiero , Vincenzo Matta , Marc Antonini , Ali H. Sayed

Distributed optimization finds applications in large-scale machine learning, data processing and classification over multi-agent networks. In real-world scenarios, the communication network of agents may encounter latency that may affect…

Systems and Control · Electrical Eng. & Systems 2025-10-06 Mohammadreza Doostmohammadian , Narahari Kasagatta Ramesh , Alireza Aghasi