English
Related papers

Related papers: Distributed Linear Equations over Random Networks

200 papers

Network consensus optimization has received increasing attention in recent years and has found important applications in many scientific and engineering fields. To solve network consensus optimization problems, one of the most well-known…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-10 Xin Zhang , Jia Liu , Zhengyuan Zhu , Elizabeth S. Bentley

There has been an increasing necessity for scalable optimization methods, especially due to the explosion in the size of datasets and model complexity in modern machine learning applications. Scalable solvers often distribute the…

Optimization and Control · Mathematics 2020-09-08 Guilherme França , José Bento

In this paper, we develop a class of decentralized algorithms for solving a convex resource allocation problem in a network of $n$ agents, where the agent objectives are decoupled while the resource constraints are coupled. The agents…

Optimization and Control · Mathematics 2018-12-18 Angelia Nedić , Alex Olshevsky , Wei Shi

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

Optimization and Control · Mathematics 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

This paper addresses the problem of distributed learning of average belief with sequential observations, in which a network of $n>1$ agents aim to reach a consensus on the average value of their beliefs, by exchanging information only with…

Multiagent Systems · Computer Science 2018-11-20 Kaiqing Zhang , Yang Liu , Ji Liu , Mingyan Liu , Tamer Başar

This paper presents a first-order {distributed continuous-time algorithm} for computing the least-squares solution to a linear equation over networks. Given the uniqueness of the solution, with nonintegrable and diminishing step size,…

Systems and Control · Computer Science 2018-08-14 Yang Liu , Youcheng Lou , Brian D. O. Anderson , Guodong Shi

We address distributed learning problems over undirected networks. Specifically, we focus on designing a novel ADMM-based algorithm that is jointly computation- and communication-efficient. Our design guarantees computational efficiency by…

Machine Learning · Computer Science 2026-01-21 Xiaoxing Ren , Nicola Bastianello , Karl H. Johansson , Thomas Parisini

Cooperative decision making is a vision of future network management and control. Distributed connection preemption is an important example where nodes can make intelligent decisions on allocating resources and controlling traffic flows for…

Machine Learning · Computer Science 2009-01-08 Sung-eok Jeon , Chuanyi Ji

We propose an algorithm for distributed optimization over time-varying communication networks. Our algorithm uses an optimized ratio between the number of rounds of communication and gradient evaluations to achieve fast convergence. The…

Optimization and Control · Mathematics 2020-01-08 Bryan Van Scoy , Laurent Lessard

Graph learning is often a necessary step in processing or representing structured data, when the underlying graph is not given explicitly. Graph learning is generally performed centrally with a full knowledge of the graph signals, namely…

Signal Processing · Electrical Eng. & Systems 2021-12-14 Isabela Cunha Maia Nobre , Mireille El Gheche , Pascal Frossard

We consider the average-consensus problem in a multi-node network of finite size. Communication between nodes is modeled by a sequence of directed signals with arbitrary communication delays. Four distributed algorithms that achieve…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-23 Kevin Topley , Vikram Krishnamurthy

Decentralized learning algorithms empower interconnected devices to share data and computational resources to collaboratively train a machine learning model without the aid of a central coordinator. In the case of heterogeneous data…

Machine Learning · Computer Science 2023-01-16 Matteo Zecchin , Marios Kountouris , David Gesbert

This paper studies a class of distributed optimization problems with coupled equality constraints in networked systems. Many existing distributed algorithms rely on solving local subproblems via the $\operatorname{argmin}$ operator in each…

Optimization and Control · Mathematics 2025-11-26 Chenyang Qiu , Zongli Lin

We consider several problems in the field of distributed optimization and hypothesis testing. We show how to obtain convergence times for these problems that scale linearly with the total number of nodes in the network by using a recent…

Optimization and Control · Mathematics 2017-05-24 Alex Olshevsky

In this paper, we consider the problem of solving linear algebraic equations of the form $Ax=b$ among multi agents which seek a solution by using local information in presence of random communication topologies. The equation is solved by…

Systems and Control · Computer Science 2018-09-24 S. Sh. Alaviani , N. Elia

We propose a decentralized online learning algorithm for distributed random inverse problems over network graphs with online measurements, and unifies the distributed parameter estimation in Hilbert spaces and the least mean square problem…

Machine Learning · Computer Science 2026-04-09 Xiwei Zhang , Tao Li , Yan Chen , Qianyuan Long

This paper proposes a new distributed algorithm for solving linear systems associated with a sparse graph under a generalised diagonal dominance assumption. The algorithm runs iteratively on each node of the graph, with low complexities on…

Signal Processing · Electrical Eng. & Systems 2019-04-30 Qianqian Cai , Zhaorong Zhang , Minyue Fu

In this paper we investigate how standard nonlinear programming algorithms can be used to solve constrained optimization problems in a distributed manner. The optimization setup consists of a set of agents interacting through a…

Optimization and Control · Mathematics 2017-07-18 Ion Matei , John S. Baras

The problem addressed in this paper is the analysis of a distributed consensus algorithm for arbitrary networks, proposed by B\'en\'ezit et al.. In the initial setting, each node in the network has one of two possible states ("yes" or…

Performance · Computer Science 2013-05-21 Shang Shang , Paul W. Cuff , Sanjeev R. Kulkarni , Pan Hui

Inspired by distributed resource allocation problems in dynamic topology networks, we initiate the study of distributed consensus with finite messaging passing. We first find a sufficient condition on the network graph for which no…

Information Theory · Computer Science 2010-07-01 Debashis Dash , Ashutosh Sabharwal