English
Related papers

Related papers: Improving Convergence Rate of Distributed Consensu…

200 papers

We study the problem of asymptotic consensus as it occurs in a wide range of applications in both man-made and natural systems. In particular, we study systems with directed communication graphs that may change over time. We recently…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-09 Bernadette Charron-Bost , Matthias Függer , Thomas Nowak

Motivated by economic dispatch and linearly-constrained resource allocation problems, this paper proposes a novel Distributed Approx-Newton algorithm that approximates the standard Newton optimization method. A main property of this…

Numerical Analysis · Computer Science 2017-03-24 Tor Anderson , Chin-Yao Chang , Sonia Martinez

We propose methods for distributed graph-based multi-task learning that are based on weighted averaging of messages from other machines. Uniform averaging or diminishing stepsize in these methods would yield consensus (single task)…

Machine Learning · Statistics 2018-02-13 Weiran Wang , Jialei Wang , Mladen Kolar , Nathan Srebro

In this article, we propose a new approach, optimize then agree for minimizing a sum $ f = \sum_{i=1}^n f_i(x)$ of convex objective functions over a directed graph. The optimize then agree approach decouples the optimization step and the…

Systems and Control · Electrical Eng. & Systems 2021-05-27 Vivek Khatana , Govind Saraswat , Sourav Patel , Murti V. Salapaka

This paper aims at addressing distributed averaging problems for signed networks in the presence of general directed topologies that are represented by signed digraphs. A new class of improved Laplacian potential functions is proposed by…

Optimization and Control · Mathematics 2020-08-14 Mingjun Du , Deyuan Meng , Zheng-Guang Wu

We consider a multi agent optimization problem where a set of agents collectively solves a global optimization problem with the objective function given by the sum of locally known convex functions. We focus on the case when information…

Optimization and Control · Mathematics 2016-03-14 Ali Makhdoumi , Asuman Ozdaglar

Distributed averaging, or distributed average consensus, is a common method for computing the sample mean of the data dispersed among the nodes of a network in a decentralized manner. By iteratively exchanging messages with neighbors, the…

Information Theory · Computer Science 2017-10-26 Ryan Pilgrim , Junan Zhu , Dror Baron , Waheed U. Bajwa

This paper studies the consensus problem of heterogeneous multi-agent systems by the feedforward control and linear quadratic (LQ) optimal control theory. Different from the existing consensus control algorithms, which require to design an…

Optimization and Control · Mathematics 2024-03-19 Liping Zhang , Huanshui Zhang

When solving consensus optimization problems over a graph, there is often an explicit characterization of the convergence rate of Gradient Descent (GD) using the spectrum of the graph Laplacian. The same type of problems under the…

Machine Learning · Statistics 2017-10-04 Guilherme França , José Bento

In this paper, we formulate and investigate a generalized consensus algorithm which makes an attempt to unify distributed averaging and maximizing algorithms considered in the literature. Each node iteratively updates its state as a…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-06 Guodong Shi , Karl Henrik Johansson

The present paper is devoted to estimating the speed of convergence towards consensus for a general class of discrete-time multi-agent systems. In the systems considered here, both the topology of the interconnection graph and the weight of…

Optimization and Control · Mathematics 2020-10-02 David Angeli , Pierre-Alexandre Bliman

Optimal design of consensus acceleration graph filters relates closely to the eigenvalues of the consensus iteration matrix. This task is complicated by random networks with uncertain iteration matrix eigenvalues. Filter design methods…

Signal Processing · Electrical Eng. & Systems 2018-03-01 Stephen Kruzick , José M. F. Moura

We study the problem of achieving average consensus between a group of agents over a network with erasure links. In the context of consensus problems, the unreliability of communication links between nodes has been traditionally modeled by…

Optimization and Control · Mathematics 2012-04-03 Ravi Teja Sukhavasi , Babak Hassibi

Results for estimating the convergence rate of non-stationary distributed consensus algorithms are provided, on the basis of qualitative (mainly topological) as well as basic quantitative information (lower-bounds on the matrix entries).…

Optimization and Control · Mathematics 2007-12-22 David Angeli , Pierre-Alexandre Bliman

Traditionally, systems governed by linear Partial Differential Equations (PDEs) are spatially discretized to exploit their algebraic structure and reduce the computational effort for controlling them. Due to beneficial insights of the PDEs,…

Systems and Control · Computer Science 2016-04-05 Saber Jafarizadeh

Classical approaches for asymptotic convergence to the global average in a distributed fashion typically assume timely and reliable exchange of information between neighboring components of a given multi-component system. These assumptions…

Multiagent Systems · Computer Science 2013-02-25 Christoforos N. Hadjicostis , Themistoklis Charalambous

Consensus strategies find a variety of applications in distributed coordination and decision making in multi-agent systems. In particular, average consensus plays a key role in a number of applications and is closely associated with two…

Multiagent Systems · Computer Science 2012-10-17 Themistoklis Charalambous , Christoforos N. Hadjicostis

This study develops an algorithm for distributed computing of linear programming problems of huge-scales. Global consensus with single common variable, multiblocks, and augmented Lagrangian are adopted. The consensus is used to partition…

Optimization and Control · Mathematics 2025-08-07 Luoyi Tao

In this paper, we propose a distributed Newton method for consensus optimization. Our approach outperforms state-of-the-art methods, including ADMM. The key idea is to exploit the sparsity of the dual Hessian and recast the computation of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-22 Rasul Tutunov , Haitham Bou Ammar , Ali Jadbabaie

Adaptive guaranteed-performance consensus control problems for multi-agent systems are investigated, where the adjustable convergence speed is discussed. This paper firstly proposes a novel adaptive guaranteed-performance consensus…

Systems and Control · Computer Science 2019-06-12 Hai-Ying Ma , Xiao Jia , Ning Cai , Jian-Xiang Xi