English
Related papers

Related papers: Convergence Time Analysis of Quantized Gossip Cons…

200 papers

We present distributed algorithms that can be used by multiple agents to align their estimates with a particular value over a network with time-varying connectivity. Our framework is general in that this value can represent a consensus…

Optimization and Control · Mathematics 2010-04-20 Angelia Nedić , Asuman Ozdaglar , Pablo A. Parrilo

In this paper, a distributed velocity-constrained consensus problem is studied for discrete-time multi-agent systems, where each agent's velocity is constrained to lie in a nonconvex set. A distributed constrained control algorithm is…

Optimization and Control · Mathematics 2020-03-05 Peng Lin , Wei Ren , Huijun Gao

In a model of communication in a social network described by a simple consensus model, we pose the problem of finding a subset of nodes with given cardinality and fixed consensus values that enable the fastest convergence rate to…

Discrete Mathematics · Computer Science 2018-12-24 Fern Y. Hunt

The convergence, convergence rate and expected hitting time play fundamental roles in the analysis of randomised search heuristics. This paper presents a unified Markov chain approach to studying them. Using the approach, the sufficient and…

Optimization and Control · Mathematics 2013-12-10 Jun He , Feidun He , Xin Yao

This paper studies the robustness of a dynamic average consensus algorithm to communication delay over strongly connected and weight-balanced (SCWB) digraphs. Under delay-free communication, the algorithm of interest achieves a practical…

Systems and Control · Computer Science 2018-12-12 Hossein Moradian , Solmaz S. Kia

Classical approaches for asymptotic convergence to the global average in a distributed fashion typically assume timely and reliable exchange of information between neighboring components of a given multi-component system. These assumptions…

Multiagent Systems · Computer Science 2013-02-25 Christoforos N. Hadjicostis , Themistoklis Charalambous

The push-sum algorithm is probably the most important distributed averaging approach over directed graphs, which has been applied to various problems including distributed optimization. This paper establishes the explicit absolute…

Optimization and Control · Mathematics 2023-04-20 Yixuan Lin , Ji Liu

This paper considers time-average optimization, where a decision vector is chosen every time step within a (possibly non-convex) set, and the goal is to minimize a convex function of the time averages subject to convex constraints on these…

Optimization and Control · Mathematics 2016-10-11 Sucha Supittayapornpong , Longbo Huang , Michael J. Neely

We study distributed methods for online prediction and stochastic optimization. Our approach is iterative: in each round nodes first perform local computations and then communicate in order to aggregate information and synchronize their…

Information Theory · Computer Science 2014-03-06 Konstantinos I. Tsianos , Michael G. Rabbat

In this preliminary paper we study the stability property of a consensus on the average algorithm in arbitrary directed graphs with respect to communication/sensing time-delays. The proposed algorithm adds a storage variable to the agents'…

Optimization and Control · Mathematics 2015-02-17 Mehran Zareh , Carla Seatzu , Mauro Franceschelli

In this paper, we discuss a class of distributed detection algorithms which can be viewed as implementations of Bayes' law in distributed settings. Some of the algorithms are proposed in the literature most recently, and others are first…

Methodology · Statistics 2015-11-10 Qipeng Liu , Jiuhua Zhao , Xiaofan Wang

We develop deterministic algorithms for the problems of consensus, gossiping and checkpointing with nodes prone to failing. Distributed systems are modeled as synchronous complete networks. Failures are represented either as crashes or…

Data Structures and Algorithms · Computer Science 2023-05-22 Bogdan S. Chlebus , Dariusz R. Kowalski , Jan Olkowski

We consider a decentralized optimization problem for networks affected by communication delays. Examples of such networks include collaborative machine learning, sensor networks, and multi-agent systems. To mimic communication delays, we…

Machine Learning · Computer Science 2024-10-03 Tomas Ortega , Hamid Jafarkhani

Communication overhead hinders the scalability of large-scale distributed training. Gossip SGD, where each node averages only with its neighbors, is more communication-efficient than the prevalent parallel SGD. However, its convergence rate…

Machine Learning · Computer Science 2021-05-20 Yiming Chen , Kun Yuan , Yingya Zhang , Pan Pan , Yinghui Xu , Wotao Yin

In recent times, a considerable amount of work has been devoted to the development and analysis of gossip algorithms in Geometric Random Graphs. In a recently introduced model termed "Geographic Gossip," each node is aware of its position…

Multiagent Systems · Computer Science 2007-07-16 Hariharan Narayanan

We present \textsc{P2PTFHH} (Peer--to--Peer Time--Faded Heavy Hitters) which, to the best of our knowledge, is the first distributed algorithm for mining time--faded heavy hitters on unstructured P2P networks. \textsc{P2PTFHH} is based on…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-05 Marco Pulimeno , Italo Epicoco , Massimo Cafaro

The distributed subgradient method (DSG) is a widely discussed algorithm to cope with large-scale distributed optimization problems in the arising machine learning applications. Most exisiting works on DSG focus on ideal communication…

Signal Processing · Electrical Eng. & Systems 2022-08-24 Zhaoyue Xia , Jun Du , Yong Ren

We consider the problem of multi-agent consensus where some agents are subject to faults/attacks and might make updates arbitrarily. The network consists of agents taking integer-valued (i.e., quantized) states under directed communication…

Systems and Control · Computer Science 2017-10-20 Seyed Mehran Dibaji , Hideaki Ishii , Roberto Tempo

We propose an asynchronous, decentralized algorithm for consensus optimization. The algorithm runs over a network in which the agents communicate with their neighbors and perform local computation. In the proposed algorithm, each agent can…

Optimization and Control · Mathematics 2017-03-06 Tianyu Wu , Kun Yuan , Qing Ling , Wotao Yin , Ali H. Sayed

This paper considers the minimization of a sum of smooth and strongly convex functions dispatched over the nodes of a communication network. Previous works on the subject either focus on synchronous algorithms, which can be heavily slowed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-09 Mathieu Even , Hadrien Hendrikx , Laurent Massoulié