English
Related papers

Related papers: Extending Gossip Algorithms to Distributed Estimat…

200 papers

Gossip algorithms are widely used to solve the distributed consensus problem, but issues can arise when nodes receive multiple signals either at the same time or before they are able to finish processing their current work load.…

Systems and Control · Computer Science 2013-01-15 Christopher D. Hollander , Annie S. Wu

Information dissemination is a fundamental problem in parallel and distributed computing. In its simplest variant, the broadcasting problem, a message has to be spread among all nodes of a graph. A prominent communication protocol for this…

Data Structures and Algorithms · Computer Science 2014-12-10 Robert Elsässer , Dominik Kaaser

Distributed gossip algorithm has been studied in literature for practical implementation of the distributed consensus algorithm as a fundamental algorithm for the purpose of in-network collaborative processing. This paper focuses on…

Systems and Control · Computer Science 2015-12-14 Saber Jafarizadeh

This paper studies distributed stochastic approximation algorithms based on broadcast gossip on communication networks represented by digraphs. Weak convergence of these algorithms is proved, and an associated ordinary differential equation…

Applications · Statistics 2016-09-05 Miloš S. Stanković , Nemanja Ilić , Srdjan S. Stanković

In decentralized optimization, it is common algorithmic practice to have nodes interleave (local) gradient descent iterations with gossip (i.e. averaging over the network) steps. Motivated by the training of large-scale machine learning…

Machine Learning · Computer Science 2020-11-24 Abolfazl Hashemi , Anish Acharya , Rudrajit Das , Haris Vikalo , Sujay Sanghavi , Inderjit Dhillon

In this paper, we study the problem of minimizing a sum of smooth and strongly convex functions split over the nodes of a network in a decentralized fashion. We propose the algorithm $ESDACD$, a decentralized accelerated algorithm that only…

Optimization and Control · Mathematics 2019-02-25 Hadrien Hendrikx , Francis Bach , Laurent Massoulié

We study gossip algorithms for the rumor spreading problem which asks each node to deliver a rumor to all nodes in an unknown network. Gossip algorithms allow nodes only to call one neighbor per round and have recently attracted attention…

Data Structures and Algorithms · Computer Science 2014-04-08 Bernhard Haeupler

Gossip algorithms are widely used in modern distributed systems, with applications ranging from sensor networks and peer-to-peer networks to mobile vehicle networks and social networks. A tremendous research effort has been devoted to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-18 Guodong Shi , Bo Li , Mikael Johansson , Karl Henrik Johansson

Gossip protocols are popular methods for average consensus problems in distributed computing. We prove new convergence guarantees for a variety of such protocols, including path, clique, and synchronous pairwise gossip. These arise by…

Optimization and Control · Mathematics 2021-10-28 Jamie Haddock , Benjamin Jarman , Chen Yap

We have recently proposed quantized gossip algorithms which solve the consensus and averaging problems on directed graphs with the least restrictive connectivity requirements. In this paper we study the convergence time of these algorithms.…

Systems and Control · Computer Science 2011-11-10 Kai Cai , Hideaki Ishii

We consider the average-consensus problem in a multi-node network of finite size. Communication between nodes is modeled by a sequence of directed signals with arbitrary communication delays. Four distributed algorithms that achieve…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-23 Kevin Topley , Vikram Krishnamurthy

In multicenter research, individual-level data are often protected against sharing across sites. To overcome the barrier of data sharing, many distributed algorithms, which only require sharing aggregated information, have been developed.…

Methodology · Statistics 2021-03-25 Rui Duan , Yang Ning , Yong Chen

The asynchronous rumor algorithm spreading propagates a piece of information, the so-called rumor, in a network. Starting with a single informed node, each node is associated with an exponential time clock with rate $1$ and calls a random…

Data Structures and Algorithms · Computer Science 2020-05-19 Ali Pourmiri , Bernard Mans

We consider two variants of the classical gossip algorithm. The first variant is a version of asynchronous stochastic approximation. We highlight a fundamental difficulty associated with the classical asynchronous gossip scheme, viz., that…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-17 Vivek S. Borkar , Rahul Makhijani , Rajesh Sundaresan

In this paper, we study gossip algorithms in communication models that describe the peer-to-peer networking functionality included in most standard smartphone operating systems. We begin by describing and analyzing a new synchronous gossip…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-16 Calvin Newport , Alex Weaver , Chaodong Zheng

In recent times, a considerable amount of work has been devoted to the development and analysis of gossip algorithms in Geometric Random Graphs. In a recently introduced model termed "Geographic Gossip," each node is aware of its position…

Multiagent Systems · Computer Science 2007-07-16 Hariharan Narayanan

We study a general framework for broadcast gossip algorithms which use companion variables to solve the average consensus problem. Each node maintains an initial state and a companion variable. Iterative updates are performed asynchronously…

Systems and Control · Computer Science 2012-09-03 Wu Shaochuan , Michael G. Rabbat

We design and analyze gossip algorithms for networks with correlated data. In these networks, either the data to be distributed, the data already available at the nodes, or both, are correlated. This model is applicable for a variety of…

Information Theory · Computer Science 2012-02-09 Bernhard Haeupler , Asaf Cohen , Chen Avin , Muriel Médard

We present the first provably almost-optimal gossip-based algorithms for aggregate computation that are both time optimal and message-optimal. Given a $n$-node network, our algorithms guarantee that all the nodes can compute the common…

Data Structures and Algorithms · Computer Science 2010-01-20 Jen-Yeu Chen , Gopal Pandurangan

Periodic gossip algorithms have generated a lot of interest due to their ability to compute the global statistics by using local pairwise communications among nodes. Simple execution, robustness to topology changes, and distributed nature…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-31 S. Kouachi , Sateeshkrishna Dhuli , Y. N. Singh