English
Related papers

Related papers: Asynchronous Gossip Algorithms for Rank-Based Stat…

200 papers

In this short note we propose a new approach for the design and analysis of randomized gossip algorithms which can be used to solve the average consensus problem. We show how that Randomized Block Kaczmarz (RBK) method - a method for…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-18 Nicolas Loizou , Peter Richtárik

Bilevel optimization have gained growing interests, with numerous applications found in meta learning, minimax games, reinforcement learning, and nested composition optimization. This paper studies the problem of distributed bilevel…

Machine Learning · Statistics 2022-06-23 Shuoguang Yang , Xuezhou Zhang , Mengdi Wang

We develop easily accessible quantities for bounding the almost sure exponential convergence rate of push-sum algorithms. We analyze the scenario of i.i.d. synchronous gossip, every agent communicating towards its single target at every…

Probability · Mathematics 2023-09-25 Balázs Gerencsér , Miklós Kornyik

This document describes a new consensus algorithm which is asynchronous and uses gossip based message dissemination between nodes. The current version of the algorithm does not cover the case of a node failure or significantly delayed…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-23 Maxim Zakharov

Gossip algorithms for aggregation have recently received significant attention for sensor network applications because of their simplicity and robustness in noisy and uncertain environments. However, gossip algorithms can waste significant…

Information Theory · Computer Science 2007-07-13 Alexandros G. Dimakis , Anand D. Sarwate , Martin J. Wainwright

By the distributed averaging problem is meant the problem of computing the average value of a set of numbers possessed by the agents in a distributed network using only communication between neighboring agents. Gossiping is a well-known…

Optimization and Control · Mathematics 2016-12-28 Ji Liu , Shaoshuai Mou , A. Stephen Morse , Brian D. O. Anderson , Changbin Yu

The paper considers gossip distributed estimation of a (static) distributed random field (a.k.a., large scale unknown parameter vector) observed by sparsely interconnected sensors, each of which only observes a small fraction of the field.…

Information Theory · Computer Science 2015-05-20 Soummya Kar , Jose' M. F. Moura

In recent years, decentralized learning has emerged as a powerful tool not only for large-scale machine learning, but also for preserving privacy. One of the key challenges in decentralized learning is that the data distribution held by…

Optimization and Control · Mathematics 2022-09-23 Yuki Takezawa , Kenta Niwa , Makoto Yamada

In many applications, nodes in a network desire not only a consensus, but an optimal one. To date, a family of subgradient algorithms have been proposed to solve this problem under general convexity assumptions. This paper shows that, for…

Optimization and Control · Mathematics 2011-02-11 Jie Lu , Choon Yik Tang , Paul R. Regier , Travis D. Bow

In this paper we present various distributed algorithms for LP-type problems in the well-known gossip model. LP-type problems include many important classes of problems such as (integer) linear programming, geometric problems like smallest…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-25 Kristian Hinnenthal , Christian Scheideler , Martijn Struijs

Two widely considered decentralized learning algorithms are Gossip and random walk-based learning. Gossip algorithms (both synchronous and asynchronous versions) suffer from high communication cost, while random-walk based learning…

Machine Learning · Computer Science 2024-05-14 Peyman Gholami , Hulya Seferoglu

We study gossip algorithms for the rumor spreading problem which asks one node to deliver a rumor to all nodes in an unknown network. We present the first protocol for any expander graph $G$ with $n$ nodes such that, the protocol informs…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-14 Zeyu Guo , He Sun

This paper considers the average consensus problem on a network of digital links, and proposes a set of algorithms based on pairwise ''gossip'' communications and updates. We study the convergence properties of such algorithms with the goal…

Optimization and Control · Mathematics 2011-07-25 Ruggero Carli , Fabio Fagnani , Paolo Frasca , Sandro Zampieri

We consider a decentralized learning setting in which data is distributed over nodes in a graph. The goal is to learn a global model on the distributed data without involving any central entity that needs to be trusted. While gossip-based…

Information Theory · Computer Science 2021-03-17 Ghadir Ayache , Salim El Rouayheb

Peer to peer (P2P) systems are moving from application specific architectures to a generic service oriented design philosophy. This raises interesting problems in connection with providing useful P2P middleware services that are capable of…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Antonio Fernandez , Vincent Gramoli , Ernesto Jimenez , Anne-Marie Kermarrec , Michel Raynal

Eigenvectors of data matrices play an important role in many computational problems, ranging from signal processing to machine learning and control. For instance, algorithms that compute positions of the nodes of a wireless network on the…

Data Structures and Algorithms · Computer Science 2011-03-23 Satish Babu Korada , Andrea Montanari , Sewoong Oh

We have recently proposed quantized gossip algorithms which solve the consensus and averaging problems on directed graphs with the least restrictive connectivity requirements. In this paper we study the convergence time of these algorithms.…

Systems and Control · Computer Science 2011-11-10 Kai Cai , Hideaki Ishii

Reputation aggregation in peer to peer networks is generally a very time and resource consuming process. Moreover, most of the methods consider that a node will have same reputation with all the nodes in the network, which is not true. This…

Networking and Internet Architecture · Computer Science 2019-08-23 Ruchir Gupta , Y. N. Singh

This paper presents greedy gossip with eavesdropping (GGE), a novel randomized gossip algorithm for distributed computation of the average consensus problem. In gossip algorithms, nodes in the network randomly communicate with their…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-14 Deniz Ustebay , Boris Oreshkin , Mark Coates , Michael Rabbat

This paper studies reliability of probabilistic neighbor-aware gossip algorithms over three well- known large-scale random topologies, namely Bernoulli (or Erd\H{o}s-R\'enyi) graph, the random geometric graph, and the scale-free graph. We…

Networking and Internet Architecture · Computer Science 2017-04-20 Ruijing Hu , Leander Jehl