English
Related papers

Related papers: Fast Distributed Algorithms for LP-Type Problems o…

200 papers

Gossip protocols are popular methods for average consensus problems in distributed computing. We prove new convergence guarantees for a variety of such protocols, including path, clique, and synchronous pairwise gossip. These arise by…

Optimization and Control · Mathematics 2021-10-28 Jamie Haddock , Benjamin Jarman , Chen Yap

Machine learning over fully distributed data poses an important problem in peer-to-peer (P2P) applications. In this model we have one data record at each network node, but without the possibility to move raw data due to privacy…

Machine Learning · Computer Science 2012-06-07 Róbert Ormándi , István Hegedüs , Márk Jelasity

We consider a fully distributed constrained convex optimization problem over a multi-agent (no central coordinator) network. We propose an asynchronous gossip-based random projection (GRP) algorithm that solves the distributed problem using…

Optimization and Control · Mathematics 2013-04-08 Soomin Lee , Angelia Nedich

We consider a gossip network, consisting of $n$ nodes, which tracks the information at a source. The source updates its information with a Poisson arrival process and also sends updates to the nodes in the network. The nodes themselves can…

Information Theory · Computer Science 2023-10-03 Purbesh Mitra , Sennur Ulukus

Gossip algorithms are attractive for in-network processing in sensor networks because they do not require any specialized routing, there is no bottleneck or single point of failure, and they are robust to unreliable wireless network…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Alexandros G. Dimakis , Soummya Kar , Jose M. F. Moura , Michael G. Rabbat , Anna Scaglione

This paper studies reliability of probabilistic neighbor-aware gossip algorithms over three well- known large-scale random topologies, namely Bernoulli (or Erd\H{o}s-R\'enyi) graph, the random geometric graph, and the scale-free graph. We…

Networking and Internet Architecture · Computer Science 2017-04-20 Ruijing Hu , Leander Jehl

We study the gossip problem in a message-passing environment: When a process receives a message, it has to decide whether the sender has more recent information on other processes than itself. This problem is at the heart of many…

Formal Languages and Automata Theory · Computer Science 2018-04-30 Benedikt Bollig , Marie Fortin , Paul Gastin

In this short note we propose a new approach for the design and analysis of randomized gossip algorithms which can be used to solve the average consensus problem. We show how that Randomized Block Kaczmarz (RBK) method - a method for…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-18 Nicolas Loizou , Peter Richtárik

Gossip algorithms for distributed computation are attractive due to their simplicity, distributed nature, and robustness in noisy and uncertain environments. However, using standard gossip algorithms can lead to a significant waste in…

Information Theory · Computer Science 2009-11-13 Alexandros G. Dimakis , Anand D. Sarwate , Martin J. Wainwright

In the IoT era, information is more and more frequently picked up by connected smart sensors with increasing, though limited, storage, communication and computation abilities. Whether due to privacy constraints or to the structure of the…

Machine Learning · Computer Science 2026-03-26 Igor Colin , Aurélien Bellet , Stephan Clémençon , Joseph Salmon

We study the fundamental problem of information spreading (also known as gossip) in dynamic networks. In gossip, or more generally, $k$-gossip, there are $k$ pieces of information (or tokens) that are initially present in some nodes and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-12-05 Chinmoy Dutta , Gopal Pandurangan , Rajmohan Rajaraman , Zhifeng Sun

In the first part of the paper, we have studied the computational privacy risks in distributed computing protocols against local or global dynamics eavesdroppers, and proposed a Privacy-Preserving-Summation-Consistent (PPSC) mechanism as a…

Systems and Control · Computer Science 2019-02-20 Yang Liu , Junfeng Wu , Ian Manchester , Guodong Shi

Bilevel optimization have gained growing interests, with numerous applications found in meta learning, minimax games, reinforcement learning, and nested composition optimization. This paper studies the problem of distributed bilevel…

Machine Learning · Statistics 2022-06-23 Shuoguang Yang , Xuezhou Zhang , Mengdi Wang

Gossip and in particular network coded algebraic gossip have recently attracted attention as a fast, bandwidth-efficient, reliable and distributed way to broadcast or multicast multiple messages. While the algorithms are simple, involved…

Data Structures and Algorithms · Computer Science 2012-06-01 Bernhard Haeupler

Broadcasting and gossiping are fundamental communication tasks in networks. In broadcasting,one node of a network has a message that must be learned by all other nodes. In gossiping, every node has a (possibly different) message, and all…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-22 Kokouvi Hounkanli , Andrzej Pelc

We study a gossip-based algorithm for searching data objects in a multipeer communication network. All of the nodes in the network are able to communicate with each other. There exists an initiator node that starts a round of searches by…

Networking and Internet Architecture · Computer Science 2009-07-16 Eva Jaho , Ioannis Koukoutsidis , Siyu Tang , Ioannis Stavrakakis , Piet Van Mieghem

We address the issue of speeding up the training of convolutional neural networks by studying a distributed method adapted to stochastic gradient descent. Our parallel optimization setup uses several threads, each applying individual…

Machine Learning · Computer Science 2018-11-13 Michael Blot , David Picard , Matthieu Cord

In many applications, nodes in a network desire not only a consensus, but an optimal one. To date, a family of subgradient algorithms have been proposed to solve this problem under general convexity assumptions. This paper shows that, for…

Optimization and Control · Mathematics 2011-02-11 Jie Lu , Choon Yik Tang , Paul R. Regier , Travis D. Bow

This paper analyzes a class of dissemination algorithms for the discovery of distributed contents in Peer-to-Peer unstructured overlay networks. The algorithms are a mix of protocols employing local knowledge of peers' neighborhood and…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-13 Stefano Ferretti

Large language models have advanced rapidly, but no single model excels in every area -- each has its strengths and weaknesses. Instead of relying on one model alone, we take inspiration from gossip protocols in distributed systems, where…

Multiagent Systems · Computer Science 2025-08-27 Saksham Arora