English
Related papers

Related papers: Order-Optimal Consensus through Randomized Path Av…

200 papers

We study a gossip protocol called forwarding without repeating (FWR). The objective is to spread multiple rumors over a graph as efficiently as possible. FWR accomplishes this by having nodes record which messages they have forwarded to…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-08-15 Vincent Gripon , Vitaly Skachek , Michael Rabbat

A localized method to distribute paths on random graphs is devised, aimed at finding the shortest paths between given source/destination pairs while avoiding path overlaps at nodes. We propose a method based on message-passing techniques to…

Disordered Systems and Neural Networks · Physics 2014-10-17 Caterina De Bacco , Silvio Franz , David Saad , Chi Ho Yeung

$O(\log n)$ rounds has been a well known upper bound for rumor spreading using push&pull in the random phone call model (i.e., uniform gossip in the complete graph). A matching lower bound of $\Omega(\log n)$ is also known for this special…

Data Structures and Algorithms · Computer Science 2015-12-10 Chen Avin , Robert Elsässer

Bilevel optimization have gained growing interests, with numerous applications found in meta learning, minimax games, reinforcement learning, and nested composition optimization. This paper studies the problem of distributed bilevel…

Machine Learning · Statistics 2022-06-23 Shuoguang Yang , Xuezhou Zhang , Mengdi Wang

In decentralized networks (of sensors, connected objects, etc.), there is an important need for efficient algorithms to optimize a global cost function, for instance to learn a global model from the local data collected by each computing…

Machine Learning · Statistics 2019-01-25 Igor Colin , Aurélien Bellet , Joseph Salmon , Stéphan Clémençon

We address the issue of speeding up the training of convolutional neural networks by studying a distributed method adapted to stochastic gradient descent. Our parallel optimization setup uses several threads, each applying individual…

Machine Learning · Computer Science 2018-11-13 Michael Blot , David Picard , Matthieu Cord

We propose a new protocol solving the fundamental problem of disseminating a piece of information to all members of a group of n players. It builds upon the classical randomized rumor spreading protocol and several extensions. The main…

Data Structures and Algorithms · Computer Science 2015-03-17 Benjamin Doerr , Mahmoud Fouz

We study networks of gossiping users where a source observing a process sends updates to an underlying graph. Nodes in the graph update their neighbors randomly and nodes always accept packets that have newer information, thus attempting to…

Information Theory · Computer Science 2025-01-23 Thomas Jacob Maranzatto , Arunabh Srivastava , Sennur Ulukus

We have recently proposed quantized gossip algorithms which solve the consensus and averaging problems on directed graphs with the least restrictive connectivity requirements. In this paper we study the convergence time of these algorithms.…

Systems and Control · Computer Science 2011-11-10 Kai Cai , Hideaki Ishii

As decentralized AI and edge intelligence become increasingly prevalent, ensuring robustness and trustworthiness in such distributed settings has become a critical issue-especially in the presence of corrupted or adversarial data.…

Machine Learning · Statistics 2025-09-12 Anna Van Elst , Igor Colin , Stephan Clémençon

We revisit the classic problem of spreading a piece of information in a group of $n$ fully connected processors. By suitably adding a small dose of randomness to the protocol of Gasienic and Pelc (1996), we derive for the first time…

Data Structures and Algorithms · Computer Science 2015-01-06 Benjamin Doerr , Carola Doerr , Shay Moran , Shlomo Moran

Although gossip and random walk-based learning algorithms are widely known for decentralized learning, there has been limited theoretical and experimental analysis to understand their relative performance for different graph topologies and…

Machine Learning · Computer Science 2026-04-20 Peyman Gholami , Hulya Seferoglu

Distributed averaging is among the most relevant cooperative control problems, with applications in sensor and robotic networks, distributed signal processing, data fusion, and load balancing. Consensus and gossip algorithms have been…

Systems and Control · Electrical Eng. & Systems 2023-09-06 Christel Sirocchi , Alessandro Bogliolo

We consider the average-consensus problem in a multi-node network of finite size. Communication between nodes is modeled by a sequence of directed signals with arbitrary communication delays. Four distributed algorithms that achieve…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-23 Kevin Topley , Vikram Krishnamurthy

Federated learning has emerged as a privacy-preserving technique for collaborative model training across heterogeneously distributed silos. Yet, its reliance on a single central server introduces potential bottlenecks and risks of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-13 Huong Nguyen , Hong-Tri Nguyen , Praveen Kumar Donta , Susanna Pirttikangas , Lauri Lovén

We consider gossiping in a fully-connected wireless network consisting of $n$ nodes. The network receives Poisson updates from a source, which generates new information. The nodes gossip their available information with the neighboring…

Information Theory · Computer Science 2023-03-09 Purbesh Mitra , Sennur Ulukus

The convergence of the gossip process has been extensively studied; however, algorithms that generate a set of stochastic matrices, the infinite product of which converges to a rank-one matrix determined by a given weight vector, have been…

Optimization and Control · Mathematics 2025-02-28 Erkan Bayram , Mohamed-Ali Belabbas

We study the optimal transmission and scheduling policy for a transmitter (source) communicating with two gossiping receivers aiming at tracking the source's status over time using the age of information (AoI) metric. Gossiping enables…

Information Theory · Computer Science 2026-02-13 Irtiza Hasan , Ahmed Arafa

We study the classical rumor spreading problem, which is used to spread information in an unknown network with $n$ nodes. We present the first protocol for any expander graph $G$ with $n$ nodes and minimum degree $\Theta(n)$ such that, the…

Data Structures and Algorithms · Computer Science 2013-11-13 Zeyu Guo , He Sun

Peer to peer (P2P) systems are moving from application specific architectures to a generic service oriented design philosophy. This raises interesting problems in connection with providing useful P2P middleware services that are capable of…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Antonio Fernandez , Vincent Gramoli , Ernesto Jimenez , Anne-Marie Kermarrec , Michel Raynal