English
Related papers

Related papers: On the Limit Performance of Floating Gossip

200 papers

We address the issue of speeding up the training of convolutional networks. Here we study a distributed method adapted to stochastic gradient descent (SGD). The parallel optimization setup uses several threads, each applying individual…

Computer Vision and Pattern Recognition · Computer Science 2016-11-30 Michael Blot , David Picard , Matthieu Cord , Nicolas Thome

This paper addresses the problem of robust estimation in gossip algorithms over arbitrary communication graphs. Gossip algorithms are fully decentralized, relying only on local neighbor-to-neighbor communication, making them well-suited for…

Machine Learning · Statistics 2026-01-01 Anna Van Elst , Igor Colin , Stephan Clémençon

Federated Learning (FL) enables collaborative model training among medical centers without sharing private data. However, traditional FL risks on server failures and suboptimal performance on local data due to the nature of centralized…

Image and Video Processing · Electrical Eng. & Systems 2024-01-30 Jingyun Chen , Yading Yuan

Federated learning (FL) has emerged as a promising strategy for collaboratively training complicated machine learning models from different medical centers without the need of data sharing. However, the traditional FL relies on a central…

Image and Video Processing · Electrical Eng. & Systems 2024-01-15 Jingyun Chen , Yading Yuan

Gossip algorithms are widely used to solve the distributed consensus problem, but issues can arise when nodes receive multiple signals either at the same time or before they are able to finish processing their current work load.…

Systems and Control · Computer Science 2013-01-15 Christopher D. Hollander , Annie S. Wu

Gossip algorithms for aggregation have recently received significant attention for sensor network applications because of their simplicity and robustness in noisy and uncertain environments. However, gossip algorithms can waste significant…

Information Theory · Computer Science 2007-07-13 Alexandros G. Dimakis , Anand D. Sarwate , Martin J. Wainwright

While distributed learning offers a new learning paradigm for distributed network with no central coordination, it is constrained by communication bottleneck between nodes. We develop a new event-triggered gossip framework for distributed…

Signal Processing · Electrical Eng. & Systems 2026-02-24 Zhiyuan Zhai , Xiaojun Yuan , Wei Ni , Xin Wang , Rui Zhang , Geoffrey Ye Li

In this paper we study two related iterative randomized algorithms for distributed computation of averages. The first one is the recently proposed Broadcast Gossip Algorithm, in which at each iteration one randomly selected node broadcasts…

Optimization and Control · Mathematics 2011-07-25 Paolo Frasca , Fabio Fagnani

Distributed learning has become an integral tool for scaling up machine learning and addressing the growing need for data privacy. Although more robust to the network topology, decentralized learning schemes have not gained the same level…

Machine Learning · Computer Science 2021-11-16 Junya Chen , Sijia Wang , Lawrence Carin , Chenyang Tao

We consider a gossip network, consisting of $n$ nodes, which tracks the information at a source. The source updates its information with a Poisson arrival process and also sends updates to the nodes in the network. The nodes themselves can…

Information Theory · Computer Science 2023-10-03 Purbesh Mitra , Sennur Ulukus

In this paper, we study gossip algorithms in communication models that describe the peer-to-peer networking functionality included in most standard smartphone operating systems. We begin by describing and analyzing a new synchronous gossip…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-16 Calvin Newport , Alex Weaver , Chaodong Zheng

Gossip algorithms is a common term to describe protocols for unreliable information dissemination in natural networks, which are not optimally designed for efficient communication between network entities. We consider application of gossip…

Quantum Physics · Physics 2016-11-22 Michael Siomau

We study a general framework for broadcast gossip algorithms which use companion variables to solve the average consensus problem. Each node maintains an initial state and a companion variable. Iterative updates are performed asynchronously…

Systems and Control · Computer Science 2012-09-03 Wu Shaochuan , Michael G. Rabbat

Gossip algorithms spread information by having nodes repeatedly forward information to a few random contacts. By their very nature, gossip algorithms tend to be distributed and fault tolerant. If done right, they can also be fast and…

Data Structures and Algorithms · Computer Science 2014-02-13 Bernhard Haeupler , Dahlia Malkhi

Two widely considered decentralized learning algorithms are Gossip and random walk-based learning. Gossip algorithms (both synchronous and asynchronous versions) suffer from high communication cost, while random-walk based learning…

Machine Learning · Computer Science 2024-05-14 Peyman Gholami , Hulya Seferoglu

Federated learning has emerged as a privacy-preserving technique for collaborative model training across heterogeneously distributed silos. Yet, its reliance on a single central server introduces potential bottlenecks and risks of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-13 Huong Nguyen , Hong-Tri Nguyen , Praveen Kumar Donta , Susanna Pirttikangas , Lauri Lovén

We present an analytical framework for gossip protocols based on the pairwise information exchange between interacting nodes. This framework allows for studying the impact of protocol parameters on the performance of the protocol.…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-05-31 Rena Bakhshi , Daniela Gavidia , Wan Fokkink , Maarten van Steen

We address the issue of speeding up the training of convolutional neural networks by studying a distributed method adapted to stochastic gradient descent. Our parallel optimization setup uses several threads, each applying individual…

Machine Learning · Computer Science 2018-11-13 Michael Blot , David Picard , Matthieu Cord

As agentic platforms scale, agents are moving beyond fixed roles and predefined toolchains, creating an urgent need for flexible and decentralized coordination. Current structured communication protocols such as direct agent-to-agent…

Multiagent Systems · Computer Science 2025-12-04 Nafiul I. Khan , Mansura Habiba , Rafflesia Khan

Mobile networks receive increasing research interest recently due to their increasingly wide applications in various areas; mobile ad hoc networks (MANET) and Vehicular ad hoc networks (VANET) are two prominent examples. Mobility introduces…

Social and Information Networks · Computer Science 2014-02-27 Huazi Zhang , Zhaoyang Zhang , Huaiyu Dai