English
Related papers

Related papers: On Gossip Algorithms for Machine Learning with Pai…

200 papers

Gossip algorithms is a common term to describe protocols for unreliable information dissemination in natural networks, which are not optimally designed for efficient communication between network entities. We consider application of gossip…

Quantum Physics · Physics 2016-11-22 Michael Siomau

In this paper we investigate the limit performance of Floating Gossip, a new, fully distributed Gossip Learning scheme which relies on Floating Content to implement location-based probabilistic evolution of machine learning models in an…

Machine Learning · Statistics 2023-11-23 Gianluca Rizzo , Noelia Perez Palma , Marco Ajmone Marsan , Vincenzo Mancuso

We study a general framework for broadcast gossip algorithms which use companion variables to solve the average consensus problem. Each node maintains an initial state and a companion variable. Iterative updates are performed asynchronously…

Systems and Control · Computer Science 2012-09-03 Wu Shaochuan , Michael G. Rabbat

This paper describes and analyzes a hierarchical gossip algorithm for solving the distributed average consensus problem in wireless sensor networks. The network is recursively partitioned into subnetworks. Initially, nodes at the finest…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-02-29 Konstantinos I. Tsianos , Michael G. Rabbat

The concept of ranking aggregation plays a central role in preference analysis, and numerous algorithms for calculating median rankings, often originating in social choice theory, have been documented in the literature, offering theoretical…

Machine Learning · Computer Science 2026-05-14 Kerrian Le Caillec , Anna Van Elst , Igor Colin , Stephan Clémençon

We consider two variants of the classical gossip algorithm. The first variant is a version of asynchronous stochastic approximation. We highlight a fundamental difficulty associated with the classical asynchronous gossip scheme, viz., that…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-17 Vivek S. Borkar , Rahul Makhijani , Rajesh Sundaresan

Bilevel optimization have gained growing interests, with numerous applications found in meta learning, minimax games, reinforcement learning, and nested composition optimization. This paper studies the problem of distributed bilevel…

Machine Learning · Statistics 2022-06-23 Shuoguang Yang , Xuezhou Zhang , Mengdi Wang

This paper addresses the problem of robust estimation in gossip algorithms over arbitrary communication graphs. Gossip algorithms are fully decentralized, relying only on local neighbor-to-neighbor communication, making them well-suited for…

Machine Learning · Statistics 2026-01-01 Anna Van Elst , Igor Colin , Stephan Clémençon

This paper investigates the problem of distributed network-wide averaging and proposes a new greedy gossip algorithm. Instead of finding the optimal path of each node in a greedy manner, the proposed approach utilises a suboptimal…

Systems and Control · Computer Science 2019-08-20 Hyo-Sang Shin , Shaoming He , Antonios Tsourdos

In this paper we study two related iterative randomized algorithms for distributed computation of averages. The first one is the recently proposed Broadcast Gossip Algorithm, in which at each iteration one randomly selected node broadcasts…

Optimization and Control · Mathematics 2011-07-25 Paolo Frasca , Fabio Fagnani

In this work we present a new framework for the analysis and design of randomized gossip algorithms for solving the average consensus problem. We show how classical randomized iterative methods for solving linear systems can be interpreted…

Optimization and Control · Mathematics 2019-06-04 Nicolas Loizou , Peter Richtárik

Motivated by the large expansion in the study of social networks, this paper deals with the problem of multiple messages spreading over the same network using gossip algorithms. Given two messages distributed over some nodes of the graph,…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-02-04 Amine Semma , Ismail Elouafiq

This paper presents greedy gossip with eavesdropping (GGE), a novel randomized gossip algorithm for distributed computation of the average consensus problem. In gossip algorithms, nodes in the network randomly communicate with their…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-14 Deniz Ustebay , Boris Oreshkin , Mark Coates , Michael Rabbat

Gossiping is a communication mechanism, used for fast information dissemination in a network, where each node of the network randomly shares its information with the neighboring nodes. To characterize the notion of fastness in the context…

Information Theory · Computer Science 2023-12-27 Priyanka Kaswan , Purbesh Mitra , Arunabh Srivastava , Sennur Ulukus

As agentic platforms scale, agents are evolving beyond static roles and fixed toolchains, creating a growing need for flexible, decentralized coordination. Today's structured communication protocols (e.g., direct agent-to-agent messaging)…

Multiagent Systems · Computer Science 2025-08-05 Mansura Habiba , Nafiul I. Khan

We consider decentralized stochastic optimization with the objective function (e.g. data samples for machine learning task) being distributed over $n$ machines that can only communicate to their neighbors on a fixed communication graph. To…

Machine Learning · Computer Science 2019-02-04 Anastasia Koloskova , Sebastian U. Stich , Martin Jaggi

We study gossip algorithms for the fundamental rumor spreading problem, where the goal is to disseminate a rumor from a given source node to all nodes in an arbitrary (and unknown) graph. Gossip algorithms allow each node to call only one…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-15 Fabien Dufoulon , William K. Moses , Gopal Pandurangan

In decentralized optimization, it is common algorithmic practice to have nodes interleave (local) gradient descent iterations with gossip (i.e. averaging over the network) steps. Motivated by the training of large-scale machine learning…

Machine Learning · Computer Science 2020-11-24 Abolfazl Hashemi , Anish Acharya , Rudrajit Das , Haris Vikalo , Sujay Sanghavi , Inderjit Dhillon

In this work we present a randomized gossip algorithm for solving the average consensus problem while at the same time protecting the information about the initial private values stored at the nodes. We give iteration complexity bounds for…

Optimization and Control · Mathematics 2024-12-20 Filip Hanzely , Jakub Konečný , Nicolas Loizou , Peter Richtárik , Dmitry Grishchenko

The gossip-based distributed algorithms are widely used to solve decentralized optimization problems in various multi-agent applications, while they are generally vulnerable to data injection attacks by internal malicious agents as each…

Machine Learning · Computer Science 2021-01-19 Sissi Xiaoxiao Wu , Gangqiang Li , Shengli Zhang , Xiaohui Lin