English
Related papers

Related papers: On Gossip Algorithms for Machine Learning with Pai…

200 papers

A family of gossiping algorithms depending on a parameter permutation is introduced, formalized, and discussed. Several of its members are analyzed and their asymptotic behaviour is revealed, including a member whose model and performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-04-14 Vincenzo De Florio , Chris Blondia

The emerging concern about data privacy and security has motivated the proposal of federated learning, which allows nodes to only synchronize the locally-trained models instead their own original data. Conventional federated learning…

Machine Learning · Computer Science 2019-08-22 Chenghao Hu , Jingyan Jiang , Zhi Wang

In this paper, we develop and analyze a gossip-based average consensus algorithm that enables all of the components of a distributed system, each with some initial value, to reach (approximate) average consensus on their initial values…

Systems and Control · Electrical Eng. & Systems 2021-11-09 Nicolaos E. Manitara , Apostolos I. Rikos , Christoforos N. Hadjicostis

In this work we present novel provably accelerated gossip algorithms for solving the average consensus problem. The proposed protocols are inspired from the recently developed accelerated variants of the randomized Kaczmarz method - a…

Optimization and Control · Mathematics 2018-11-01 Nicolas Loizou , Michael Rabbat , Peter Richtárik

Bots, in recent times, have posed a major threat to enterprise networks. With the distributed nature of the way in which botnets operate, the problems faced by enterprises have become acute. A bot is a program that operates as an agent for…

Cryptography and Security · Computer Science 2012-07-03 Manoj Rameshchandra Thakur

Two widely considered decentralized learning algorithms are Gossip and random walk-based learning. Gossip algorithms (both synchronous and asynchronous versions) suffer from high communication cost, while random-walk based learning…

Machine Learning · Computer Science 2024-05-14 Peyman Gholami , Hulya Seferoglu

We address the issue of speeding up the training of convolutional neural networks by studying a distributed method adapted to stochastic gradient descent. Our parallel optimization setup uses several threads, each applying individual…

Machine Learning · Computer Science 2018-11-13 Michael Blot , David Picard , Matthieu Cord

We present an analytical framework for gossip protocols based on the pairwise information exchange between interacting nodes. This framework allows for studying the impact of protocol parameters on the performance of the protocol.…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-05-31 Rena Bakhshi , Daniela Gavidia , Wan Fokkink , Maarten van Steen

The influence of node mobility on the convergence time of averaging gossip algorithms in networks is studied. It is shown that a small number of fully mobile nodes can yield a significant decrease in convergence time. A method is developed…

Networking and Internet Architecture · Computer Science 2011-06-22 Anand D. Sarwate , Alexandros G. Dimakis

The gossip problem, in which information (known as secrets) must be shared among a certain number of agents using the minimum number of calls, is of interest in the conception of communication networks and protocols. We extend the gossip…

Artificial Intelligence · Computer Science 2016-06-15 Martin C. Cooper , Andreas Herzig , Faustine Maffre , Frédéric Maris , Pierre Régnier

In this paper, we study an asynchronous randomized gossip algorithm under unreliable communication. At each instance, two nodes are selected to meet with a given probability. When nodes meet, two unreliable communication links are…

Information Theory · Computer Science 2012-03-28 Guodong Shi , Mikael Johansson , Karl Henrik Johansson

In the first part of the paper, we have studied the computational privacy risks in distributed computing protocols against local or global dynamics eavesdroppers, and proposed a Privacy-Preserving-Summation-Consistent (PPSC) mechanism as a…

Systems and Control · Computer Science 2019-02-20 Yang Liu , Junfeng Wu , Ian Manchester , Guodong Shi

Gossip protocols have been proposed as a robust and efficient method for disseminating information throughout large-scale networks. In this paper, we propose a compositional analysis technique to study formal probabilistic models of gossip…

Logic in Computer Science · Computer Science 2023-06-22 Ruggero Lanotte , Massimo Merro , Simone Tini

In this paper, we study random gossip processes in communication models that describe the peer-to-peer networking functionality included in standard smartphone operating systems. Random gossip processes spread information through the basic…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-08 Calvin Newport , Alex Weaver

Gossip protocols form the basis of many smart collective adaptive systems. They are a class of fully decentralised, simple but robust protocols for the distribution of information throughout large scale networks with hundreds or thousands…

Performance · Computer Science 2020-04-17 Nicolas Gast , Diego Latella , Mieke Massink

As agentic platforms scale, agents are moving beyond fixed roles and predefined toolchains, creating an urgent need for flexible and decentralized coordination. Current structured communication protocols such as direct agent-to-agent…

Multiagent Systems · Computer Science 2025-12-04 Nafiul I. Khan , Mansura Habiba , Rafflesia Khan

Information dissemination is a fundamental problem in parallel and distributed computing. In its simplest variant, the broadcasting problem, a message has to be spread among all nodes of a graph. A prominent communication protocol for this…

Data Structures and Algorithms · Computer Science 2014-12-10 Robert Elsässer , Dominik Kaaser

The paper considers gossip distributed estimation of a (static) distributed random field (a.k.a., large scale unknown parameter vector) observed by sparsely interconnected sensors, each of which only observes a small fraction of the field.…

Information Theory · Computer Science 2015-05-20 Soummya Kar , Jose' M. F. Moura

By the distributed averaging problem is meant the problem of computing the average value of a set of numbers possessed by the agents in a distributed network using only communication between neighboring agents. Gossiping is a well-known…

Optimization and Control · Mathematics 2016-12-28 Ji Liu , Shaoshuai Mou , A. Stephen Morse , Brian D. O. Anderson , Changbin Yu

This paper studies reliability of probabilistic neighbor-aware gossip algorithms over three well- known large-scale random topologies, namely Bernoulli (or Erd\H{o}s-R\'enyi) graph, the random geometric graph, and the scale-free graph. We…

Networking and Internet Architecture · Computer Science 2017-04-20 Ruijing Hu , Leander Jehl