English
Related papers

Related papers: Distributed Reinforcement Learning via Gossip

200 papers

The paper considers a class of multi-agent Markov decision processes (MDPs), in which the network agents respond differently (as manifested by the instantaneous one-stage random costs) to a global controlled state and the control actions of…

Machine Learning · Statistics 2015-06-04 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

We present a framework combining hierarchical and multi-agent deep reinforcement learning approaches to solve coordination problems among a multitude of agents using a semi-decentralized model. The framework extends the multi-agent learning…

Artificial Intelligence · Computer Science 2017-12-25 Saurabh Kumar , Pararth Shah , Dilek Hakkani-Tur , Larry Heck

We study a gossip-based algorithm for searching data objects in a multipeer communication network. All of the nodes in the network are able to communicate with each other. There exists an initiator node that starts a round of searches by…

Networking and Internet Architecture · Computer Science 2009-07-16 Eva Jaho , Ioannis Koukoutsidis , Siyu Tang , Ioannis Stavrakakis , Piet Van Mieghem

Modern artificial intelligence relies on networks of agents that collect data, process information, and exchange it with neighbors to collaboratively solve optimization and learning problems. This article introduces a novel distributed…

Optimization and Control · Mathematics 2026-01-15 Diego Deplano , Nicola Bastianello , Mauro Franceschelli , Karl H. Johansson

We present a novel distributed probabilistic bisection algorithm using social learning with application to target localization. Each agent in the network first constructs a query about the target based on its local information and obtains a…

Social and Information Networks · Computer Science 2016-12-30 Athanasios Tsiligkaridis , Theodoros Tsiligkaridis

Large language models have advanced rapidly, but no single model excels in every area -- each has its strengths and weaknesses. Instead of relying on one model alone, we take inspiration from gossip protocols in distributed systems, where…

Multiagent Systems · Computer Science 2025-08-27 Saksham Arora

We study the decentralized multi-agent multi-armed bandit problem for agents that communicate with probability over a network defined by a $d$-regular graph. Every edge in the graph has probabilistic weight $p$ to account for the…

Machine Learning · Statistics 2021-10-12 Udari Madhushani , Naomi Ehrich Leonard

This paper proposes a novel approach to resilient distributed optimization with quadratic costs in a networked control system (e.g., wireless sensor network, power grid, robotic team) prone to external attacks (e.g., hacking, power outage)…

Systems and Control · Electrical Eng. & Systems 2025-02-11 Luca Ballotta , Giacomo Como , Jeff S. Shamma , Luca Schenato

We study a social learning scheme where at every time instant, each agent chooses to receive information from one of its neighbors at random. We show that under this sparser communication scheme, the agents learn the truth eventually and…

Multiagent Systems · Computer Science 2022-05-13 Yunus Inan , Mert Kayaalp , Emre Telatar , Ali H. Sayed

In this work we present three different randomized gossip algorithms for solving the average consensus problem while at the same time protecting the information about the initial private values stored at the nodes. We give iteration…

Optimization and Control · Mathematics 2017-06-26 Filip Hanzely , Jakub Konečný , Nicolas Loizou , Peter Richtárik , Dmitry Grishchenko

In large-scale systems there are fundamental challenges when centralised techniques are used for task allocation. The number of interactions is limited by resource constraints such as on computation, storage, and network communication. We…

Artificial Intelligence · Computer Science 2022-05-12 Niall Creech , Natalia Criado Pacheco , Simon Miles

In traditional reinforcement learning, an agent maximizes the reward collected during its interaction with the environment by approximating the optimal policy through the estimation of value functions. Typically, given a state s and action…

Machine Learning · Computer Science 2018-06-20 Shangda Li , Selina Bing , Steven Yang

The distributed dual ascent is an established algorithm to solve strongly convex multi-agent optimization problems with separable cost functions, in the presence of coupling constraints. In this paper, we study its asynchronous counterpart.…

Optimization and Control · Mathematics 2021-05-05 Mattia Bianchi , Wicak Ananduta , Sergio Grammatico

In this paper, we study an asynchronous randomized gossip algorithm under unreliable communication. At each instance, two nodes are selected to meet with a given probability. When nodes meet, two unreliable communication links are…

Information Theory · Computer Science 2012-03-28 Guodong Shi , Mikael Johansson , Karl Henrik Johansson

In this paper, we consider a distributed learning problem in a subnetwork zero-sum game, where agents are competing in different subnetworks. These agents are connected through time-varying graphs where each agent has its own cost function…

Optimization and Control · Mathematics 2021-08-05 Shijie Huang , Jinlong Lei , Yiguang Hong , Uday V. Shanbhag , Jie Chen

We study the gossip problem in a message-passing environment: When a process receives a message, it has to decide whether the sender has more recent information on other processes than itself. This problem is at the heart of many…

Formal Languages and Automata Theory · Computer Science 2018-04-30 Benedikt Bollig , Marie Fortin , Paul Gastin

How can non-communicating agents learn to share congested resources efficiently? This is a challenging task when the agents can access the same resource simultaneously (in contrast to multi-agent multi-armed bandit problems) and the…

Multiagent Systems · Computer Science 2021-05-13 Tomer Boyarski , Amir Leshem , Vikram Krishnamurthy

Current approaches to multi-agent cooperation rely heavily on centralized mechanisms or explicit communication protocols to ensure convergence. This paper studies the problem of distributed multi-agent learning without resorting to…

Multiagent Systems · Computer Science 2025-08-19 Caroline Wang , Ishan Durugkar , Elad Liebman , Peter Stone

We provide a new non-asymptotic analysis of distributed TD(0) with linear function approximation. Our approach relies on "one-shot averaging," where $N$ agents run local copies of TD(0) and average the outcomes only once at the very end. We…

Machine Learning · Computer Science 2022-01-31 Rui Liu , Alex Olshevsky

Training generative adversarial networks (GAN) in a distributed fashion is a promising technology since it is contributed to training GAN on a massive of data efficiently in real-world applications. However, GAN is known to be difficult to…

Machine Learning · Computer Science 2020-10-27 Xiaojun Chen , Shu Yang , Li Shen , Xuanrong Pang