English
Related papers

Related papers: Communication-efficient Distributed Cooperative Le…

200 papers

The cooperative bandit problem is increasingly becoming relevant due to its applications in large-scale decision-making. However, most research for this problem focuses exclusively on the setting with perfect communication, whereas in most…

Machine Learning · Statistics 2021-11-25 Udari Madhushani , Abhimanyu Dubey , Naomi Ehrich Leonard , Alex Pentland

Non-Bayesian social learning theory provides a framework for distributed inference of a group of agents interacting over a social network by sequentially communicating and updating beliefs about the unknown state of the world through…

Methodology · Statistics 2019-10-25 James Z. Hare , Cesar Uribe , Lance Kaplan , Ali Jadbabaie

In this paper, we investigate distributed inference schemes, over binary-valued Markov random fields, which are realized by the belief propagation (BP) algorithm. We first show that a decision variable obtained by the BP algorithm in a…

Information Theory · Computer Science 2019-09-19 Younes Abdi , Tapani Ristaniemi

In this letter, we formulate a compositional distributed learning framework for multi-view perception by leveraging the maximal coding rate reduction principle combined with subspace basis fusion. In the proposed algorithm, each agent…

Image and Video Processing · Electrical Eng. & Systems 2025-11-13 Zhuojun Tian , Mehdi Bennis

Conventional distributed approaches to coverage control may suffer from lack of convergence and poor performance, due to the fact that agents have limited information, especially in non-convex discrete environments. To address this issue,…

Computer Science and Game Theory · Computer Science 2024-04-09 Tatsuya Iwase , Aurélie Beynier , Nicolas Bredeche , Nicolas Maudet , Jason R. Marden

In this paper we study the problem of social learning under multiple true hypotheses and self-interested agents which exchange information over a graph. In this setup, each agent receives data that might be generated from a different…

Multiagent Systems · Computer Science 2021-10-27 Konstantinos Ntemos , Virginia Bordignon , Stefan Vlaski , Ali H. Sayed

The distributed coordination of robot teams performing complex tasks is challenging to formulate. The different aspects of a complete task such as local planning for obstacle avoidance, global goal coordination and collaborative mapping are…

Robotics · Computer Science 2023-10-04 Aalok Patwardhan , Andrew J. Davison

In this paper, we propose the problem of collaborative perception, where robots can combine their local observations with those of neighboring agents in a learnable way to improve accuracy on a perception task. Unlike existing work in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Yen-Cheng Liu , Junjiao Tian , Chih-Yao Ma , Nathan Glaser , Chia-Wen Kuo , Zsolt Kira

This work studies the problem of ad hoc teamwork in teams composed of agents with differing computational capabilities. We consider cooperative multi-player games in which each agent's policy is constrained by a private capability…

Multiagent Systems · Computer Science 2023-04-28 Charles Jin , Zhang-Wei Hong , Farid Arthaud , Idan Orzech , Martin Rinard

This work studies the learning abilities of agents sharing partial beliefs over social networks. The agents observe data that could have risen from one of several hypotheses and interact locally to decide whether the observations they are…

Signal Processing · Electrical Eng. & Systems 2019-10-31 Virginia Bordignon , Vincenzo Matta , Ali H. Sayed

Federated learning faces severe communication bottlenecks due to the high dimensionality of model updates. Communication compression with contractive compressors (e.g., Top-K) is often preferable in practice but can degrade performance…

Machine Learning · Computer Science 2025-06-04 Rustem Islamov , Yarden As , Ilyas Fatkhullin

A network of agents attempt to learn some unknown state of the world drawn by nature from a finite set. Agents observe private signals conditioned on the true state, and form beliefs about the unknown state accordingly. Each agent may face…

Machine Learning · Computer Science 2015-03-13 Shahin Shahrampour , Mohammad Amin Rahimian , Ali Jadbabaie

Inspired by biological swarms, robotic swarms are envisioned to solve real-world problems that are difficult for individual agents. Biological swarms can achieve collective intelligence based on local interactions and simple rules; however,…

Robotics · Computer Science 2017-09-21 Qiyang Li , Xintong Du , Yizhou Huang , Quinlan Sykora , Angela P. Schoellig

Information theoretic secrecy is combined with cryptographic secrecy to create a secret-key exchange protocol for wireless networks. A network of transmitters, which already have cryptographically secured channels between them, cooperate to…

Cryptography and Security · Computer Science 2016-11-15 Toni Draganov Stojanovski , Ninoslav Marina

Privacy and communication constraints are two major bottlenecks in federated learning (FL) and analytics (FA). We study the optimal accuracy of mean and frequency estimation (canonical models for FL and FA respectively) under joint…

Machine Learning · Statistics 2023-04-05 Wei-Ning Chen , Dan Song , Ayfer Ozgur , Peter Kairouz

Diffusion learning is a framework that endows edge devices with advanced intelligence. By processing and analyzing data locally and allowing each agent to communicate with its immediate neighbors, diffusion effectively protects the privacy…

Machine Learning · Computer Science 2025-05-19 Elsa Rizk , Kun Yuan , Ali H. Sayed

Continual learning is often motivated by the idea, known as the big world hypothesis, that "the world is bigger" than the agent. Recent problem formulations capture this idea by explicitly constraining an agent relative to the environment.…

Artificial Intelligence · Computer Science 2025-12-30 Alex Lewandowski , Adtiya A. Ramesh , Edan Meyer , Dale Schuurmans , Marlos C. Machado

We consider the problem of PAC-learning from distributed data and analyze fundamental communication complexity questions involved. We provide general upper and lower bounds on the amount of communication needed to learn well, showing that…

Machine Learning · Computer Science 2012-05-28 Maria-Florina Balcan , Avrim Blum , Shai Fine , Yishay Mansour

Distributed high dimensional mean estimation is a common aggregation routine used often in distributed optimization methods. Most of these applications call for a communication-constrained setting where vectors, whose mean is to be…

Machine Learning · Statistics 2026-01-28 Harsh Vardhan , Arya Mazumdar

We consider the following communication task in the multi-party setting, which involves a joint random variable $XYZMN$ with the property that $M$ is independent of $YZN$ conditioned on $X$ and $N$ is independent of $XZM$ conditioned on…

Information Theory · Computer Science 2020-03-24 Anurag Anshu , Penghui Yao