English
Related papers

Related papers: Asynchronous Diffusion Learning with Agent Subsamp…

200 papers

In this paper, we deal with distributed estimation problems in diffusion networks with heterogeneous nodes, i.e., nodes that either implement different adaptive rules or differ in some other aspect such as the filter structure or length, or…

Systems and Control · Computer Science 2017-09-05 Jesus Fernandez-Bes , Jerónimo Arenas-García , Magno T. M. Silva , Luis A. Azpicueta-Ruiz

Distributed learning is essential to train machine learning algorithms across heterogeneous agents while maintaining data privacy. We conduct an asymptotic analysis of Unified Distributed SGD (UD-SGD), exploring a variety of communication…

Machine Learning · Computer Science 2024-10-30 Jie Hu , Yi-Ting Ma , Do Young Eun

This work develops effective distributed strategies for the solution of constrained multi-agent stochastic optimization problems with coupled parameters across the agents. In this formulation, each agent is influenced by only a subset of…

Optimization and Control · Mathematics 2019-03-15 Sulaiman A. Alghunaim , Ali H. Sayed

We propose an asynchronous, decentralized algorithm for consensus optimization. The algorithm runs over a network in which the agents communicate with their neighbors and perform local computation. In the proposed algorithm, each agent can…

Optimization and Control · Mathematics 2017-03-06 Tianyu Wu , Kun Yuan , Qing Ling , Wotao Yin , Ali H. Sayed

The objective of meta-learning is to exploit the knowledge obtained from observed tasks to improve adaptation to unseen tasks. As such, meta-learners are able to generalize better when they are trained with a larger number of observed tasks…

Machine Learning · Computer Science 2022-10-11 Mert Kayaalp , Stefan Vlaski , Ali H. Sayed

This work examines adaptive distributed learning strategies designed to operate under communication constraints. We consider a network of agents that must solve an online optimization problem from continual observation of streaming data.…

Machine Learning · Computer Science 2025-04-25 Marco Carpentiero , Vincenzo Matta , Ali H. Sayed

One of the most important problems in the field of distributed optimization is the problem of minimizing a sum of local convex objective functions over a networked system. Most of the existing work in this area focus on developing…

Optimization and Control · Mathematics 2019-01-08 Fatemeh Mansoori , Ermin Wei

As multi-agent networks grow in size and scale, they become increasingly difficult to synchronize, though agents must work together even when generating and sharing different information at different times. Targeting such cases, this paper…

Optimization and Control · Mathematics 2018-09-18 Stefan Hochhaus , Matthew Hale

In this paper, we consider learning dictionary models over a network of agents, where each agent is only in charge of a portion of the dictionary elements. This formulation is relevant in Big Data scenarios where large dictionary models may…

Machine Learning · Computer Science 2015-06-18 Jianshu Chen , Zaid J. Towfic , Ali H. Sayed

In this paper we study the problem of social learning under multiple true hypotheses and self-interested agents which exchange information over a graph. In this setup, each agent receives data that might be generated from a different…

Multiagent Systems · Computer Science 2021-10-27 Konstantinos Ntemos , Virginia Bordignon , Stefan Vlaski , Ali H. Sayed

We consider the problem of distributed hypothesis testing (or social learning) where a network of agents seeks to identify the true state of the world from a finite set of hypotheses, based on a series of stochastic signals that each agent…

Multiagent Systems · Computer Science 2020-04-06 Shreyas Sundaram , Aritra Mitra

We study the distributed consensus of state vectors in a discrete-time multi-agent network with matrix edge weights using stochastic matrix convergence theory. We present a distributed asynchronous time update model wherein one randomly…

Systems and Control · Electrical Eng. & Systems 2025-08-05 P Raghavendra Rao , Pooja Vyavahare

We consider a multi-agent framework for distributed optimization where each agent has access to a local smooth strongly convex function, and the collective goal is to achieve consensus on the parameters that minimize the sum of the agents'…

Multiagent Systems · Computer Science 2020-04-23 Mahmoud Assran , Michael Rabbat

This paper studies the problem of finding the median of N distinct numbers distributed across networked agents. Each agent updates its estimate for the median from noisy local observations of one of the N numbers and information from…

Optimization and Control · Mathematics 2021-10-12 Shuhua Yu , Yuan Chen , Soummya Kar

We study a social learning scheme where at every time instant, each agent chooses to receive information from one of its neighbors at random. We show that under this sparser communication scheme, the agents learn the truth eventually and…

Multiagent Systems · Computer Science 2022-05-13 Yunus Inan , Mert Kayaalp , Emre Telatar , Ali H. Sayed

In this letter we focus on designing self-organizing diffusion mobile adaptive networks where the individual agents are allowed to move in pursuit of an objective (target). The well-known Adapt-then-Combine (ATC) algorithm is already…

Robotics · Computer Science 2016-03-30 Amir Rastegarnia , Azam Khalili , Md Kafiul Islam

This article presents the long-term behaviour analysis of Stochastic Diffusion Search (SDS), a distributed agent-based system for best-fit pattern matching. SDS operates by allocating simple agents into different regions of the search…

Artificial Intelligence · Computer Science 2007-05-23 Slawomir J. Nasuto , Mark J. Bishop

This paper considers the distributed optimization of a sum of locally observable, non-convex functions. The optimization is performed over a multi-agent networked system, and each local function depends only on a subset of the variables. An…

Optimization and Control · Mathematics 2016-05-04 Sandeep Kumar , Rahul Jain , Ketan Rajawat

In this paper, we study a distributed privacy-preserving learning problem in social networks with general topology. The agents can communicate with each other over the network, which may result in privacy disclosure, since the…

Social and Information Networks · Computer Science 2023-01-30 Youming Tao , Shuzhen Chen , Feng Li , Dongxiao Yu , Jiguo Yu , Hao Sheng

We consider a set of learning agents in a collaborative peer-to-peer network, where each agent learns a personalized model according to its own learning objective. The question addressed in this paper is: how can agents improve upon their…

Machine Learning · Computer Science 2019-01-25 Paul Vanhaesebrouck , Aurélien Bellet , Marc Tommasi