English
Related papers

Related papers: Decentralized Collaborative Learning of Personaliz…

200 papers

In decentralized networks (of sensors, connected objects, etc.), there is an important need for efficient algorithms to optimize a global cost function, for instance to learn a global model from the local data collected by each computing…

Machine Learning · Statistics 2019-01-25 Igor Colin , Aurélien Bellet , Joseph Salmon , Stéphan Clémençon

The rapid growth of wearable sensor technologies holds substantial promise for the field of personalized and context-aware Human Activity Recognition. Given the inherently decentralized nature of data sources within this domain, the…

Signal Processing · Electrical Eng. & Systems 2023-11-09 Ahmad Esmaeili , Zahra Ghorrati , Eric T. Matson

In this paper, we devise three actor-critic algorithms with decentralized training for multi-agent reinforcement learning in cooperative, adversarial, and mixed settings with continuous action spaces. To this goal, we adapt the MADDPG…

Machine Learning · Computer Science 2025-03-11 Diego Bolliger , Lorenz Zauter , Robert Ziegler

We study locally differentially private algorithms for reinforcement learning to obtain a robust policy that performs well across distributed private environments. Our algorithm protects the information of local agents' models from being…

Machine Learning · Computer Science 2020-02-03 Hajime Ono , Tsubasa Takahashi

The vulnerability of machine learning models to adversarial attacks has been attracting considerable attention in recent years. Most existing studies focus on the behavior of stand-alone single-agent learners. In comparison, this work…

Machine Learning · Computer Science 2025-05-13 Ying Cao , Elsa Rizk , Stefan Vlaski , Ali H. Sayed

In important applications involving multi-task networks with multiple objectives, agents in the network need to decide between these multiple objectives and reach an agreement about which single objective to follow for the network. In this…

Optimization and Control · Mathematics 2018-12-27 Sahar Khawatmi , Abdelhak M. Zoubir , Ali H. Sayed

We present a practical asynchronous data fusion model for networked agents to perform distributed Bayesian learning without sharing raw data. Our algorithm uses a gossip-based approach where pairs of randomly selected agents employ…

Machine Learning · Computer Science 2022-11-17 Kinjal Bhar , He Bai , Jemin George , Carl Busart

Decentralized learning with private data is a central problem in machine learning. We propose a novel distillation-based decentralized learning technique that allows multiple agents with private non-iid data to learn from each other,…

Machine Learning · Computer Science 2022-11-30 Andrey Zhmoginov , Mark Sandler , Nolan Miller , Gus Kristiansen , Max Vladymyrov

In federated learning, models are learned from users' data that are held private in their edge devices, by aggregating them in the service provider's "cloud" to obtain a global model. Such global model is of great commercial value in, e.g.,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-02 Ruiyuan Wu , Anna Scaglione , Hoi-To Wai , Nurullah Karakoc , Kari Hreinsson , Wing-Kin Ma

Distributed learning has become an integral tool for scaling up machine learning and addressing the growing need for data privacy. Although more robust to the network topology, decentralized learning schemes have not gained the same level…

Machine Learning · Computer Science 2021-11-16 Junya Chen , Sijia Wang , Lawrence Carin , Chenyang Tao

We propose an asynchronous, decentralized algorithm for consensus optimization. The algorithm runs over a network in which the agents communicate with their neighbors and perform local computation. In the proposed algorithm, each agent can…

Optimization and Control · Mathematics 2017-03-06 Tianyu Wu , Kun Yuan , Qing Ling , Wotao Yin , Ali H. Sayed

Decentralized optimization is widely used in large scale and privacy preserving machine learning and various distributed control and sensing systems. It is assumed that every agent in the network possesses a local objective function, and…

Optimization and Control · Mathematics 2023-01-31 Savelii Chezhegov , Anton Novitskii , Alexander Rogozin , Sergei Parsegov , Pavel Dvurechensky , Alexander Gasnikov

The emerging concern about data privacy and security has motivated the proposal of federated learning, which allows nodes to only synchronize the locally-trained models instead their own original data. Conventional federated learning…

Machine Learning · Computer Science 2019-08-22 Chenghao Hu , Jingyan Jiang , Zhi Wang

Cooperative multi-agent reinforcement learning is a powerful tool to solve many real-world cooperative tasks, but restrictions of real-world applications may require training the agents in a fully decentralized manner. Due to the lack of…

Multiagent Systems · Computer Science 2024-01-11 Jiechuan Jiang , Kefan Su , Zongqing Lu

We consider an asynchronous decentralized learning system, which consists of a network of connected devices trying to learn a machine learning model without any centralized parameter server. The users in the network have their own local…

Information Theory · Computer Science 2024-05-01 Purbesh Mitra , Sennur Ulukus

Many machine learning problems can be formulated as consensus optimization problems which can be solved efficiently via a cooperative multi-agent system. However, the agents in the system can be unreliable due to a variety of reasons:…

Machine Learning · Computer Science 2018-05-23 Qunwei Li , Bhavya Kailkhura , Ryan Goldhahn , Priyadip Ray , Pramod K. Varshney

The proliferation of edge networks creates islands of learning agents working on local streams of data. Transferring knowledge between these agents in real-time without exposing private data allows for collaboration to decrease learning…

Machine Learning · Computer Science 2021-10-04 Orpaz Goldstein , Mohammad Kachuee , Derek Shiell , Majid Sarrafzadeh

This paper seeks to establish a framework for directing a society of simple, specialized, self-interested agents to solve what traditionally are posed as monolithic single-agent sequential decision problems. What makes it challenging to use…

Machine Learning · Computer Science 2020-08-17 Michael Chang , Sidhant Kaushik , S. Matthew Weinberg , Thomas L. Griffiths , Sergey Levine

This chapter deals with decentralized learning algorithms for in-network processing of graph-valued data. A generic learning problem is formulated and recast into a separable form, which is iteratively minimized using the…

Optimization and Control · Mathematics 2015-04-01 Georgios B. Giannakis , Qing Ling , Gonzalo Mateos , Ioannis D. Schizas , Hao Zhu

Adaptive networks have the capability to pursue solutions of global stochastic optimization problems by relying only on local interactions within neighborhoods. The diffusion of information through repeated interactions allows for globally…

Multiagent Systems · Computer Science 2021-03-30 Stefan Vlaski , Ali H. Sayed