English
Related papers

Related papers: Personalized and Resilient Distributed Learning Th…

200 papers

Feedback optimization is an increasingly popular control paradigm to optimize dynamical systems, accounting for control objectives that concern the system operation at steady-state. Existing feedback optimization techniques heavily rely on…

Optimization and Control · Mathematics 2025-04-08 Amir Mehrnoosh , Gianluca Bianchin

The recent deployment of multi-agent networks has enabled the distributed solution of learning problems, where agents cooperate to train a global model without sharing their local, private data. This work specifically targets some prevalent…

Optimization and Control · Mathematics 2024-08-20 Nicola Bastianello , Diego Deplano , Mauro Franceschelli , Karl H. Johansson

Deep learning has enabled traditional reinforcement learning methods to deal with high-dimensional problems. However, one of the disadvantages of deep reinforcement learning methods is the limited exploration capacity of learning agents. In…

Machine Learning · Computer Science 2019-07-30 Thanh Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Deep reinforcement learning for multi-agent cooperation and competition has been a hot topic recently. This paper focuses on cooperative multi-agent problem based on actor-critic methods under local observations settings. Multi agent deep…

Artificial Intelligence · Computer Science 2017-10-04 Xiangxiang Chu , Hangjun Ye

This article reviews recent advances in multi-agent reinforcement learning algorithms for large-scale control systems and communication networks, which learn to communicate and cooperate. We provide an overview of this emerging field, with…

Machine Learning · Computer Science 2020-06-24 Donghwan Lee , Niao He , Parameswaran Kamalaruban , Volkan Cevher

A resilient distributed algorithm is proposed to solve the distributed resource allocation problem of a first-order nonlinear multi-agent system who is subject to false data injection (FDI) attacks. An intelligent attacker injects false…

Optimization and Control · Mathematics 2022-12-07 Xin Cai , Xinyuan Nan , Binpeng Gao

Data used to train machine learning models can be adversarial--maliciously constructed by adversaries to fool the model. Challenge also arises by privacy, confidentiality, or due to legal constraints when data are geographically gathered…

Machine Learning · Computer Science 2020-07-09 Alireza Sadeghi , Gang Wang , Meng Ma , Georgios B. Giannakis

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

We study the problem of online personalized decentralized learning with $N$ statistically heterogeneous clients collaborating to accelerate local training. An important challenge in this setting is to select relevant collaborators to reduce…

Machine Learning · Statistics 2025-07-10 Constantin Philippenko , Batiste Le Bars , Kevin Scaman , Laurent Massoulié

In personalized Federated Learning, each member of a potentially large set of agents aims to train a model minimizing its loss function averaged over its local data distribution. We study this problem under the lens of stochastic…

Optimization and Control · Mathematics 2022-02-02 Mathieu Even , Laurent Massoulié , Kevin Scaman

In this paper we address distributed learning problems over peer-to-peer networks. In particular, we focus on the challenges of quantized communications, asynchrony, and stochastic gradients that arise in this set-up. We first discuss how…

Optimization and Control · Mathematics 2025-09-04 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

We consider a distributed learning setup where a network of agents sequentially access realizations of a set of random variables with unknown distributions. The network objective is to find a parametrized distribution that best describes…

Optimization and Control · Mathematics 2016-05-10 Angelia Nedić , Alex Olshevsky , César Uribe

Representation learning is a widely adopted framework for learning in data-scarce environments to obtain a feature extractor or representation from various different yet related tasks. Despite extensive research on representation learning,…

Machine Learning · Computer Science 2025-12-30 Donghwa Kang , Shana Moothedath

We consider a distributed multi-task learning scheme that accounts for multiple linear model estimation tasks with heterogeneous and/or correlated data streams. We assume that nodes can be partitioned into groups corresponding to different…

Multiagent Systems · Computer Science 2024-10-07 Lingzhou Hong , Alfredo Garcia

Federated learning is a method of training models on private data distributed over multiple devices. To keep device data private, the global model is trained by only communicating parameters and updates which poses scalability challenges…

We consider distributed online learning for joint regret with communication constraints. In this setting, there are multiple agents that are connected in a graph. Each round, an adversary first activates one of the agents to issue a…

Machine Learning · Computer Science 2021-10-26 Dirk van der Hoeven , Hédi Hadiji , Tim van Erven

Federated learning enables collaborative model training across distributed clients while preserving data privacy. However, in practical deployments, device heterogeneity, non-independent, and identically distributed (Non-IID) data often…

Artificial Intelligence · Computer Science 2026-02-20 Jin Wang , Hui Ma , Fei Xing , Ming Yan

This paper aims to provide a new perspective on the interplay between decentralization -- a prevalent character of multi-agent systems -- and centralization, i.e., the task of imposing central control to meet system-level goals. In…

Social and Information Networks · Computer Science 2022-10-31 Yiping Liu , Jiamou Liu , Bakhadyr Khoussaino , Miao Qiao , Bo Yan

We study distributed estimation and learning problems in a networked environment where agents exchange information to estimate unknown statistical properties of random variables from their privately observed samples. The agents can…

Machine Learning · Computer Science 2024-04-02 Marios Papachristou , M. Amin Rahimian

Federated learning (FL) research has made progress in developing algorithms for distributed learning of global models, as well as algorithms for local personalization of those common models to the specifics of each client's local data…

Machine Learning · Computer Science 2023-10-05 Royson Lee , Minyoung Kim , Da Li , Xinchi Qiu , Timothy Hospedales , Ferenc Huszár , Nicholas D. Lane