English
Related papers

Related papers: Global Convergence Guarantees for Federated Policy…

200 papers

We study a Federated Reinforcement Learning (FedRL) problem in which $n$ agents collaboratively learn a single policy without sharing the trajectories they collected during agent-environment interaction. We stress the constraint of…

Machine Learning · Computer Science 2022-04-07 Hao Jin , Yang Peng , Wenhao Yang , Shusen Wang , Zhihua Zhang

This paper develops the first policy gradient method with global optimality guarantee and complexity analysis for robust reinforcement learning under model mismatch. Robust reinforcement learning is to learn a policy robust to model…

Machine Learning · Computer Science 2022-05-17 Yue Wang , Shaofeng Zou

Representation learning is increasingly applied to generate representations that generalize well across multiple downstream tasks. Ensuring fairness guarantees in representation learning is crucial to prevent unfairness toward specific…

Machine Learning · Computer Science 2025-10-27 Yuhong Luo , Austin Hoag , Xintong Wang , Philip S. Thomas , Przemyslaw A. Grabowicz

We investigate a Federated Reinforcement Learning with Environment Heterogeneity (FRL-EH) framework, where local environments exhibit statistical heterogeneity. Within this framework, agents collaboratively learn a global policy by…

Machine Learning · Computer Science 2025-07-22 Ukjo Hwang , Songnam Hong

We obtain global, non-asymptotic convergence guarantees for independent learning algorithms in competitive reinforcement learning settings with two agents (i.e., zero-sum stochastic games). We consider an episodic setting where in each…

Machine Learning · Computer Science 2021-01-13 Constantinos Daskalakis , Dylan J. Foster , Noah Golowich

Federated reinforcement learning (FRL) has emerged as a promising paradigm for reducing the sample complexity of reinforcement learning tasks by exploiting information from different agents. However, when each agent interacts with a…

Machine Learning · Computer Science 2024-04-16 Chenyu Zhang , Han Wang , Aritra Mitra , James Anderson

Meta federated learning (FL) is a personalized variant of FL, where multiple agents collaborate on training an initial shared model without exchanging raw data samples. The initial model should be trained in a way that current or new agents…

Machine Learning · Computer Science 2025-05-14 Mohammad Vahid Jamali , Hamid Saber , Jung Hyun Bae

Federated learning (FL) is a distributed machine learning paradigm that enables training models on decentralized data. The field of FL security against poisoning attacks is plagued with confusion due to the proliferation of research that…

Machine Learning · Computer Science 2024-03-12 Hamid Mozaffari , Sunav Choudhary , Amir Houmansadr

Generative adversarial imitation learning (GAIL) is a popular inverse reinforcement learning approach for jointly optimizing policy and reward from expert trajectories. A primary question about GAIL is whether applying a certain policy…

Machine Learning · Computer Science 2020-06-26 Ziwei Guan , Tengyu Xu , Yingbin Liang

Recently, empowered with the powerful capabilities of neural networks, reinforcement learning (RL) has successfully tackled numerous challenging tasks. However, while these models demonstrate enhanced decision-making abilities, they are…

Machine Learning · Computer Science 2025-10-09 Zhengpeng Xie , Yulong Zhang

Robust reinforcement learning (RL) considers the problem of learning policies that perform well in the worst case among a set of possible environment parameter values. In real-world environments, choosing the set of possible values for…

Machine Learning · Computer Science 2022-10-05 JB Lanier , Stephen McAleer , Pierre Baldi , Roy Fox

Vertical Federated Learning (VFL) has revolutionised collaborative machine learning by enabling privacy-preserving model training across multiple parties. However, it remains vulnerable to information leakage during intermediate computation…

Machine Learning · Computer Science 2025-05-19 Achmad Ginanjar , Xue Li , Priyanka Singh , Wen Hua

Federated learning (FL) is a training technique that enables client devices to jointly learn a shared model by aggregating locally-computed models without exposing their raw data. While most of the existing work focuses on improving the FL…

Machine Learning · Computer Science 2022-01-11 Sai Qian Zhang , Jieyu Lin , Qi Zhang

Federated learning (FL) is a communication-efficient collaborative learning framework that enables model training across multiple agents with private local datasets. While the benefits of FL in improving global model performance are well…

Machine Learning · Computer Science 2026-05-19 Fateme Maleki , Krishnan Raghavan , Farzad Yousefian

Group-agent reinforcement learning (GARL) is a newly arising learning scenario, where multiple reinforcement learning agents study together in a group, sharing knowledge in an asynchronous fashion. The goal is to improve the learning…

Machine Learning · Computer Science 2025-02-18 Kaiyue Wu , Xiao-Jun Zeng , Tingting Mu

Federated Reinforcement Learning (FedRL) encourages distributed agents to learn collectively from each other's experience to improve their performance without exchanging their raw trajectories. The existing work on FedRL assumes that all…

Machine Learning · Computer Science 2023-01-27 Flint Xiaofeng Fan , Yining Ma , Zhongxiang Dai , Cheston Tan , Bryan Kian Hsiang Low , Roger Wattenhofer

Federated Learning (FL) enables collaborative model training across multiple clients without sharing private data. We consider FL scenarios wherein FL clients are subject to adversarial (Byzantine) attacks, while the FL server is trusted…

Machine Learning · Computer Science 2026-04-30 Emmanouil Kritharakis , Dusan Jakovetic , Antonios Makris , Konstantinos Tserpes

Federated Reinforcement Learning (FRL) offers a promising solution to various practical challenges in resource allocation for vehicle-to-everything (V2X) networks. However, the data discrepancy among individual agents can significantly…

Signal Processing · Electrical Eng. & Systems 2024-05-06 Kaidi Xu , Shenglong Zhou , Geoffrey Ye Li

Extended reality technologies are transforming fields such as healthcare, entertainment, and education, with Smart Eye-Wears (SEWs) and Artificial Intelligence (AI) playing a crucial role. However, SEWs face inherent limitations in…

Artificial Intelligence · Computer Science 2025-08-26 Hamta Sedghani , Abednego Wamuhindo Kambale , Federica Filippini , Francesca Palermo , Diana Trojaniello , Danilo Ardagna

Risk-sensitive reinforcement learning (RL) is crucial for maintaining reliable performance in high-stakes applications. While traditional RL methods aim to learn a point estimate of the random cumulative cost, distributional RL (DRL) seeks…

Machine Learning · Computer Science 2025-02-03 Minheng Xiao , Xian Yu , Lei Ying