English
Related papers

Related papers: Global Convergence Guarantees for Federated Policy…

200 papers

In tabular multi-agent reinforcement learning with average-cost criterion, a team of agents sequentially interacts with the environment and observes local incentives. We focus on the case that the global reward is a sum of local rewards,…

Optimization and Control · Mathematics 2021-10-26 Alec Koppel , Amrit Singh Bedi , Bhargav Ganguly , Vaneet Aggarwal

This paper considers the problem of solving constrained reinforcement learning (RL) problems with anytime guarantees, meaning that the algorithmic solution must yield a constraint-satisfying policy at every iteration of its evolution. Our…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Pol Mestres , Arnau Marzabal , Jorge Cortés

In Internet-of-Things systems, federated learning has advanced online reinforcement learning (RL) by enabling parallel policy training without sharing raw data. However, interacting with real environments online can be risky and costly,…

Machine Learning · Computer Science 2026-02-03 Nan Qiao , Sheng Yue

Action-constrained reinforcement learning (RL) is a widely-used approach in various real-world applications, such as scheduling in networked systems with resource constraints and control of a robot with kinematic constraints. While the…

Machine Learning · Computer Science 2021-08-03 Jyun-Li Lin , Wei Hung , Shang-Hsuan Yang , Ping-Chun Hsieh , Xi Liu

Federated Learning (FL) is an emerging decentralized learning paradigm that can partly address the privacy concern that cannot be handled by traditional centralized and distributed learning. Further, to make FL practical, it is also…

Machine Learning · Computer Science 2025-03-19 Binghui Zhang , Luis Mares De La Cruz , Binghui Wang

Many emerging agentic paradigms require agents to collaborate with one another (or people) to achieve shared goals. Unfortunately, existing approaches to learning policies for such collaborative problems produce brittle solutions that fail…

Machine Learning · Computer Science 2026-03-02 Chengrui Qu , Yizhou Zhang , Nicolas Lanzetti , Eric Mazumdar

Federated Learning (FL) enables privacy-preserving collaborative model training, but its effectiveness is often limited by client data heterogeneity. We introduce a client-selection algorithm that (i) dynamically forms nonoverlapping…

Machine Learning · Computer Science 2025-10-16 Alessandro Licciardi , Roberta Raineri , Anton Proskurnikov , Lamberto Rondoni , Lorenzo Zino

Federated Learning (FL) enables multiple clients to collaboratively train models without sharing raw data, but it is highly vulnerable to Byzantine attacks. Existing robust approaches can neutralize these threats but incur substantial…

Machine Learning · Computer Science 2026-05-28 Shiyuan Zuo , Jiashuo Li , Rongfei Fan , Han Hu , Jie Xu

Hybrid RL is the setting where an RL agent has access to both offline data and online data by interacting with the real-world environment. In this work, we propose a new hybrid RL algorithm that combines an on-policy actor-critic method…

Machine Learning · Computer Science 2023-11-15 Yifei Zhou , Ayush Sekhari , Yuda Song , Wen Sun

Non-IID data distribution across clients and poisoning attacks are two main challenges in real-world federated learning (FL) systems. While both of them have attracted great research interest with specific strategies developed, no known…

Machine Learning · Computer Science 2022-11-22 Yueqi Xie , Weizhong Zhang , Renjie Pi , Fangzhao Wu , Qifeng Chen , Xing Xie , Sunghun Kim

Federated Learning (FL) enables decentralized model training across multiple clients while optionally preserving data privacy. However, communication efficiency remains a critical bottleneck, particularly for large-scale models. In this…

Machine Learning · Computer Science 2025-11-11 Arnaud Descours , Léonard Deroose , Jan Ramon

Federated learning (FL) systems are susceptible to attacks from malicious actors who might attempt to corrupt the training model through various poisoning attacks. FL also poses new challenges in addressing group bias, such as ensuring fair…

Machine Learning · Computer Science 2023-06-08 Viktor Valadi , Xinchi Qiu , Pedro Porto Buarque de Gusmão , Nicholas D. Lane , Mina Alibeigi

Reinforcement Learning (RL) can directly enhance the reasoning capabilities of large language models without extensive reliance on Supervised Fine-Tuning (SFT). In this work, we revisit the traditional Policy Gradient (PG) mechanism and…

Machine Learning · Computer Science 2026-02-04 Xiangxiang Chu , Hailang Huang , Xiao Zhang , Fei Wei , Yong Wang

Resource allocation significantly impacts the performance of vehicle-to-everything (V2X) networks. Most existing algorithms for resource allocation are based on optimization or machine learning (e.g., reinforcement learning). In this paper,…

Machine Learning · Computer Science 2023-10-17 Kaidi Xu , Shenglong Zhou , Geoffrey Ye Li

Federated Learning (FL) has emerged as a machine learning approach able to preserve the privacy of user's data. Applying FL, clients train machine learning models on a local dataset and a central server aggregates the learned parameters…

Cryptography and Security · Computer Science 2024-09-27 Luiz Leite , Yuri Santo , Bruno L. Dalmazo , André Riker

Federated Learning (FL) enables a group of clients to jointly train a machine learning model with the help of a centralized server. Clients do not need to submit their local data to the server during training, and hence the local training…

Machine Learning · Computer Science 2023-01-10 Liling Zhang , Xinyu Lei , Yichun Shi , Hongyu Huang , Chao Chen

A major challenge of reinforcement learning (RL) in real-world applications is the variation between environments, tasks or clients. Meta-RL (MRL) addresses this issue by learning a meta-policy that adapts to new tasks. Standard MRL methods…

Machine Learning · Computer Science 2023-10-03 Ido Greenberg , Shie Mannor , Gal Chechik , Eli Meirom

Modern multi-agent reinforcement learning (RL) algorithms hold great potential for solving a variety of real-world problems. However, they do not fully exploit cross-agent knowledge to reduce sample complexity and improve performance.…

Artificial Intelligence · Computer Science 2023-04-13 Haozhi Wang , Yinchuan Li , Qing Wang , Yunfeng Shao , Jianye Hao

Reinforcement learning (RL) is one of the most practical ways to learn from real-life use-cases. Motivated from the cognitive methods used by humans makes it a widely acceptable strategy in the field of artificial intelligence. Most of the…

Artificial Intelligence · Computer Science 2026-04-14 Abhishek Sawaika , Samuel Yen-Chi Chen , Udaya Parampalli , Rajkumar Buyya

Deep reinforcement learning (DRL) has emerged as a promising paradigm for autonomous driving. However, despite their advanced capabilities, DRL-based policies remain highly vulnerable to adversarial attacks, posing serious safety risks in…

Machine Learning · Computer Science 2025-06-24 Junchao Fan , Xuyang Lei , Xiaolin Chang