English
Related papers

Related papers: Federated Reinforcement Learning with Constraint H…

200 papers

It is critical for robots to explore Federated Learning (FL) settings where several robots, deployed in parallel, can learn independently while also sharing their learning with each other. This collaborative learning in real-world…

The field development optimization (FDO) problem represents a challenging mixed-integer nonlinear programming (MINLP) problem in which we seek to obtain the number of wells, their type, location, and drilling sequence that maximizes an…

Signal Processing · Electrical Eng. & Systems 2022-07-22 Yusuf Nasir

Federated learning (FL) enables distributed model training from local data collected by users. In distributed systems with constrained resources and potentially high dynamics, e.g., mobile edge networks, the efficiency of FL is an important…

Machine Learning · Computer Science 2022-12-19 Shiqiang Wang , Jake Perazzone , Mingyue Ji , Kevin S. Chan

Recently, a large number of data sources opened up by informatization intensify the data heterogeneity, the faster speed of data generation and the gradual implementation of data regulations limit the storage time of data. In personalized…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-03 Sixing Tan , Xianmin Liu

This paper introduces an information-theoretic constraint on learned policy complexity in the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithm. Previous research with a related approach in continuous…

Artificial Intelligence · Computer Science 2025-05-16 Tailia Malloy , Tim Klinger , Miao Liu , Matthew Riemer , Gerald Tesauro , Chris R. Sims

Meta reinforcement learning (RL) allows agents to leverage experience across a distribution of tasks on which the agent can train at will, enabling faster learning of optimal policies on new test tasks. Despite its success in improving…

Machine Learning · Computer Science 2026-05-27 Tingting Ni , Maryam Kamgarpour

Federated Learning (FL) is a distributed machine learning paradigm that achieves a globally robust model through decentralized computation and periodic model synthesis, primarily focusing on the global model's accuracy over aggregated…

Machine Learning · Computer Science 2024-11-27 Han Liang , Ziwei Zhan , Weijie Liu , Xiaoxi Zhang , Chee Wei Tan , Xu Chen

This paper considers the problem of learning safe policies in the context of reinforcement learning (RL). In particular, we consider the notion of probabilistic safety. This is, we aim to design policies that maintain the state of the…

Machine Learning · Computer Science 2023-04-20 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain

In the context of Federated Reinforcement Learning (FRL), applying Proximal Policy Optimization (PPO) faces challenges related to the update order of its actor and critic due to the aggregation step occurring between successive iterations.…

Machine Learning · Computer Science 2025-06-03 Zhijie Xie , Shenghui Song

In many real-world applications, safety constraints for reinforcement learning (RL) algorithms are either unknown or not explicitly defined. We propose a framework that concurrently learns safety constraints and optimal RL policies in such…

Systems and Control · Electrical Eng. & Systems 2023-05-02 Lunet Yifru , Ali Baheri

Data heterogeneity across clients in federated learning (FL) settings is a widely acknowledged challenge. In response, personalized federated learning (PFL) emerged as a framework to curate local models for clients' tasks. In PFL, a common…

Machine Learning · Computer Science 2023-12-27 Yutong Dai , Zeyuan Chen , Junnan Li , Shelby Heinecke , Lichao Sun , Ran Xu

The explosive growth of dynamic and heterogeneous data traffic brings great challenges for 5G and beyond mobile networks. To enhance the network capacity and reliability, we propose a learning-based dynamic time-frequency division duplexing…

Machine Learning · Computer Science 2023-03-22 Ziyan Yin , Zhe Wang , Jun Li , Ming Ding , Wen Chen , Shi Jin

The recent remarkable progress of deep reinforcement learning (DRL) stands on regularization of policy for stable and efficient learning. A popular method, named proximal policy optimization (PPO), has been introduced for this purpose. PPO…

Machine Learning · Computer Science 2023-07-04 Taisuke Kobayashi

Federated Learning (FL) has shown great potential as a privacy-preserving solution to learning from decentralized data that are only accessible to end devices (i.e., clients). In many scenarios, however, a large proportion of the clients…

Machine Learning · Computer Science 2022-01-31 Wentai Wu , Ligang He , Weiwei Lin , Carsten Maple

Reinforcement learning (RL) is a promising approach for deriving control policies for complex systems. As we show in two control problems, the derived policies from using the Proximal Policy Optimization (PPO) and Deep Q-Network (DQN)…

Machine Learning · Computer Science 2022-04-05 Jan de Priester , Ricardo G. Sanfelice , Nathan van de Wouw

Federated learning allows clients to collaboratively learn statistical models while keeping their data local. Federated learning was originally used to train a unique global model to be served to all clients, but this approach might be…

Machine Learning · Computer Science 2022-06-20 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

Federated learning (FL) has attracted increasing attention in recent years. As a privacy-preserving collaborative learning paradigm, it enables a broader range of applications, especially for computer vision and natural language processing…

Machine Learning · Computer Science 2020-11-24 Yilun Lin , Chaochao Chen , Cen Chen , Li Wang

As the operations of autonomous systems generally affect simultaneously several users, it is crucial that their designs account for fairness considerations. In contrast to standard (deep) reinforcement learning (RL), we investigate the…

Artificial Intelligence · Computer Science 2020-08-19 Umer Siddique , Paul Weng , Matthieu Zimmer

Federated Learning (FL) has gained significant attention in distributed machine learning by enabling collaborative model training across decentralized system while preserving data privacy. Although extensive research has addressed…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-05 Ahmad Dabaja , Rachid El-Azouzi

Federated Learning (FL) is an emerging framework for distributed processing of large data volumes by edge devices subject to limited communication bandwidths, heterogeneity in data distributions and computational resources, as well as…

Machine Learning · Computer Science 2022-04-11 Yonghai Gong , Yichuan Li , Nikolaos M. Freris