中文
相关论文

相关论文: Federated Reinforcement Learning with Constraint H…

200 篇论文

Federated Learning (FL) in Deep Learning (DL)-automated medical image segmentation helps preserving privacy by enabling collaborative model training without sharing patient data. However, FL faces challenges with data heterogeneity among…

图像与视频处理 · 电气工程与系统科学 2024-08-22 Philip Schutte , Valentina Corbetta , Regina Beets-Tan , Wilson Silva

The growing literature of Federated Learning (FL) has recently inspired Federated Reinforcement Learning (FRL) to encourage multiple agents to federatively build a better decision-making policy without sharing raw trajectories. Despite its…

机器学习 · 计算机科学 2022-11-04 Flint Xiaofeng Fan , Yining Ma , Zhongxiang Dai , Wei Jing , Cheston Tan , Bryan Kian Hsiang Low

Federated learning (FL), as a collaborative distributed training paradigm with several edge computing devices under the coordination of a centralized server, is plagued by inconsistent local stationary points due to the heterogeneity of the…

系统与控制 · 电气工程与系统科学 2023-02-14 Yixing Liu , Yan Sun , Zhengtao Ding , Li Shen , Bo Liu , Dacheng Tao

In deep reinforcement learning, building policies of high-quality is challenging when the feature space of states is small and the training data is limited. Despite the success of previous transfer learning approaches in deep reinforcement…

机器学习 · 计算机科学 2020-02-11 Hankz Hankui Zhuo , Wenfeng Feng , Yufeng Lin , Qian Xu , Qiang Yang

We study the setting of \emph{performative reinforcement learning} where the deployed policy affects both the reward, and the transition of the underlying Markov decision process. Prior work~\parencite{MTR23} has addressed this problem…

机器学习 · 计算机科学 2025-03-18 Debmalya Mandal , Goran Radanovic

Federated Learning (FL) can be coordinated under the orchestration of a central server to collaboratively build a privacy-preserving model without the need for data exchange. However, participant data heterogeneity leads to local optima…

机器学习 · 计算机科学 2024-08-30 Boyuan Li , Zihao Peng , Yafei Li , Mingliang Xu , Shengbo Chen , Baofeng Ji , Cong Shen

Federated learning has attracted significant attention as a privacy-preserving framework for training personalised models on multi-source heterogeneous data. However, most existing approaches are unable to handle scenarios where subgroup…

统计方法学 · 统计学 2025-10-14 Changxin Yang , Zhongyi Zhu , Heng Lian

Personalized Federated Learning (PFL) enables a collection of agents to collaboratively learn individual models without sharing raw data. We propose a new PFL approach in which each agent optimizes a weighted combination of all agents'…

机器学习 · 计算机科学 2026-03-04 Jean-Baptiste Fermanian , Batiste Le Bars , Aurélien Bellet

Existing studies on constrained reinforcement learning (RL) may obtain a well-performing policy in the training environment. However, when deployed in a real environment, it may easily violate constraints that were originally satisfied…

机器学习 · 计算机科学 2024-05-06 Zhongchang Sun , Sihong He , Fei Miao , Shaofeng Zou

The development of Policy Iteration (PI) has inspired many recent algorithms for Reinforcement Learning (RL), including several policy gradient methods that gained both theoretical soundness and empirical success on a variety of tasks. The…

机器学习 · 计算机科学 2025-06-03 Zhijie Xie , Shenghui Song

Federated learning enables a population of clients to collaboratively train machine learning models without exchanging their raw data, but standard algorithms such as FedAvg suffer from slow convergence and high communication and memory…

机器学习 · 计算机科学 2026-04-30 Yutong He , Zhengyang Huang , Jiahe Geng

The nuclear fuel loading pattern optimization problem belongs to the class of large-scale combinatorial optimization. It is also characterized by multiple objectives and constraints, which makes it impossible to solve explicitly. Stochastic…

机器学习 · 计算机科学 2023-07-18 Paul Seurin , Koroush Shirvan

There is an increasing interest in a fast-growing machine learning technique called Federated Learning, in which the model training is distributed over mobile user equipments (UEs), exploiting UEs' local computation and training data.…

Federated learning (FL) is an effective and widely used approach to training deep learning models on decentralized datasets held by distinct clients. FL also strengthens both security and privacy protections for training data. Common…

机器学习 · 计算机科学 2025-10-27 Sana Ayromlou , Fatemeh Tavakoli , D. B. Emerson

Reinforcement learning algorithms, just like any other Machine learning algorithm pose a serious threat from adversaries. The adversaries can manipulate the learning algorithm resulting in non-optimal policies. In this paper, we analyze the…

机器学习 · 计算机科学 2021-03-12 Aqeel Anwar , Arijit Raychowdhury

We consider the problem of federated offline reinforcement learning (RL), a scenario under which distributed learning agents must collaboratively learn a high-quality control policy only using small pre-collected datasets generated…

机器学习 · 计算机科学 2024-10-07 Desik Rengarajan , Nitin Ragothaman , Dileep Kalathil , Srinivas Shakkottai

Although reinforcement learning (RL) can provide reliable solutions in many settings, practitioners are often wary of the discrepancies between the RL solution and their status quo procedures. Therefore, they may be reluctant to adapt to…

机器学习 · 计算机科学 2019-06-03 Mohammadreza Nazari , Majid Jahani , Lawrence V. Snyder , Martin Takáč

In this study, we delve into Federated Reinforcement Learning (FedRL) in the context of value-based agents operating across diverse Markov Decision Processes (MDPs). Existing FedRL methods typically aggregate agents' learning by averaging…

机器学习 · 计算机科学 2024-04-18 Hei Yi Mak , Flint Xiaofeng Fan , Luca A. Lanzendörfer , Cheston Tan , Wei Tsang Ooi , Roger Wattenhofer

Federated learning (FL) is a privacy-preserving paradigm for collaboratively training a global model from decentralized clients. However, the performance of FL is hindered by non-independent and identically distributed (non-IID) data and…

机器学习 · 计算机科学 2024-03-08 Xinyu Zhang , Weiyu Sun , Ying Chen

We propose a novel algorithm for solving the composite Federated Learning (FL) problem. This algorithm manages non-smooth regularization by strategically decoupling the proximal operator and communication, and addresses client drift without…

机器学习 · 计算机科学 2023-09-06 Jiaojiao Zhang , Jiang Hu , Mikael Johansson