中文
相关论文

相关论文: Federated Reinforcement Learning in Heterogeneous …

200 篇论文

Federated Reinforcement Learning (FRL) allows multiple agents to collaboratively build a decision making policy without sharing raw trajectories. However, if a small fraction of these agents are adversarial, it can lead to catastrophic…

机器学习 · 计算机科学 2024-11-06 Swetha Ganesh , Jiayu Chen , Gugan Thoppe , Vaneet Aggarwal

Federated Learning (FL) confronts a significant challenge known as data heterogeneity, which impairs model performance and convergence. Existing methods have made notable progress in addressing this issue. However, improving performance in…

机器学习 · 计算机科学 2025-10-24 Zhiqin Yang , Yonggang Zhang , Chenxin Li , Yiu-ming Cheung , Bo Han , Yixuan Yuan

Federated Learning has recently been utilized to collaboratively fine-tune foundation models across multiple clients. Notably, federated low-rank adaptation LoRA-based fine-tuning methods have recently gained attention, which allows clients…

机器学习 · 计算机科学 2025-06-17 Zikai Zhang , Ping Liu , Jiahao Xu , Rui Hu

Street Scene Semantic Understanding (denoted as TriSU) is a crucial but complex task for world-wide distributed autonomous driving (AD) vehicles (e.g., Tesla). Its inference model faces poor generalization issue due to inter-city…

机器人学 · 计算机科学 2024-07-02 Wei-Bin Kou , Qingfeng Lin , Ming Tang , Shuai Wang , Guangxu Zhu , Yik-Chung Wu

Federated Learning (FL) enables collaborative model training across diverse entities while safeguarding data privacy. However, FL faces challenges such as data heterogeneity and model diversity. The Meta-Federated Learning (Meta-FL)…

机器学习 · 计算机科学 2024-06-25 Zahir Alsulaimawi

Federated learning (FL) allows mutually untrusted clients to collaboratively train a common machine learning model without sharing their private/proprietary training data among each other. FL is unfortunately susceptible to poisoning by…

机器学习 · 计算机科学 2022-08-18 Hamid Mozaffari , Virat Shejwalkar , Amir Houmansadr

There is an increasing interest in a fast-growing machine learning technique called Federated Learning, in which the model training is distributed over mobile user equipments (UEs), exploiting UEs' local computation and training data.…

In the field of federated learning, addressing non-independent and identically distributed (non-i.i.d.) data remains a quintessential challenge for improving global model performance. This work introduces the Feature Norm Regularized…

机器学习 · 计算机科学 2023-12-13 Ke Hu , WeiDong Qiu , Peng Tang

Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data…

机器学习 · 计算机科学 2024-05-28 Yuting Ma , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Xiaohua Xu , Meng Wang

We consider the problem of federated offline reinforcement learning (RL), a scenario under which distributed learning agents must collaboratively learn a high-quality control policy only using small pre-collected datasets generated…

机器学习 · 计算机科学 2024-10-07 Desik Rengarajan , Nitin Ragothaman , Dileep Kalathil , Srinivas Shakkottai

The integration of Reinforcement Learning (RL) into robotic-assisted surgery (RAS) holds significant promise for advancing surgical precision, adaptability, and autonomous decision-making. However, the development of robust RL models in…

机器人学 · 计算机科学 2025-10-30 Sana Hafeez , Sundas Rafat Mulkana , Muhammad Ali Imran , Michele Sevegnani

Reinforcement learning-based mapless navigation holds significant potential. However, it faces challenges in indoor environments with local minima area. This paper introduces a safe mapless navigation framework utilizing hierarchical…

机器人学 · 计算机科学 2025-03-18 Jianqi Gao , Xizheng Pang , Qi Liu , Yanjie Li

Model heterogeneous federated learning (MHeteroFL) enables FL clients to collaboratively train models with heterogeneous structures in a distributed fashion. However, existing MHeteroFL methods rely on training loss to transfer knowledge…

机器学习 · 计算机科学 2024-06-04 Liping Yi , Han Yu , Chao Ren , Gang Wang , Xiaoguang Liu , Xiaoxiao Li

Hierarchical reinforcement learning (HRL) improves the efficiency of long-horizon reinforcement-learning tasks with sparse rewards by decomposing the task into a hierarchy of subgoals. The main challenge of HRL is efficient discovery of the…

机器学习 · 计算机科学 2025-07-08 Sadegh Khorasani , Saber Salehkaleybar , Negar Kiyavash , Matthias Grossglauser

Federated reinforcement learning (RL) enables collaborative decision making of multiple distributed agents without sharing local data trajectories. In this work, we consider a multi-task setting, in which each agent has its own private…

机器学习 · 计算机科学 2024-08-19 Tong Yang , Shicong Cen , Yuting Wei , Yuxin Chen , Yuejie Chi

Sub-grid parameterisations in climate models are traditionally static and tuned offline, limiting adaptability to evolving states. This work introduces FedRAIN-Lite, a federated reinforcement learning (FedRL) framework that mirrors the…

机器学习 · 计算机科学 2025-09-25 Pritthijit Nath , Sebastian Schemm , Henry Moss , Peter Haynes , Emily Shuckburgh , Mark Webb

In many real-world applications, safety constraints for reinforcement learning (RL) algorithms are either unknown or not explicitly defined. We propose a framework that concurrently learns safety constraints and optimal RL policies in such…

系统与控制 · 电气工程与系统科学 2023-05-02 Lunet Yifru , Ali Baheri

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

最优化与控制 · 数学 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

In deep reinforcement learning, building policies of high-quality is challenging when the feature space of states is small and the training data is limited. Despite the success of previous transfer learning approaches in deep reinforcement…

机器学习 · 计算机科学 2020-02-11 Hankz Hankui Zhuo , Wenfeng Feng , Yufeng Lin , Qian Xu , Qiang Yang

Federated Learning (FL) has emerged as an essential framework for distributed machine learning, especially with its potential for privacy-preserving data processing. However, existing FL frameworks struggle to address statistical and model…

机器学习 · 计算机科学 2025-04-02 Fucheng Guo , Zeyu Luan , Qing Li , Dan Zhao , Yong Jiang