English
Related papers

Related papers: Federated Reinforcement Learning in Heterogeneous …

200 papers

Federated Reinforcement Learning (FRL) allows multiple agents to collaboratively build a decision making policy without sharing raw trajectories. However, if a small fraction of these agents are adversarial, it can lead to catastrophic…

Machine Learning · Computer Science 2024-11-06 Swetha Ganesh , Jiayu Chen , Gugan Thoppe , Vaneet Aggarwal

Federated Learning (FL) confronts a significant challenge known as data heterogeneity, which impairs model performance and convergence. Existing methods have made notable progress in addressing this issue. However, improving performance in…

Machine Learning · Computer Science 2025-10-24 Zhiqin Yang , Yonggang Zhang , Chenxin Li , Yiu-ming Cheung , Bo Han , Yixuan Yuan

Federated Learning has recently been utilized to collaboratively fine-tune foundation models across multiple clients. Notably, federated low-rank adaptation LoRA-based fine-tuning methods have recently gained attention, which allows clients…

Machine Learning · Computer Science 2025-06-17 Zikai Zhang , Ping Liu , Jiahao Xu , Rui Hu

Street Scene Semantic Understanding (denoted as TriSU) is a crucial but complex task for world-wide distributed autonomous driving (AD) vehicles (e.g., Tesla). Its inference model faces poor generalization issue due to inter-city…

Robotics · Computer Science 2024-07-02 Wei-Bin Kou , Qingfeng Lin , Ming Tang , Shuai Wang , Guangxu Zhu , Yik-Chung Wu

Federated Learning (FL) enables collaborative model training across diverse entities while safeguarding data privacy. However, FL faces challenges such as data heterogeneity and model diversity. The Meta-Federated Learning (Meta-FL)…

Machine Learning · Computer Science 2024-06-25 Zahir Alsulaimawi

Federated learning (FL) allows mutually untrusted clients to collaboratively train a common machine learning model without sharing their private/proprietary training data among each other. FL is unfortunately susceptible to poisoning by…

Machine Learning · Computer Science 2022-08-18 Hamid Mozaffari , Virat Shejwalkar , Amir Houmansadr

There is an increasing interest in a fast-growing machine learning technique called Federated Learning, in which the model training is distributed over mobile user equipments (UEs), exploiting UEs' local computation and training data.…

Machine Learning · Computer Science 2020-12-23 Canh T. Dinh , Nguyen H. Tran , Minh N. H. Nguyen , Choong Seon Hong , Wei Bao , Albert Y. Zomaya , Vincent Gramoli

In the field of federated learning, addressing non-independent and identically distributed (non-i.i.d.) data remains a quintessential challenge for improving global model performance. This work introduces the Feature Norm Regularized…

Machine Learning · Computer Science 2023-12-13 Ke Hu , WeiDong Qiu , Peng Tang

Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data…

Machine Learning · Computer Science 2024-05-28 Yuting Ma , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Xiaohua Xu , Meng Wang

We consider the problem of federated offline reinforcement learning (RL), a scenario under which distributed learning agents must collaboratively learn a high-quality control policy only using small pre-collected datasets generated…

Machine Learning · Computer Science 2024-10-07 Desik Rengarajan , Nitin Ragothaman , Dileep Kalathil , Srinivas Shakkottai

The integration of Reinforcement Learning (RL) into robotic-assisted surgery (RAS) holds significant promise for advancing surgical precision, adaptability, and autonomous decision-making. However, the development of robust RL models in…

Robotics · Computer Science 2025-10-30 Sana Hafeez , Sundas Rafat Mulkana , Muhammad Ali Imran , Michele Sevegnani

Reinforcement learning-based mapless navigation holds significant potential. However, it faces challenges in indoor environments with local minima area. This paper introduces a safe mapless navigation framework utilizing hierarchical…

Robotics · Computer Science 2025-03-18 Jianqi Gao , Xizheng Pang , Qi Liu , Yanjie Li

Model heterogeneous federated learning (MHeteroFL) enables FL clients to collaboratively train models with heterogeneous structures in a distributed fashion. However, existing MHeteroFL methods rely on training loss to transfer knowledge…

Machine Learning · Computer Science 2024-06-04 Liping Yi , Han Yu , Chao Ren , Gang Wang , Xiaoguang Liu , Xiaoxiao Li

Hierarchical reinforcement learning (HRL) improves the efficiency of long-horizon reinforcement-learning tasks with sparse rewards by decomposing the task into a hierarchy of subgoals. The main challenge of HRL is efficient discovery of the…

Machine Learning · Computer Science 2025-07-08 Sadegh Khorasani , Saber Salehkaleybar , Negar Kiyavash , Matthias Grossglauser

Federated reinforcement learning (RL) enables collaborative decision making of multiple distributed agents without sharing local data trajectories. In this work, we consider a multi-task setting, in which each agent has its own private…

Machine Learning · Computer Science 2024-08-19 Tong Yang , Shicong Cen , Yuting Wei , Yuxin Chen , Yuejie Chi

Sub-grid parameterisations in climate models are traditionally static and tuned offline, limiting adaptability to evolving states. This work introduces FedRAIN-Lite, a federated reinforcement learning (FedRL) framework that mirrors the…

Machine Learning · Computer Science 2025-09-25 Pritthijit Nath , Sebastian Schemm , Henry Moss , Peter Haynes , Emily Shuckburgh , Mark Webb

In many real-world applications, safety constraints for reinforcement learning (RL) algorithms are either unknown or not explicitly defined. We propose a framework that concurrently learns safety constraints and optimal RL policies in such…

Systems and Control · Electrical Eng. & Systems 2023-05-02 Lunet Yifru , Ali Baheri

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

In deep reinforcement learning, building policies of high-quality is challenging when the feature space of states is small and the training data is limited. Despite the success of previous transfer learning approaches in deep reinforcement…

Machine Learning · Computer Science 2020-02-11 Hankz Hankui Zhuo , Wenfeng Feng , Yufeng Lin , Qian Xu , Qiang Yang

Federated Learning (FL) has emerged as an essential framework for distributed machine learning, especially with its potential for privacy-preserving data processing. However, existing FL frameworks struggle to address statistical and model…

Machine Learning · Computer Science 2025-04-02 Fucheng Guo , Zeyu Luan , Qing Li , Dan Zhao , Yong Jiang