English
Related papers

Related papers: Asynchronous Federated Reinforcement Learning with…

200 papers

Federated Learning (FL) is a promising decentralized learning framework and has great potentials in privacy preservation and in lowering the computation load at the cloud. Recent work showed that FedAvg and FedProx - the two widely-adopted…

Machine Learning · Statistics 2022-02-16 Lili Su , Jiaming Xu , Pengkun Yang

This paper presents a comprehensive survey of Federated Reinforcement Learning (FRL), an emerging and promising field in Reinforcement Learning (RL). Starting with a tutorial of Federated Learning (FL) and RL, we then focus on the…

Machine Learning · Computer Science 2023-05-12 Jiaju Qi , Qihao Zhou , Lei Lei , Kan Zheng

Federated Learning (FL) can be coordinated under the orchestration of a central server to collaboratively build a privacy-preserving model without the need for data exchange. However, participant data heterogeneity leads to local optima…

Machine Learning · Computer Science 2024-08-30 Boyuan Li , Zihao Peng , Yafei Li , Mingliang Xu , Shengbo Chen , Baofeng Ji , Cong Shen

The robustness of federated learning (FL) is vital for the distributed training of an accurate global model that is shared among large number of clients. The collaborative learning framework by typically aggregating model updates is…

Heterogeneity across clients in federated learning (FL) usually hinders the optimization convergence and generalization performance when the aggregation of clients' knowledge occurs in the gradient space. For example, clients may differ in…

Machine Learning · Computer Science 2022-03-08 Yue Tan , Guodong Long , Lu Liu , Tianyi Zhou , Qinghua Lu , Jing Jiang , Chengqi Zhang

In this paper, a new learning algorithm for Federated Learning (FL) is introduced. The proposed scheme is based on a weighted gradient aggregation using two-step optimization to offer a flexible training pipeline. Herein, two different…

Machine Learning · Computer Science 2021-06-15 Dimitrios Dimitriadis , Kenichi Kumatani , Robert Gmyr , Yashesh Gaur , Sefik Emre Eskimez

Federated learning on heterogeneous (non-IID) client data experiences slow convergence due to client drift. To address this challenge, we propose Kuramoto-FedAvg, a federated optimization algorithm that reframes the weight aggregation step…

Machine Learning · Computer Science 2025-05-27 Aggrey Muhebwa , Khotso Selialia , Fatima Anwar , Khalid K. Osman

Many reinforcement learning (RL) algorithms are impractical for training in operational systems or computationally expensive high-fidelity simulations, as they require large amounts of data. Meanwhile, low-fidelity simulators, e.g.,…

Machine Learning · Computer Science 2026-02-13 Xinjie Liu , Cyrus Neary , Kushagra Gupta , Wesley A. Suttle , Christian Ellis , Ufuk Topcu , David Fridovich-Keil

As a promising approach to deal with distributed data, Federated Learning (FL) achieves major advancements in recent years. FL enables collaborative model training by exploiting the raw data dispersed in multiple edge devices. However, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-12 Ji Liu , Juncheng Jia , Tianshi Che , Chao Huo , Jiaxiang Ren , Yang Zhou , Huaiyu Dai , Dejing Dou

This work investigates fault-resilient federated learning when the data samples are non-uniformly distributed across workers, and the number of faulty workers is unknown to the central server. In the presence of adversarially faulty workers…

Machine Learning · Computer Science 2020-08-20 Yanjie Dong , Georgios B. Giannakis , Tianyi Chen , Julian Cheng , Md. Jahangir Hossain , Victor C. M. Leung

Federated Learning (FL) enables collaborative model training across distributed clients while preserving data privacy, yet faces challenges in non-independent and identically distributed (non-IID) settings due to client drift, which impairs…

Machine Learning · Computer Science 2026-02-12 Mohammad Partohaghighi , Roummel Marcia , Bruce J. West , YangQuan Chen

Federated learning (FL) is a distributed learning protocol in which a server needs to aggregate a set of models learned some independent clients to proceed the learning process. At present, model averaging, known as FedAvg, is one of the…

Machine Learning · Computer Science 2020-08-12 Kenta Nagura , Song Bian , Takashi Sato

Federated Learning (FL) is an emerging paradigm that enables intelligent agents to collaboratively train Machine Learning (ML) models in a distributed manner, eliminating the need for sharing their local data. The recent work…

Machine Learning · Computer Science 2024-12-13 Konstantin Burlachenko , Peter Richtárik

Federated learning often suffers from slow and unstable convergence due to the heterogeneous characteristics of participating client datasets. Such a tendency is aggravated when the client participation ratio is low since the information…

Machine Learning · Computer Science 2024-04-02 Geeho Kim , Jinkyu Kim , Bohyung Han

Extended reality technologies are transforming fields such as healthcare, entertainment, and education, with Smart Eye-Wears (SEWs) and Artificial Intelligence (AI) playing a crucial role. However, SEWs face inherent limitations in…

Artificial Intelligence · Computer Science 2025-08-26 Hamta Sedghani , Abednego Wamuhindo Kambale , Federica Filippini , Francesca Palermo , Diana Trojaniello , Danilo Ardagna

Federated learning is a recent development in the machine learning area that allows a system of devices to train on one or more tasks without sharing their data to a single location or device. However, this framework still requires a…

Machine Learning · Computer Science 2024-01-11 Guangyao Zheng , Michael A. Jacobs , Vladimir Braverman , Vishwa S. Parekh

Federated Learning (FL) enables collaborative model training across distributed devices while preserving data privacy. Nonetheless, the heterogeneity of edge devices often leads to inconsistent performance of the globally trained models,…

Machine Learning · Computer Science 2025-05-13 Lin Wang , Zhichao Wang , Ye Shi , Sai Praneeth Karimireddy , Xiaoying Tang

Federated Learning (FL) enables multiple devices to collaboratively train a shared model while ensuring data privacy. The selection of participating devices in each training round critically affects both the model performance and training…

Machine Learning · Computer Science 2024-05-08 Chunlin Tian , Zhan Shi , Xinpeng Qin , Li Li , Chengzhong Xu

Reinforcement learning (RL) has achieved remarkable success in a wide range of control and decision-making tasks. However, RL agents often exhibit unstable or degraded performance when deployed in environments subject to unexpected external…

Machine Learning · Computer Science 2026-03-13 Taeho Lee , Donghwan Lee

Federated Learning (FL) is a novel distributed machine learning which allows thousands of edge devices to train model locally without uploading data concentrically to the server. But since real federated settings are resource-constrained,…

Machine Learning · Computer Science 2024-04-16 Li Li , Moming Duan , Duo Liu , Yu Zhang , Ao Ren , Xianzhang Chen , Yujuan Tan , Chengliang Wang