English
Related papers

Related papers: Analysis of Asynchronous Federated Learning: Unrav…

200 papers

Federated learning (FL) is an emerging machine learning paradigm involving multiple clients, e.g., mobile phone devices, with an incentive to collaborate in solving a machine learning problem coordinated by a central server. FL was proposed…

Machine Learning · Computer Science 2022-07-04 Samuel Horváth

Federated learning (FL) is a new machine learning framework which trains a joint model across a large amount of decentralized computing devices. Existing methods, e.g., Federated Averaging (FedAvg), are able to provide an optimization…

Machine Learning · Computer Science 2021-02-15 Xingyu Li , Zhe Qu , Bo Tang , Zhuo Lu

Federated Learning (FL) has emerged as a transformative approach for enabling distributed machine learning while preserving user privacy, yet it faces challenges like communication inefficiencies and reliance on centralized infrastructures,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-29 Sai Puppala , Ismail Hossain , Md Jahangir Alam , Sajedul Talukder , Zahidur Talukder , Syed Bahauddin

Device heterogeneity poses major challenges in Federated Learning (FL), where resource-constrained clients slow down synchronous schemes that wait for all updates before aggregation. Asynchronous FL addresses this by incorporating updates…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-13 Samaneh Mohammadi , Iraklis Symeonidis , Ali Balador , Francesco Flammini

Communication overhead is a known bottleneck in federated learning (FL). To address this, lossy compression is commonly used on the information communicated between the server and clients during training. In horizontal FL, where each client…

Machine Learning · Computer Science 2025-02-25 Pedro Valdeira , João Xavier , Cláudia Soares , Yuejie Chi

Federated Learning (FL) is a decentralized learning method used to train machine learning algorithms. In FL, a global model iteratively collects the parameters of local models without accessing their local data. However, a significant…

Machine Learning · Computer Science 2023-08-29 Mingjie Wang , Jianxiong Guo , Weijia Jia

In cross-device Federated Learning (FL) environments, scaling synchronous FL methods is challenging as stragglers hinder the training process. Moreover, the availability of each client to join the training is highly variable over time due…

Machine Learning · Computer Science 2023-04-17 Tuo Zhang , Lei Gao , Sunwoo Lee , Mi Zhang , Salman Avestimehr

Asynchronous federated learning aims to solve the straggler problem in heterogeneous environments, i.e., clients have small computational capacities that could cause aggregation delay. The principle of asynchronous federated learning is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-05 Xiang Ma , Qun Wang , Haijian Sun , Rose Qingyang Hu , Yi Qian

Federated learning (FL) is an emerging distributed machine learning paradigm that protects privacy and tackles the problem of isolated data islands. At present, there are two main communication strategies of FL: synchronous FL and…

Machine Learning · Computer Science 2024-04-16 Yu Zhang , Moming Duan , Duo Liu , Li Li , Ao Ren , Xianzhang Chen , Yujuan Tan , Chengliang Wang

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with…

Machine Learning · Computer Science 2020-04-07 Muhammad Asad , Ahmed Moustafa , Takayuki Ito , Muhammad Aslam

Synchronous federated learning (FL) scales poorly with the number of clients due to the straggler effect. Algorithms like FedAsync and GeneralizedFedAsync address this limitation by enabling asynchronous communication between clients and…

Machine Learning · Computer Science 2025-10-23 Abdelkrim Alahyane , Céline Comte , Matthieu Jonckheere , Éric Moulines

Federated Learning (FL) revolutionizes collaborative machine learning among Internet of Things (IoT) devices by enabling them to train models collectively while preserving data privacy. FL algorithms fall into two primary categories:…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-12 Liangkun Yu , Xiang Sun , Rana Albelaihi , Chaeeun Park , Sihua Shao

Federated learning (FL) allows multiple clients cooperatively train models without disclosing local data. However, the existing works fail to address all these practical concerns in FL: limited communication resources, dynamic network…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-20 Zhida Jiang , Yang Xu , Hongli Xu , Zhiyuan Wang , Chen Qian

Federated Learning (FL) trains deep models across edge devices without centralizing raw data, preserving user privacy. However, client heterogeneity slows down convergence and limits global model accuracy. Clustered FL (CFL) mitigates this…

Machine Learning · Computer Science 2026-02-10 Minghao Li , Dmitrii Avdiukhin , Rana Shahout , Nikita Ivkin , Vladimir Braverman , Minlan Yu

Federated Learning (FL) enables decentralized model training across multiple clients while optionally preserving data privacy. However, communication efficiency remains a critical bottleneck, particularly for large-scale models. In this…

Machine Learning · Computer Science 2025-11-11 Arnaud Descours , Léonard Deroose , Jan Ramon

Federated Learning (FL) is a decentralized approach for collaborative model training on edge devices. This distributed method of model training offers advantages in privacy, security, regulatory compliance, and cost-efficiency. Our emphasis…

Machine Learning · Computer Science 2024-10-24 Charuka Herath , Xiaolan Liu , Sangarapillai Lambotharan , Yogachandran Rahulamathavan

In federated learning (FL) systems, e.g., wireless networks, the communication cost between the clients and the central server can often be a bottleneck. To reduce the communication cost, the paradigm of communication compression has become…

Machine Learning · Statistics 2022-11-28 Xiaoyun Li , Ping Li

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye

The performance of Federated Learning (FL) hinges on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yuan Wang , Huazhu Fu , Renuga Kanagavelu , Qingsong Wei , Yong Liu , Rick Siow Mong Goh

Asynchronous learning protocols have regained attention lately, especially in the Federated Learning (FL) setup, where slower clients can severely impede the learning process. Herein, we propose \texttt{AsyncDrop}, a novel asynchronous FL…

Machine Learning · Computer Science 2022-10-31 Chen Dun , Mirian Hipolito , Chris Jermaine , Dimitrios Dimitriadis , Anastasios Kyrillidis