English
Related papers

Related papers: Stragglers Can Contribute More: Uncertainty-Aware …

200 papers

Federated learning (FL) is a machine learning paradigm that allows multiple clients to collaboratively train a shared model while keeping their data on-premise. However, the straggler issue, due to slow clients, often hinders the efficiency…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-02 Hongpeng Guo , Haotian Gu , Xiaoyang Wang , Bo Chen , Eun Kyung Lee , Tamar Eilam , Deming Chen , Klara Nahrstedt

Federated Learning (FL) has emerged as a pivotal framework for the development of effective global models (global FL) or personalized models (personalized FL) across clients with heterogeneous, non-iid data distribution. A key challenge in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Seongyoon Kim , Minchan Jeong , Sungnyun Kim , Sungwoo Cho , Sumyeong Ahn , Se-Young Yun

Federated Learning (FL) is an innovative distributed machine learning paradigm that enables neural network training across devices without centralizing data. While this addresses issues of information sharing and data privacy, challenges…

Machine Learning · Computer Science 2024-12-09 Jiayu Liu , Yong Wang , Nianbin Wang , Jing Yang , Xiaohui Tao

Federated Learning (FL) enables collaborative model training without centralizing data. However, real-world deployments must simultaneously address statistical heterogeneity across client data (non-IID), system heterogeneity in device…

Machine Learning · Computer Science 2026-05-21 Chaimaa Medjadji , Sylvain Kubler , Yves Le Traon , Guilain Leduc , Sadi Alawadi , Feras M. Awaysheh

In Asynchronous Federated Learning (AFL), the central server immediately updates the global model with each arriving client's contribution. As a result, clients perform their local training on different model versions, causing information…

Federated learning (FL) is a distributed collaborative learning method, where multiple clients learn together by sharing gradient updates instead of raw data. However, it is well-known that FL is vulnerable to manipulated updates from…

Machine Learning · Computer Science 2025-03-06 Dimitar Chakarov , Nikita Tsoy , Kristian Minchev , Nikola Konstantinov

Federated Learning (FL) allows several clients to cooperatively train machine learning models without disclosing the raw data. In practical applications, asynchronous FL (AFL) can address the straggler effect compared to synchronous FL.…

Machine Learning · Computer Science 2025-03-25 Xiaorui Jiang , Yu Gao , Hengwei Xu , Qi Zhang , Yong Liao , Pengyuan Zhou

Federated Distillation (FD) is a popular novel algorithmic paradigm for Federated Learning, which achieves training performance competitive to prior parameter averaging based methods, while additionally allowing the clients to train…

Machine Learning · Computer Science 2021-02-05 Felix Sattler , Tim Korjakow , Roman Rischke , Wojciech Samek

Federated Learning (FL) suffers from severe performance degradation due to the data heterogeneity among clients. Existing works reveal that the fundamental reason is that data heterogeneity can cause client drift where the local model…

Machine Learning · Computer Science 2025-01-22 Haoran Xu , Jiaze Li , Wanyi Wu , Hao Ren

Federated Learning (FL) is an emerging machine learning paradigm that enables the collaborative training of a shared global model across distributed clients while keeping the data decentralized. Recent works on designing systems for…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-23 Mohak Chadha , Alexander Jensen , Jianfeng Gu , Osama Abboud , Michael Gerndt

Federated learning (FL) has emerged as a transformative training paradigm, particularly invaluable in privacy-sensitive domains like healthcare. However, client heterogeneity in data, computing power, and tasks poses a significant…

Machine Learning · Computer Science 2024-10-01 Huidong Tang , Chen Li , Huachong Yu , Sayaka Kamei , Yasuhiko Morimoto

Federated learning (FL) enables multiple clients to collaboratively train a global machine learning model via a server without sharing their private training data. In traditional FL, the system follows a synchronous approach, where the…

Cryptography and Security · Computer Science 2026-04-07 Anjun Gao , Feng Wang , Zhenglin Wan , Yueyang Quan , Zhuqing Liu , Minghong Fang

Federated learning (FL) enables clients to collaboratively train machine learning models under the coordination of a server in a privacy-preserving manner. One of the main challenges in FL is that the server may not receive local updates…

Machine Learning · Computer Science 2024-07-30 Chutian Jiang , Hansong Zhou , Xiaonan Zhang , Shayok Chakraborty

Federated learning (FL) enables distributed training while preserving data privacy, but stragglers-slow or incapable clients-can significantly slow down the total training time and degrade performance. To mitigate the impact of stragglers,…

Machine Learning · Computer Science 2024-09-11 Honggu Kang , Seohyeon Cha , Jinwoo Shin , Jongmyeong Lee , Joonhyuk Kang

Federated Learning (FL) can be affected by data and device heterogeneities, caused by clients' different local data distributions and latencies in uploading model updates (i.e., staleness). Traditional schemes consider these heterogeneities…

Machine Learning · Computer Science 2024-12-25 Haoming Wang , Wei Gao

Federated learning (FL) is an emerging machine learning (ML) paradigm that enables heterogeneous edge devices to collaboratively train ML models without revealing their raw data to a logically centralized server. However, beyond the…

Machine Learning · Computer Science 2023-10-03 Jiachen Liu , Fan Lai , Yinwei Dai , Aditya Akella , Harsha Madhyastha , Mosharaf Chowdhury

Federated learning (FL) is a privacy-preserving machine learning paradigm in which the server periodically aggregates local model parameters from clients without assembling their private data. Constrained communication and personalization…

Machine Learning · Computer Science 2023-11-10 Zhiyuan Wu , Sheng Sun , Yuwei Wang , Min Liu , Quyang Pan , Junbo Zhang , Zeju Li , Qingxiang Liu

Device heterogeneity poses major challenges in Federated Learning (FL), where resource-constrained clients slow down synchronous schemes that wait for all updates before aggregation. Asynchronous FL addresses this by incorporating updates…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-13 Samaneh Mohammadi , Iraklis Symeonidis , Ali Balador , Francesco Flammini

Federated Learning (FL) is a machine learning setting where many devices collaboratively train a machine learning model while keeping the training data decentralized. In most of the current training schemes the central model is refined by…

Machine Learning · Computer Science 2021-03-30 Tao Lin , Lingjing Kong , Sebastian U. Stich , Martin Jaggi

Asynchronous federated learning aims to solve the straggler problem in heterogeneous environments, i.e., clients have small computational capacities that could cause aggregation delay. The principle of asynchronous federated learning is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-05 Xiang Ma , Qun Wang , Haijian Sun , Rose Qingyang Hu , Yi Qian