English
Related papers

Related papers: A General Theory for Client Sampling in Federated …

200 papers

Federated Learning (FL) is a distributed learning paradigm to train a global model across multiple devices without collecting local data. In FL, a server typically selects a subset of clients for each training round to optimize resource…

Machine Learning · Computer Science 2024-09-04 Dun Zeng , Zenglin Xu , Yu Pan , Xu Luo , Qifan Wang , Xiaoying Tang

Federated Learning (FL) trains deep models across edge devices without centralizing raw data, preserving user privacy. However, client heterogeneity slows down convergence and limits global model accuracy. Clustered FL (CFL) mitigates this…

Machine Learning · Computer Science 2026-02-10 Minghao Li , Dmitrii Avdiukhin , Rana Shahout , Nikita Ivkin , Vladimir Braverman , Minlan Yu

Federated learning (FL) is an emerging machine learning paradigm involving multiple clients, e.g., mobile phone devices, with an incentive to collaborate in solving a machine learning problem coordinated by a central server. FL was proposed…

Machine Learning · Computer Science 2022-07-04 Samuel Horváth

Clustered Federated Multitask Learning (CFL) was introduced as an efficient scheme to obtain reliable specialized models when data is imbalanced and distributed in a non-i.i.d. (non-independent and identically distributed) fashion amongst…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-20 Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Aiman Erbad

Federated Learning has been recently proposed for distributed model training at the edge. The principle of this approach is to aggregate models learned on distributed clients to obtain a new more general "average" model (FedAvg). The…

Machine Learning · Statistics 2022-07-20 Adnan Ben Mansour , Gaia Carenini , Alexandre Duplessis , David Naccache

Federated learning (FL) is a distributed learning paradigm that allows multiple clients to jointly train a shared model while maintaining data privacy. Despite its great potential for domains with strict data privacy requirements, the…

Machine Learning · Computer Science 2025-09-26 Christoph Düsing , Philipp Cimiano

Federated Learning (FL) is a decentralized machine learning (ML) technique that allows a number of participants to train an ML model collaboratively without having to share their private local datasets with others. When participants are…

Machine Learning · Computer Science 2023-12-19 Youssra Cheriguene , Wael Jaafar , Halim Yanikomeroglu , Chaker Abdelaziz Kerrache

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

Machine Learning · Computer Science 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

While providing machine learning model as a service to process users' inference requests, online applications can periodically upgrade the model utilizing newly collected data. Federated learning (FL) is beneficial for enabling the training…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-22 Pengchao Han , Shiqiang Wang , Yang Jiao , Jianwei Huang

With the arising concerns of privacy within machine learning, federated learning (FL) was invented in 2017, in which the clients, such as mobile devices, train a model and send the update to the centralized server. Choosing clients randomly…

Machine Learning · Computer Science 2023-06-09 Carl Smestad , Jingyue Li

Federated learning (FL) is increasingly adopted in domains like healthcare, where data privacy is paramount. A fundamental challenge in these systems is statistical heterogeneity-the fact that data distributions vary significantly across…

Machine Learning · Computer Science 2026-02-12 Zijian Wang , Xiaofei Zhang , Xin Zhang , Yukun Liu , Qiong Zhang

In this paper, we investigate the effect of data heterogeneity across clients on the performance of distributed learning systems, i.e., one-round Federated Learning, as measured by the associated generalization error. Specifically, $K$…

Machine Learning · Computer Science 2025-05-21 Masoud Kavian , Romain Chor , Milad Sefidgaran , Abdellatif Zaidi

Federated Learning (FL) aims to foster collaboration among a population of clients to improve the accuracy of machine learning without directly sharing local data. Although there has been rich literature on designing federated learning…

Machine Learning · Computer Science 2023-02-20 Shengyuan Hu , Dung Daniel Ngo , Shuran Zheng , Virginia Smith , Zhiwei Steven Wu

As a distributed machine learning technique, federated learning (FL) requires clients to collaboratively train a shared model with an edge server without leaking their local data. However, the heterogeneous data distribution among clients…

Machine Learning · Computer Science 2023-07-21 Yu Qiao , Huy Q. Le , Choong Seon Hong

Federated learning (FL) is a distributed learning technique that trains a shared model over distributed data in a privacy-preserving manner. Unfortunately, FL's performance degrades when there is (i) variability in client characteristics in…

Machine Learning · Computer Science 2021-10-28 Muhammad Tahir Munir , Muhammad Mustansar Saeed , Mahad Ali , Zafar Ayyub Qazi , Ihsan Ayyub Qazi

Although common in real-world applications, heterogeneous client label sets are rarely investigated in federated learning (FL). Furthermore, in the cases they are, clients are assumed to be willing to share their entire label sets with…

Machine Learning · Computer Science 2025-08-27 Adam Breitholtz , Edvin Listo Zec , Fredrik D. Johansson

Federated learning (FL) aims at optimizing a shared global model over multiple edge devices without transmitting (private) data to the central server. While it is theoretically well-known that FL yields an optimal model -- centrally trained…

Machine Learning · Computer Science 2022-11-01 Youngjoon Lee , Sangwoo Park , Joonhyuk Kang

Federated Learning (FL) is a learning paradigm that protects privacy by keeping client data on edge devices. However, optimizing FL in practice can be difficult due to the diversity and heterogeneity of the learning system. Despite recent…

Machine Learning · Computer Science 2023-02-21 Yongxin Guo , Tao Lin , Xiaoying Tang

Due to the high cost of communication, federated learning (FL) systems need to sample a subset of clients that are involved in each round of training. As a result, client sampling plays an important role in FL systems as it affects the…

Machine Learning · Computer Science 2025-01-31 Boxin Zhao , Lingxiao Wang , Ziqi Liu , Zhiqiang Zhang , Jun Zhou , Chaochao Chen , Mladen Kolar

Federated Learning (FL) typically aggregates client model parameters using a weighting approach determined by sample proportions. However, this naive weighting method may lead to unfairness and degradation in model performance due to…

Machine Learning · Computer Science 2023-11-13 Mingwei Xu , Xiaofeng Cao , Ivor W. Tsang , James T. Kwok