English
Related papers

Related papers: FedExP: Speeding Up Federated Averaging via Extrap…

200 papers

Despite achieving remarkable performance, Federated Learning (FL) suffers from two critical challenges, i.e., limited computational resources and low training efficiency. In this paper, we propose a novel FL framework, i.e., FedDUAP, with…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-26 Hong Zhang , Ji Liu , Juncheng Jia , Yang Zhou , Huaiyu Dai , Dejing Dou

Federated Learning (FL) is a distributed machine learning framework to alleviate the data silos, where decentralized clients collaboratively learn a global model without sharing their private data. However, the clients' Non-Independent and…

Machine Learning · Computer Science 2024-09-19 Ping Luo , Jieren Cheng , Zhenhao Liu , N. Xiong , Jie Wu

Federated Learning (FL) is a paradigm that aims to support loosely connected clients in learning a global model collaboratively with the help of a centralized server. The most popular FL algorithm is Federated Averaging (FedAvg), which is…

Computer Vision and Pattern Recognition · Computer Science 2021-01-21 Yaoxin Zhuo , Baoxin Li

A widely recognized difficulty in federated learning arises from the statistical heterogeneity among clients: local datasets often originate from distinct yet not entirely unrelated probability distributions, and personalization is,…

Machine Learning · Statistics 2025-03-12 Shuxiao Chen , Qinqing Zheng , Qi Long , Weijie J. Su

Federated learning (FL) is a prevailing distributed learning paradigm, where a large number of workers jointly learn a model without sharing their training data. However, high communication costs could arise in FL due to large-scale (deep)…

Machine Learning · Computer Science 2021-06-15 Haibo Yang , Jia Liu , Elizabeth S. Bentley

Federated learning (FL) is a widely employed distributed paradigm for collaboratively training machine learning models from multiple clients without sharing local data. In practice, FL encounters challenges in dealing with partial client…

Machine Learning · Computer Science 2024-10-30 Xin Liu , Wei li , Dazhi Zhan , Yu Pan , Xin Ma , Yu Ding , Zhisong Pan

Federated learning (FL) is a distributed machine learning architecture that leverages a large number of workers to jointly learn a model with decentralized data. FL has received increasing attention in recent years thanks to its data…

Machine Learning · Computer Science 2021-05-05 Haibo Yang , Minghong Fang , Jia Liu

Federated learning (FL) is a distributed learning technique that trains a shared model over distributed data in a privacy-preserving manner. Unfortunately, FL's performance degrades when there is (i) variability in client characteristics in…

Machine Learning · Computer Science 2021-10-28 Muhammad Tahir Munir , Muhammad Mustansar Saeed , Mahad Ali , Zafar Ayyub Qazi , Ihsan Ayyub Qazi

We study a hierarchical federated learning (FL) problem, where clients cooperatively seek to select among multiple optimal solutions of a primary distributed learning problem, a solution that minimizes a secondary loss function. This…

Optimization and Control · Mathematics 2026-05-26 Mohammadjavad Ebrahimi , Yuyang Qiu , Shisheng Cui , Farzad Yousefian

Federated learning is highly valued due to its high-performance computing in distributed environments while safeguarding data privacy. To address resource heterogeneity, researchers have proposed a semi-asynchronous federated learning…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-28 Yunbo Li , Jiaping Gui , Yue Wu

Federated learning (FL) has enabled training machine learning models exploiting the data of multiple agents without compromising privacy. However, FL is known to be vulnerable to data heterogeneity, partial device participation, and…

Machine Learning · Computer Science 2023-06-13 Marina Costantini , Giovanni Neglia , Thrasyvoulos Spyropoulos

Federated learning (FL) takes a first step towards privacy-preserving machine learning by training models while keeping client data local. Models trained using FL may still leak private client information through model updates during…

Machine Learning · Computer Science 2023-01-18 Nasser Aldaghri , Hessam Mahdavifar , Ahmad Beirami

Federated learning (FL) enables collaborative model training while preserving each participant's privacy, which is particularly beneficial to the medical field. FedAvg is a standard algorithm that uses fixed weights, often originating from…

Federated learning enables a large amount of edge computing devices to jointly learn a model without data sharing. As a leading algorithm in this setting, Federated Averaging (\texttt{FedAvg}) runs Stochastic Gradient Descent (SGD) in…

Machine Learning · Statistics 2020-06-26 Xiang Li , Kaixuan Huang , Wenhao Yang , Shusen Wang , Zhihua Zhang

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Federated learning (FL), as an emerging distributed machine learning paradigm, allows a mass of edge devices to collaboratively train a global model while preserving privacy. In this tutorial, we focus on FL via over-the-air computation…

Machine Learning · Computer Science 2023-10-17 Jingyang Zhu , Yuanming Shi , Yong Zhou , Chunxiao Jiang , Wei Chen , Khaled B. Letaief

Federated learning is typically approached as an optimization problem, where the goal is to minimize a global loss function by distributing computation across client devices that possess local data and specify different parts of the global…

Machine Learning · Computer Science 2021-02-02 Maruan Al-Shedivat , Jennifer Gillenwater , Eric Xing , Afshin Rostamizadeh

Over the past few years, Federated Learning (FL) has become a popular distributed machine learning paradigm. FL involves a group of clients with decentralized data who collaborate to learn a common model under the coordination of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-21 Jieming Bian , Lei Wang , Kun Yang , Cong Shen , Jie Xu

Federated learning algorithms, such as FedAvg, are negatively affected by data heterogeneity and partial client participation. To mitigate the latter problem, global variance reduction methods, like FedVARP, leverage stale model updates for…

Machine Learning · Computer Science 2024-05-08 Angelo Rodio , Giovanni Neglia

Federated learning (FL) enables decentralized model training without centralizing raw data. However, practical FL deployments often face a key realistic challenge: Clients participate intermittently in server aggregation and with unknown,…

Machine Learning · Computer Science 2025-07-15 Herlock , Rahimi , Dionysis Kalogerias