English
Related papers

Related papers: FedExP: Speeding Up Federated Averaging via Extrap…

200 papers

Federated Learning (FL) is a distributed learning paradigm that scales on-device learning collaboratively and privately. Standard FL algorithms such as FedAvg are primarily geared towards smooth unconstrained settings. In this paper, we…

Machine Learning · Computer Science 2021-06-08 Honglin Yuan , Manzil Zaheer , Sashank Reddi

Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distributions, limiting its effectiveness in real-world deployments.…

Machine Learning · Computer Science 2025-04-22 Kun Zhai , Yifeng Gao , Difan Zou , Guangnan Ye , Siheng Chen , Xingjun Ma , Yu-Gang Jiang

In this paper, we present a novel analysis of \FedAvg with constant step size, relying on the Markov property of the underlying process. We demonstrate that the global iterates of the algorithm converge to a stationary distribution and…

Machine Learning · Statistics 2025-12-22 Paul Mangold , Alain Durmus , Aymeric Dieuleveut , Sergey Samsonov , Eric Moulines

Federated learning (FL) is an emerging paradigm to train model with distributed data from numerous Internet of Things (IoT) devices. It inherently assumes a uniform capacity among participants. However, due to different conditions such as…

Machine Learning · Computer Science 2023-07-04 Hao Zhang , Tingting Wu , Siyao Cheng , Jie Liu

Federated learning has attracted increasing attention with the emergence of distributed data. While extensive federated learning algorithms have been proposed for the non-convex distributed problem, federated learning in practice still…

Machine Learning · Computer Science 2023-03-10 Xidong Wu , Feihu Huang , Zhengmian Hu , Heng Huang

Federated Learning (FL) is an emerging framework for distributed processing of large data volumes by edge devices subject to limited communication bandwidths, heterogeneity in data distributions and computational resources, as well as…

Machine Learning · Computer Science 2022-04-11 Yonghai Gong , Yichuan Li , Nikolaos M. Freris

Virtually all federated learning (FL) methods, including FedAvg, operate in the following manner: i) an orchestrating server sends the current model parameters to a cohort of clients selected via certain rule, ii) these clients then…

Machine Learning · Computer Science 2024-06-04 Kai Yi , Timur Kharisov , Igor Sokolov , Peter Richtárik

Providing privacy protection has been one of the primary motivations of Federated Learning (FL). Recently, there has been a line of work on incorporating the formal privacy notion of differential privacy with FL. To guarantee the…

Machine Learning · Computer Science 2021-06-28 Xinwei Zhang , Xiangyi Chen , Mingyi Hong , Zhiwei Steven Wu , Jinfeng Yi

To improve the efficiency of reinforcement learning (RL), we propose a novel asynchronous federated reinforcement learning (FedRL) framework termed AFedPG, which constructs a global model through collaboration among $N$ agents using policy…

Machine Learning · Computer Science 2025-01-27 Guangchen Lan , Dong-Jun Han , Abolfazl Hashemi , Vaneet Aggarwal , Christopher G. Brinton

Recent demands on data privacy have called for federated learning (FL) as a new distributed learning paradigm in massive and heterogeneous networks. Although many FL algorithms have been proposed, few of them have considered the matrix…

Machine Learning · Computer Science 2020-11-02 Shuai Wang , Tsung-Hui Chang

Federated Learning (FL) is a novel distributed machine learning which allows thousands of edge devices to train model locally without uploading data concentrically to the server. But since real federated settings are resource-constrained,…

Machine Learning · Computer Science 2024-04-16 Li Li , Moming Duan , Duo Liu , Yu Zhang , Ao Ren , Xianzhang Chen , Yujuan Tan , Chengliang Wang

As a promising privacy-preserving machine learning method, Federated Learning (FL) enables global model training across clients without compromising their confidential local data. However, existing FL methods suffer from the problem of low…

Machine Learning · Computer Science 2022-08-23 Ming Hu , Zhihao Yue , Zhiwei Ling , Xian Wei , Mingsong Chen

Federated learning (FL) is a promising framework for learning from distributed data while maintaining privacy. The development of efficient FL algorithms encounters various challenges, including heterogeneous data and systems, limited…

Machine Learning · Computer Science 2024-08-01 Yongcun Song , Ziqi Wang , Enrique Zuazua

Typical machine learning approaches require centralized data for model training, which may not be possible where restrictions on data sharing are in place due to, for instance, privacy and gradient protection. The recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Hanchi Ren , Jingjing Deng , Xianghua Xie , Xiaoke Ma , Yichuan Wang

Federated Learning (FL) commonly relies on a central server to coordinate training across distributed clients. While effective, this paradigm suffers from significant communication overhead, impacting overall training efficiency. To…

Machine Learning · Computer Science 2026-02-12 Jungwon Seo , Minhoe Kim , Chunming Rong

Current data compression methods, such as sparsification in Federated Averaging (FedAvg), effectively enhance the communication efficiency of Federated Learning (FL). However, these methods encounter challenges such as the straggler problem…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-28 Zichen Tang , Junlin Huang , Rudan Yan , Yuxin Wang , Zhenheng Tang , Shaohuai Shi , Amelie Chi Zhou , Xiaowen Chu

Federated learning (FL) has emerged as a communication-efficient algorithmic framework for distributed learning across multiple agents. While standard FL formulations capture unconstrained or globally constrained problems, many practical…

Machine Learning · Computer Science 2026-03-23 Mohammadjavad Ebrahimi , Daniel Burbano , Farzad Yousefian

Composite federated learning offers a general framework for solving machine learning problems with additional regularization terms. However, existing methods often face significant limitations: many require clients to perform…

Machine Learning · Computer Science 2025-12-12 Yuan Zhou , Jiachen Zhong , Xinli Shi , Guanghui Wen , Xinghuo Yu

Graph federated recommendation systems offer a privacy-preserving alternative to traditional centralized recommendation architectures, which often raise concerns about data security. While federated learning enables personalized…

Machine Learning · Computer Science 2025-07-03 Aymen Rayane Khouas , Mohamed Reda Bouadjenek , Hakim Hacid , Sunil Aryal

Federated Learning (FL) allows distributed model training without sharing raw data, but suffers when client participation is partial. In practice, the distribution of available users (\emph{availability distribution} $q$) rarely aligns with…

Machine Learning · Computer Science 2025-09-19 Herlock , Rahimi , Dionysis Kalogerias