English
Related papers

Related papers: Continuous-Time Analysis of Federated Averaging

200 papers

Federated averaging (FedAvg) is the most fundamental algorithm in Federated learning (FL). Previous theoretical results assert that FedAvg convergence and generalization degenerate under heterogeneous clients. However, recent empirical…

Machine Learning · Computer Science 2024-12-16 Dun Zeng , Zenglin Xu , Shiyu Liu , Yu Pan , Qifan Wang , Xiaoying Tang

The Federated Averaging (FedAvg) algorithm, which consists of alternating between a few local stochastic gradient updates at client nodes, followed by a model averaging update at the server, is perhaps the most commonly used method in…

Machine Learning · Computer Science 2022-05-30 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

Federated learning (FL) enables collaborative model training while preserving each participant's privacy, which is particularly beneficial to the medical field. FedAvg is a standard algorithm that uses fixed weights, often originating from…

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Federated learning (FL) learns a model jointly from a set of participating devices without sharing each other's privately held data. The characteristics of non-i.i.d. data across the network, low device participation, high communication…

Machine Learning · Computer Science 2024-01-02 Zhaonan Qu , Kaixiang Lin , Zhaojian Li , Jiayu Zhou , Zhengyuan Zhou

Federated averaging (FedAvg) is a popular federated learning (FL) technique that updates the global model by averaging local models and then transmits the updated global model to devices for their local model update. One main limitation of…

Machine Learning · Computer Science 2021-12-15 Luong Trung Nguyen , Junhan Kim , Byonghyo Shim

Federated averaging (FedAvg) is a communication efficient algorithm for the distributed training with an enormous number of clients. In FedAvg, clients keep their data locally for privacy protection; a central parameter server is used to…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-26 Tao Sun , Dongsheng Li , Bao Wang

Federated learning (FL) is an emerging paradigm to train model with distributed data from numerous Internet of Things (IoT) devices. It inherently assumes a uniform capacity among participants. However, due to different conditions such as…

Machine Learning · Computer Science 2023-07-04 Hao Zhang , Tingting Wu , Siyao Cheng , Jie Liu

Federated learning (FL) is an emerging distributed training paradigm that aims to learn a common global model without exchanging or transferring the data that are stored locally at different clients. The Federated Averaging (FedAvg)-based…

Machine Learning · Computer Science 2024-02-20 Xiaolu Wang , Zijian Li , Shi Jin , Jun Zhang

Federated learning is a paradigm of distributed machine learning in which multiple clients coordinate with a central server to learn a model, without sharing their own training data. Standard federated optimization methods such as Federated…

Machine Learning · Computer Science 2024-05-15 Sohom Mukherjee , Nicolas Loizou , Sebastian U. Stich

Federated learning (FL) enables decentralized model training without centralizing raw data. However, practical FL deployments often face a key realistic challenge: Clients participate intermittently in server aggregation and with unknown,…

Machine Learning · Computer Science 2025-07-15 Herlock , Rahimi , Dionysis Kalogerias

Federated Learning (FL) has recently emerged as a promising method that employs a distributed learning model structure to overcome data privacy and transmission issues paused by central machine learning models. In FL, datasets collected…

Machine Learning · Computer Science 2021-11-05 Ali Anaissi , Basem Suleiman

Federated Averaging (FedAvg), also known as Local SGD, is one of the most popular algorithms in Federated Learning (FL). Despite its simplicity and popularity, the convergence rate of FedAvg has thus far been undetermined. Even under the…

Machine Learning · Computer Science 2022-02-15 Margalit Glasgow , Honglin Yuan , Tengyu Ma

Federated Learning (FL), a distributed learning paradigm that scales on-device learning collaboratively, has emerged as a promising approach for decentralized AI applications. Local optimization methods such as Federated Averaging (FedAvg)…

Machine Learning · Computer Science 2024-01-25 Honglin Yuan

Federated Learning (FL) has emerged as a crucial distributed training paradigm, enabling discrete devices to collaboratively train a shared model under the coordination of a central server, while leveraging their locally stored private…

Machine Learning · Computer Science 2024-09-02 Wenhao Yuan , Xuehe Wang

Federated Learning has been recently proposed for distributed model training at the edge. The principle of this approach is to aggregate models learned on distributed clients to obtain a new more general "average" model (FedAvg). The…

Machine Learning · Statistics 2022-07-20 Adnan Ben Mansour , Gaia Carenini , Alexandre Duplessis , David Naccache

In Federated Learning (FL) client devices connected over the internet collaboratively train a machine learning model without sharing their private data with a central server or with other clients. The seminal Federated Averaging (FedAvg)…

Machine Learning · Computer Science 2023-05-17 Jed Mills , Jia Hu , Geyong Min

Federated learning is a new distributed machine learning framework, where a bunch of heterogeneous clients collaboratively train a model without sharing training data. In this work, we consider a practical and ubiquitous issue when…

Machine Learning · Statistics 2023-09-06 Yikai Yan , Chaoyue Niu , Yucheng Ding , Zhenzhe Zheng , Fan Wu , Guihai Chen , Shaojie Tang , Zhihua Wu

Federated learning (FL) aims to train machine learning models in the decentralized system consisting of an enormous amount of smart edge devices. Federated averaging (FedAvg), the fundamental algorithm in FL settings, proposes on-device…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Tianchi Huang , Rui-Xiao Zhang , Ruiyu Li , Lifeng Sun

Federated Learning (FL) has become a popular paradigm for learning from distributed data. To effectively utilize data at different devices without moving them to the cloud, algorithms such as the Federated Averaging (FedAvg) have adopted a…

Machine Learning · Computer Science 2021-11-24 Xinwei Zhang , Mingyi Hong , Sairaj Dhople , Wotao Yin , Yang Liu
‹ Prev 1 2 3 10 Next ›