English
Related papers

Related papers: Federated Submodel Optimization for Hot and Cold D…

200 papers

Federated averaging (FedAvg) is a popular federated learning (FL) technique that updates the global model by averaging local models and then transmits the updated global model to devices for their local model update. One main limitation of…

Machine Learning · Computer Science 2021-12-15 Luong Trung Nguyen , Junhan Kim , Byonghyo Shim

Federated learning (FL) aims to train machine learning models in the decentralized system consisting of an enormous amount of smart edge devices. Federated averaging (FedAvg), the fundamental algorithm in FL settings, proposes on-device…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Tianchi Huang , Rui-Xiao Zhang , Ruiyu Li , Lifeng Sun

Federated averaging (FedAvg) is a communication efficient algorithm for the distributed training with an enormous number of clients. In FedAvg, clients keep their data locally for privacy protection; a central parameter server is used to…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-26 Tao Sun , Dongsheng Li , Bao Wang

Federated learning has emerged in the last decade as a distributed optimization paradigm due to the rapidly increasing number of portable devices able to support the heavy computational needs related to the training of machine learning…

Machine Learning · Computer Science 2024-10-10 Emanuel Buttaci , Giuseppe Carlo Calafiore

Federated learning enables a large amount of edge computing devices to learn a model without data sharing jointly. As a leading algorithm in this setting, Federated Average FedAvg, which runs Stochastic Gradient Descent (SGD) in parallel on…

Machine Learning · Computer Science 2022-11-04 Xiaoxiao Li , Zhao Song , Runzhou Tao , Guangyi Zhang

Federated learning (FL) allows remote clients to train a global model collaboratively while protecting client privacy. Despite its privacy-preserving benefits, FL has significant drawbacks, including slow convergence, high communication…

Machine Learning · Computer Science 2026-02-18 Mohammad Partohaghighi , Roummel Marcia , YangQuan Chen

Federated averaging (FedAvg) is a popular algorithm for horizontal federated learning (FL), where samples are gathered across different clients and are not shared with each other or a central server. Extensive convergence analysis of FedAvg…

Machine Learning · Computer Science 2025-02-03 Tom Overman , Diego Klabjan

Federated learning allows distributed devices to collectively train a model without sharing or disclosing the local dataset with a central server. The global model is optimized by training and averaging the model parameters of all local…

Machine Learning · Computer Science 2021-03-23 George Pu , Yanlin Zhou , Dapeng Wu , Xiaolin Li

Federated Averaging (FedAvg), also known as Local SGD, is one of the most popular algorithms in Federated Learning (FL). Despite its simplicity and popularity, the convergence rate of FedAvg has thus far been undetermined. Even under the…

Machine Learning · Computer Science 2022-02-15 Margalit Glasgow , Honglin Yuan , Tengyu Ma

Personalized federated learning is aimed at allowing numerous clients to train personalized models while participating in collaborative training in a communication-efficient manner without exchanging private data. However, many personalized…

Machine Learning · Computer Science 2022-10-28 Jaehee Jang , Heonseok Ha , Dahuin Jung , Sungroh Yoon

Federated Learning (FL) offers a collaborative training framework, allowing multiple clients to contribute to a shared model without compromising data privacy. Due to the heterogeneous nature of local datasets, updated client models may…

Machine Learning · Computer Science 2023-11-14 Chia-Hsiang Kao , Yu-Chiang Frank Wang

Federated Learning (FL) has emerged as a prominent distributed machine learning framework that enables geographically discrete clients to train a global model collaboratively while preserving their privacy-sensitive data. However, due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-15 Shensheng Zheng , Wenhao Yuan , Xuehe Wang , Lingjie Duan

As a promising privacy-preserving machine learning method, Federated Learning (FL) enables global model training across clients without compromising their confidential local data. However, existing FL methods suffer from the problem of low…

Machine Learning · Computer Science 2022-08-23 Ming Hu , Zhihao Yue , Zhiwei Ling , Xian Wei , Mingsong Chen

Federated Averaging (FedAvg) has emerged as the algorithm of choice for federated learning due to its simplicity and low communication cost. However, in spite of recent research efforts, its performance is not fully understood. We obtain…

The federated learning paradigm has motivated the development of methods for aggregating multiple client updates into a global server model, without sharing client data. Many federated learning algorithms, including the canonical Federated…

Machine Learning · Computer Science 2024-02-20 Nikita Dhawan , Nicole Mitchell , Zachary Charles , Zachary Garrett , Gintare Karolina Dziugaite

Recent attacks have shown that user data can be recovered from FedSGD updates, thus breaking privacy. However, these attacks are of limited practical relevance as federated learning typically uses the FedAvg algorithm. Compared to FedSGD,…

Machine Learning · Computer Science 2022-11-02 Dimitar I. Dimitrov , Mislav Balunović , Nikola Konstantinov , Martin Vechev

In Federated Learning (FL) client devices connected over the internet collaboratively train a machine learning model without sharing their private data with a central server or with other clients. The seminal Federated Averaging (FedAvg)…

Machine Learning · Computer Science 2023-05-17 Jed Mills , Jia Hu , Geyong Min

Federated learning (FL) learns a model jointly from a set of participating devices without sharing each other's privately held data. The characteristics of non-i.i.d. data across the network, low device participation, high communication…

Machine Learning · Computer Science 2024-01-02 Zhaonan Qu , Kaixiang Lin , Zhaojian Li , Jiayu Zhou , Zhengyuan Zhou

Federated learning is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. Standard federated optimization methods such as…

Federated learning (FL) is a distributed learning protocol in which a server needs to aggregate a set of models learned some independent clients to proceed the learning process. At present, model averaging, known as FedAvg, is one of the…

Machine Learning · Computer Science 2020-08-12 Kenta Nagura , Song Bian , Takashi Sato