English
Related papers

Related papers: Federated Submodel Optimization for Hot and Cold D…

200 papers

Current data compression methods, such as sparsification in Federated Averaging (FedAvg), effectively enhance the communication efficiency of Federated Learning (FL). However, these methods encounter challenges such as the straggler problem…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-28 Zichen Tang , Junlin Huang , Rudan Yan , Yuxin Wang , Zhenheng Tang , Shaohuai Shi , Amelie Chi Zhou , Xiaowen Chu

Federated Learning (FL), a distributed learning paradigm that scales on-device learning collaboratively, has emerged as a promising approach for decentralized AI applications. Local optimization methods such as Federated Averaging (FedAvg)…

Machine Learning · Computer Science 2024-01-25 Honglin Yuan

Federated learning (FL) is a distributed learning technique that trains a shared model over distributed data in a privacy-preserving manner. Unfortunately, FL's performance degrades when there is (i) variability in client characteristics in…

Machine Learning · Computer Science 2021-10-28 Muhammad Tahir Munir , Muhammad Mustansar Saeed , Mahad Ali , Zafar Ayyub Qazi , Ihsan Ayyub Qazi

Federated Learning (FL) has recently emerged as a promising method that employs a distributed learning model structure to overcome data privacy and transmission issues paused by central machine learning models. In FL, datasets collected…

Machine Learning · Computer Science 2021-11-05 Ali Anaissi , Basem Suleiman

Federated learning (FL) enables on-device training over distributed networks consisting of a massive amount of modern smart devices, such as smartphones and IoT (Internet of Things) devices. However, the leading optimization algorithm in…

Machine Learning · Computer Science 2019-09-04 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

Federated Learning (FL) is a paradigm that aims to support loosely connected clients in learning a global model collaboratively with the help of a centralized server. The most popular FL algorithm is Federated Averaging (FedAvg), which is…

Computer Vision and Pattern Recognition · Computer Science 2021-01-21 Yaoxin Zhuo , Baoxin Li

The enormous amount of data produced by mobile and IoT devices has motivated the development of federated learning (FL), a framework allowing such devices (or clients) to collaboratively train machine learning models without sharing their…

Machine Learning · Computer Science 2023-01-12 Angelo Rodio , Francescomaria Faticanti , Othmane Marfoq , Giovanni Neglia , Emilio Leonardi

Federated learning (FL) enables decentralized clients to train a model collaboratively without sharing local data. A key distinction between FL and centralized learning is that clients' data are non-independent and identically distributed,…

Machine Learning · Computer Science 2025-08-19 Like Jian , Dong Liu

Petabytes of data are generated each day by emerging Internet of Things (IoT), but only few of them can be finally collected and used for Machine Learning (ML) purposes due to the apprehension of data & privacy leakage, which seriously…

Machine Learning · Computer Science 2021-06-17 Yuhao Zhou , Ye Qing , Jiancheng Lv

Federated learning is typically approached as an optimization problem, where the goal is to minimize a global loss function by distributing computation across client devices that possess local data and specify different parts of the global…

Machine Learning · Computer Science 2021-02-02 Maruan Al-Shedivat , Jennifer Gillenwater , Eric Xing , Afshin Rostamizadeh

While federated learning has shown strong results in optimizing a machine learning model without direct access to the original data, its performance may be hindered by intermittent client availability which slows down the convergence and…

Machine Learning · Computer Science 2022-12-08 Zheng Wang , Xiaoliang Fan , Jianzhong Qi , Haibing Jin , Peizhen Yang , Siqi Shen , Cheng Wang

Federated learning (FL) enables resource-constrained edge nodes to collaboratively learn a global model under the orchestration of a central server while keeping privacy-sensitive data locally. The…

Machine Learning · Computer Science 2021-04-07 Hongda Wu , Ping Wang

In federated optimization, heterogeneity in the clients' local datasets and computation speeds results in large variations in the number of local updates performed by each client in each communication round. Naive weighted aggregation of…

Machine Learning · Computer Science 2020-07-16 Jianyu Wang , Qinghua Liu , Hao Liang , Gauri Joshi , H. Vincent Poor

Federated Learning using the Federated Averaging algorithm has shown great advantages for large-scale applications that rely on collaborative learning, especially when the training data is either unbalanced or inaccessible due to privacy…

Machine Learning · Computer Science 2021-07-21 Jonatan Reyes , Lisa Di Jorio , Cecile Low-Kam , Marta Kersten-Oertel

We consider federated learning (FL), where the training data is distributed across a large number of clients. The standard optimization method in this setting is Federated Averaging (FedAvg), which performs multiple local first-order…

Machine Learning · Computer Science 2021-09-07 Sebastian Bischoff , Stephan Günnemann , Martin Jaggi , Sebastian U. Stich

Federated learning is proposed as an alternative to centralized machine learning since its client-server structure provides better privacy protection and scalability in real-world applications. In many applications, such as smart homes with…

Machine Learning · Computer Science 2022-02-21 Yuchen Zhao , Payam Barnaghi , Hamed Haddadi

We consider a standard federated learning (FL) architecture where a group of clients periodically coordinate with a central server to train a statistical model. We develop a general algorithmic framework called FedLin to tackle some of the…

Machine Learning · Computer Science 2021-09-01 Aritra Mitra , Rayana Jaafar , George J. Pappas , Hamed Hassani

The label distribution skew induced data heterogeniety has been shown to be a significant obstacle that limits the model performance in federated learning, which is particularly developed for collaborative model training over decentralized…

Machine Learning · Computer Science 2023-03-16 Jian Xu , Meiling Yang , Wenbo Ding , Shao-Lun Huang

Federated learning (FL) is a machine learning paradigm where a shared central model is learned across distributed edge devices while the training data remains on these devices. Federated Averaging (FedAvg) is the leading optimization method…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-22 Yujing Chen , Yue Ning , Martin Slawski , Huzefa Rangwala

In federated learning (FL), clients usually have diverse participation statistics that are unknown a priori, which can significantly harm the performance of FL if not handled properly. Existing works aiming at addressing this problem are…

Machine Learning · Computer Science 2024-04-16 Shiqiang Wang , Mingyue Ji