English
Related papers

Related papers: Communication-Efficient Federated Learning With Da…

200 papers

Federated averaging (FedAvg) is the most fundamental algorithm in Federated learning (FL). Previous theoretical results assert that FedAvg convergence and generalization degenerate under heterogeneous clients. However, recent empirical…

Machine Learning · Computer Science 2024-12-16 Dun Zeng , Zenglin Xu , Shiyu Liu , Yu Pan , Qifan Wang , Xiaoying Tang

We consider federated learning (FL), where the training data is distributed across a large number of clients. The standard optimization method in this setting is Federated Averaging (FedAvg), which performs multiple local first-order…

Machine Learning · Computer Science 2021-09-07 Sebastian Bischoff , Stephan Günnemann , Martin Jaggi , Sebastian U. Stich

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

There is an increasing interest in a fast-growing machine learning technique called Federated Learning, in which the model training is distributed over mobile user equipments (UEs), exploiting UEs' local computation and training data.…

Machine Learning · Computer Science 2020-12-23 Canh T. Dinh , Nguyen H. Tran , Minh N. H. Nguyen , Choong Seon Hong , Wei Bao , Albert Y. Zomaya , Vincent Gramoli

Federated learning (FL) is an emerging paradigm that permits a large number of clients with heterogeneous data to coordinate learning of a unified global model without the need to share data amongst each other. A major challenge in…

Machine Learning · Computer Science 2023-11-16 Irene Tenison , Sai Aravind Sreeramadas , Vaikkunth Mugunthan , Edouard Oyallon , Irina Rish , Eugene Belilovsky

By letting local clients perform multiple local updates before communicating with a parameter server, modern federated learning algorithms such as FedAvg tackle the communication bottleneck problem in distributed learning and have found…

Machine Learning · Computer Science 2025-03-21 Jie Liu , Yongqiang Wang

Federated averaging (FedAvg) is a popular federated learning (FL) technique that updates the global model by averaging local models and then transmits the updated global model to devices for their local model update. One main limitation of…

Machine Learning · Computer Science 2021-12-15 Luong Trung Nguyen , Junhan Kim , Byonghyo Shim

Federated learning (FL) is a promising strategy for performing privacy-preserving, distributed learning with a network of clients (i.e., edge devices). However, the data distribution among clients is often non-IID in nature, making…

Machine Learning · Computer Science 2022-04-15 Matias Mendieta , Taojiannan Yang , Pu Wang , Minwoo Lee , Zhengming Ding , Chen Chen

Federated Learning has been recently proposed for distributed model training at the edge. The principle of this approach is to aggregate models learned on distributed clients to obtain a new more general "average" model (FedAvg). The…

Machine Learning · Statistics 2022-07-20 Adnan Ben Mansour , Gaia Carenini , Alexandre Duplessis , David Naccache

Classic Machine Learning techniques require training on data available in a single data lake. However, aggregating data from different owners is not always convenient for different reasons, including security, privacy and secrecy. Data…

Machine Learning · Computer Science 2023-04-03 Bruno Casella , Roberto Esposito , Carlo Cavazzoni , Marco Aldinucci

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye

Federated learning is a new distributed machine learning framework, where a bunch of heterogeneous clients collaboratively train a model without sharing training data. In this work, we consider a practical and ubiquitous issue when…

Machine Learning · Statistics 2023-09-06 Yikai Yan , Chaoyue Niu , Yucheng Ding , Zhenzhe Zheng , Fan Wu , Guihai Chen , Shaojie Tang , Zhihua Wu

As a promising paradigm federated Learning (FL) is widely used in privacy-preserving machine learning, which allows distributed devices to collaboratively train a model while avoiding data transmission among clients. Despite its immense…

Machine Learning · Computer Science 2023-08-29 Jinglong Shen , Xiucheng Wang , Nan Cheng , Longfei Ma , Conghao Zhou , Yuan Zhang

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

Machine Learning · Computer Science 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

Federated Learning (FL) has emerged as a prominent distributed machine learning framework that enables geographically discrete clients to train a global model collaboratively while preserving their privacy-sensitive data. However, due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-15 Shensheng Zheng , Wenhao Yuan , Xuehe Wang , Lingjie Duan

Federated Learning (FL) is a promising decentralized learning framework and has great potentials in privacy preservation and in lowering the computation load at the cloud. Recent work showed that FedAvg and FedProx - the two widely-adopted…

Machine Learning · Statistics 2022-02-16 Lili Su , Jiaming Xu , Pengkun Yang

Federated Learning (FL) facilitates collaborative training of a shared global model without exposing clients' private data. In practical FL systems, clients (e.g., edge servers, smartphones, and wearables) typically have disparate system…

Machine Learning · Computer Science 2025-03-03 Leming Shen , Qiang Yang , Kaiyan Cui , Yuanqing Zheng , Xiao-Yong Wei , Jianwei Liu , Jinsong Han

Personalized federated learning is aimed at allowing numerous clients to train personalized models while participating in collaborative training in a communication-efficient manner without exchanging private data. However, many personalized…

Machine Learning · Computer Science 2022-10-28 Jaehee Jang , Heonseok Ha , Dahuin Jung , Sungroh Yoon

Federated Learning (FL) is a paradigm that aims to support loosely connected clients in learning a global model collaboratively with the help of a centralized server. The most popular FL algorithm is Federated Averaging (FedAvg), which is…

Computer Vision and Pattern Recognition · Computer Science 2021-01-21 Yaoxin Zhuo , Baoxin Li

Federated learning (FL) is a distributed machine learning architecture that leverages a large number of workers to jointly learn a model with decentralized data. FL has received increasing attention in recent years thanks to its data…

Machine Learning · Computer Science 2021-05-05 Haibo Yang , Minghong Fang , Jia Liu