English
Related papers

Related papers: FedControl: When Control Theory Meets Federated Le…

200 papers

Traditional federated learning (FL) methods often rely on fixed weighting for parameter aggregation, neglecting the mutual influence by others. Hence, their effectiveness in heterogeneous data contexts is limited. To address this problem,…

Machine Learning · Computer Science 2024-10-07 Yue Tan , Guodong Long , Jing Jiang , Chengqi Zhang

We consider federated learning (FL), where the training data is distributed across a large number of clients. The standard optimization method in this setting is Federated Averaging (FedAvg), which performs multiple local first-order…

Machine Learning · Computer Science 2021-09-07 Sebastian Bischoff , Stephan Günnemann , Martin Jaggi , Sebastian U. Stich

We address the problem of client participation in federated learning, where traditional methods typically rely on a random selection of a small subset of clients for each training round. In contrast, we propose FedBack, a deterministic…

Machine Learning · Computer Science 2025-05-28 Michael Cummins , Guner Dilsad Er , Michael Muehlebach

Federated Learning enables visual models to be trained on-device, bringing advantages for user privacy (data need never leave the device), but challenges in terms of data diversity and quality. Whilst typical models in the datacenter are…

Machine Learning · Computer Science 2020-07-20 Tzu-Ming Harry Hsu , Hang Qi , Matthew Brown

Federated learning has emerged as an umbrella term for centralized coordination strategies in multi-agent environments. While many federated learning architectures process data in an online manner, and are hence adaptive by nature, most…

Machine Learning · Computer Science 2020-05-06 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

Federated learning harnesses the power of distributed optimization to train a unified machine learning model across separate clients. However, heterogeneous data distributions and computational workloads can lead to inconsistent updates and…

Machine Learning · Computer Science 2024-10-15 Aayushya Agarwal , Gauri Joshi , Larry Pileggi

Federated learning (FL) enables on-device training over distributed networks consisting of a massive amount of modern smart devices, such as smartphones and IoT (Internet of Things) devices. However, the leading optimization algorithm in…

Machine Learning · Computer Science 2019-09-04 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

Federated averaging (FedAvg) is the most fundamental algorithm in Federated learning (FL). Previous theoretical results assert that FedAvg convergence and generalization degenerate under heterogeneous clients. However, recent empirical…

Machine Learning · Computer Science 2024-12-16 Dun Zeng , Zenglin Xu , Shiyu Liu , Yu Pan , Qifan Wang , Xiaoying Tang

Federated learning is a distributed machine learning approach in which a single server and multiple clients collaboratively build machine learning models without sharing datasets on clients. A challenging issue of federated learning is data…

Machine Learning · Computer Science 2022-06-28 Koji Matsuda , Yuya Sasaki , Chuan Xiao , Makoto Onizuka

Federated learning is typically approached as an optimization problem, where the goal is to minimize a global loss function by distributing computation across client devices that possess local data and specify different parts of the global…

Machine Learning · Computer Science 2021-02-02 Maruan Al-Shedivat , Jennifer Gillenwater , Eric Xing , Afshin Rostamizadeh

Personalized federated learning is aimed at allowing numerous clients to train personalized models while participating in collaborative training in a communication-efficient manner without exchanging private data. However, many personalized…

Machine Learning · Computer Science 2022-10-28 Jaehee Jang , Heonseok Ha , Dahuin Jung , Sungroh Yoon

Federated learning is a new learning paradigm that decouples data collection and model training via multi-party computation and model aggregation. As a flexible learning setting, federated learning has the potential to integrate with other…

Machine Learning · Computer Science 2024-05-15 Shaoxiong Ji , Yue Tan , Teemu Saravirta , Zhiqin Yang , Yixin Liu , Lauri Vasankari , Shirui Pan , Guodong Long , Anwar Walid

Federated learning (FL) is a distributed learning protocol in which a server needs to aggregate a set of models learned some independent clients to proceed the learning process. At present, model averaging, known as FedAvg, is one of the…

Machine Learning · Computer Science 2020-08-12 Kenta Nagura , Song Bian , Takashi Sato

Restrictive rules for data sharing in many industries have led to the development of federated learning. Federated learning is a machine-learning technique that allows distributed clients to train models collaboratively without the need to…

Computers and Society · Computer Science 2023-09-07 Joaquin Delgado Fernandez , Martin Brennecke , Tom Barbereau , Alexander Rieger , Gilbert Fridgen

Federated learning (FL) aims to train machine learning models in the decentralized system consisting of an enormous amount of smart edge devices. Federated averaging (FedAvg), the fundamental algorithm in FL settings, proposes on-device…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Tianchi Huang , Rui-Xiao Zhang , Ruiyu Li , Lifeng Sun

Federated learning has received significant attention as a potential solution for distributing machine learning (ML) model training through edge networks. This work addresses an important consideration of federated learning at the network…

Machine Learning · Computer Science 2020-08-24 Frank Po-Chen Lin , Christopher G. Brinton , Nicolò Michelusi

Federated learning is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. Standard federated optimization methods such as…

Federated learning aims to collaboratively train models without accessing their client's local private data. The data may be Non-IID for different clients and thus resulting in poor performance. Recently, personalized federated learning…

Machine Learning · Computer Science 2023-02-16 Dui Wang , Li Shen , Yong Luo , Han Hu , Kehua Su , Yonggang Wen , Dacheng Tao

Federated Learning (FL) enables a group of clients to jointly train a machine learning model with the help of a centralized server. Clients do not need to submit their local data to the server during training, and hence the local training…

Machine Learning · Computer Science 2023-01-10 Liling Zhang , Xinyu Lei , Yichun Shi , Hongyu Huang , Chao Chen

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye