English
Related papers

Related papers: Adaptive Federated Learning via Dynamical System M…

200 papers

Federated Learning is a distributed learning paradigm with two key challenges that differentiate it from traditional distributed optimization: (1) significant variability in terms of the systems characteristics on each device in the network…

Machine Learning · Computer Science 2020-04-23 Tian Li , Anit Kumar Sahu , Manzil Zaheer , Maziar Sanjabi , Ameet Talwalkar , Virginia Smith

Federated Learning has become an important learning paradigm due to its privacy and computational benefits. As the field advances, two key challenges that still remain to be addressed are: (1) system heterogeneity - variability in the…

Machine Learning · Computer Science 2022-06-02 Disha Makhija , Nhat Ho , Joydeep Ghosh

One of the biggest challenges in Federated Learning (FL) is that client devices often have drastically different computation and communication resources for local updates. To this end, recent research efforts have focused on training…

Machine Learning · Computer Science 2022-02-10 Hanhan Zhou , Tian Lan , Guru Venkataramani , Wenbo Ding

This paper focuses on addressing the practical yet challenging problem of model heterogeneity in federated learning, where clients possess models with different network structures. To track this problem, we propose a novel framework called…

Machine Learning · Computer Science 2023-10-30 Jiaqi Wang , Xingyi Yang , Suhan Cui , Liwei Che , Lingjuan Lyu , Dongkuan Xu , Fenglong Ma

Recently, federated learning has emerged as a promising approach for training a global model using data from multiple organizations without leaking their raw data. Nevertheless, directly applying federated learning to real-world tasks faces…

Machine Learning · Computer Science 2022-04-19 Bingzhe Wu , Zhipeng Liang , Yuxuan Han , Yatao Bian , Peilin Zhao , Junzhou Huang

Federated Learning (FL) is a collaborative machine learning framework that allows multiple users to train models utilizing their local data in a distributed manner. However, considerable statistical heterogeneity in local data across…

Machine Learning · Computer Science 2024-09-10 Qi Le , Enmao Diao , Xinran Wang , Vahid Tarokh , Jie Ding , Ali Anwar

Federated Learning is a collaborative machine learning framework to train a deep learning model without accessing clients' private data. Previous works assume one central parameter server either at the cloud or at the edge. The cloud server…

Networking and Internet Architecture · Computer Science 2019-11-01 Lumin Liu , Jun Zhang , S. H. Song , Khaled B. Letaief

Federated learning allows clients to collaboratively learn statistical models while keeping their data local. Federated learning was originally used to train a unique global model to be served to all clients, but this approach might be…

Machine Learning · Computer Science 2022-06-20 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

Federated learning is an approach to collaboratively training machine learning models for multiple parties that prohibit data sharing. One of the challenges in federated learning is non-IID data between clients, as a single model can not…

Machine Learning · Computer Science 2023-08-08 Peng Lan , Donglai Chen , Chong Xie , Keshu Chen , Jinyuan He , Juntao Zhang , Yonghong Chen , Yan Xu

Federated Learning (FL) requires frequent exchange of model parameters, which leads to long communication delay, especially when the network environments of clients vary greatly. Moreover, the parameter server needs to wait for the slowest…

Machine Learning · Computer Science 2024-04-09 Zhiying Feng , Xu Chen , Qiong Wu , Wen Wu , Xiaoxi Zhang , Qianyi Huang

Tuning hyperparameters is a crucial but arduous part of the machine learning pipeline. Hyperparameter optimization is even more challenging in federated learning, where models are learned over a distributed network of heterogeneous devices;…

Machine Learning · Computer Science 2021-11-05 Mikhail Khodak , Renbo Tu , Tian Li , Liam Li , Maria-Florina Balcan , Virginia Smith , Ameet Talwalkar

Personalized federated learning is aimed at allowing numerous clients to train personalized models while participating in collaborative training in a communication-efficient manner without exchanging private data. However, many personalized…

Machine Learning · Computer Science 2022-10-28 Jaehee Jang , Heonseok Ha , Dahuin Jung , Sungroh Yoon

Federated learning is a distributed machine learning method in which a single server and multiple clients collaboratively build machine learning models without sharing datasets on clients. Numerous methods have been proposed to cope with…

Machine Learning · Computer Science 2021-10-18 Koji Matsuda , Yuya Sasaki , Chuan Xiao , Makoto Onizuka

Federated learning (FL) aims to train machine learning (ML) models across potentially millions of edge client devices. Yet, training and customizing models for FL clients is notoriously challenging due to the heterogeneity of client data,…

Machine Learning · Computer Science 2024-04-29 Yuxuan Zhu , Jiachen Liu , Mosharaf Chowdhury , Fan Lai

Federated learning (FL) is an emerging distributed training paradigm that aims to learn a common global model without exchanging or transferring the data that are stored locally at different clients. The Federated Averaging (FedAvg)-based…

Machine Learning · Computer Science 2024-02-20 Xiaolu Wang , Zijian Li , Shi Jin , Jun Zhang

While federated learning leverages distributed client resources, it faces challenges due to heterogeneous client capabilities. This necessitates allocating models suited to clients' resources and careful parameter aggregation to accommodate…

Machine Learning · Computer Science 2024-10-04 Yujin Shin , Kichang Lee , Sungmin Lee , You Rim Choi , Hyung-Sin Kim , JeongGil Ko

Federated learning allows mobile clients to jointly train a global model without sending their private data to a central server. Extensive works have studied the performance guarantee of the global model, however, it is still unclear how…

Machine Learning · Computer Science 2021-04-14 Yihao Xue , Chaoyue Niu , Zhenzhe Zheng , Shaojie Tang , Chengfei Lv , Fan Wu , Guihai Chen

Federated Learning is a novel framework that allows multiple devices or institutions to train a machine learning model collaboratively while preserving their data private. This decentralized approach is prone to suffer the consequences of…

Machine Learning · Computer Science 2021-11-29 Marcos F. Criado , Fernando E. Casado , Roberto Iglesias , Carlos V. Regueiro , Senén Barro

Federated learning is gaining popularity as a distributed machine learning method that can be used to deploy AI-dependent IoT applications while protecting client data privacy and security. Due to the differences of clients, a single global…

Machine Learning · Computer Science 2022-02-21 Xingjian Cao , Gang Sun , Hongfang Yu , Mohsen Guizani

Federated learning is a distributed optimization paradigm that enables a large number of resource-limited client nodes to cooperatively train a model without data sharing. Several works have analyzed the convergence of federated learning by…

Machine Learning · Computer Science 2020-10-06 Yae Jee Cho , Jianyu Wang , Gauri Joshi