English
Related papers

Related papers: Personalized Federated Learning with First Order M…

200 papers

Federated Learning (FL) is a distributed machine learning paradigm where data is distributed among clients who collaboratively train a model in a computation process coordinated by a central server. By assigning a weight to each client…

Machine Learning · Computer Science 2021-05-19 Amit Portnoy , Yoav Tirosh , Danny Hendler

Different from conventional federated learning, personalized federated learning (PFL) is able to train a customized model for each individual client according to its unique requirement. The mainstream approach is to adopt a kind of weighted…

Machine Learning · Computer Science 2023-07-18 Jiahao Liu , Jiang Wu , Jinyu Chen , Miao Hu , Yipeng Zhou , Di Wu

Personalization methods in federated learning aim to balance the benefits of federated and local training for data availability, communication cost, and robustness to client heterogeneity. Approaches that require clients to communicate all…

Machine Learning · Computer Science 2022-04-28 Karan Singhal , Hakim Sidahmed , Zachary Garrett , Shanshan Wu , Keith Rush , Sushant Prakash

Federated Learning (FL) has been becoming a popular interdisciplinary research area in both applied mathematics and information sciences. Mathematically, FL aims to collaboratively optimize aggregate objective functions over distributed…

Machine Learning · Computer Science 2024-12-03 Shusen Yang , Fangyuan Zhao , Zihao Zhou , Liang Shi , Xuebin Ren , Zongben Xu

Knowledge sharing and model personalization are two key components in the conceptual framework of personalized federated learning (PFL). Existing PFL methods focus on proposing new model personalization mechanisms while simply implementing…

Machine Learning · Computer Science 2022-05-03 Fengwen Chen , Guodong Long , Zonghan Wu , Tianyi Zhou , Jing Jiang

Standard federated learning approaches suffer when client data distributions have sufficient heterogeneity. Recent methods addressed the client data heterogeneity issue via personalized federated learning (PFL) - a class of FL algorithms…

Machine Learning · Computer Science 2024-04-04 Rishub Tamirisa , Chulin Xie , Wenxuan Bao , Andy Zhou , Ron Arel , Aviv Shamsian

Federated learning (FL) is a recently developed area of machine learning, in which the private data of a large number of distributed clients is used to develop a global model under the coordination of a central server without explicitly…

Machine Learning · Computer Science 2022-07-21 Amit Kumar Kundu , Joseph Jaja

We propose a new optimization formulation for training federated learning models. The standard formulation has the form of an empirical risk minimization problem constructed to find a single global model trained from the private data stored…

Machine Learning · Computer Science 2021-02-15 Filip Hanzely , Peter Richtárik

Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across…

Federated learning enables distributed clients to collaborate on training while storing their data locally to protect client privacy. However, due to the heterogeneity of data, models, and devices, the final global model may need to perform…

Machine Learning · Computer Science 2024-06-25 Wolong Xing , Zhenkui Shi , Hongyan Peng , Xiantao Hu , Xianxian Li

Federated Learning (FL) is a distributed framework for collaborative model training over large-scale distributed data, enabling higher performance while maintaining client data privacy. However, the nature of model aggregation at the…

Machine Learning · Computer Science 2025-06-10 Ali Murad , Bo Hui , Wei-Shinn Ku

Federated Learning (FL) allows collaborative model training among distributed parties without pooling local datasets at a central server. However, the distributed nature of FL poses challenges in training fair federated learning models. The…

Machine Learning · Computer Science 2025-01-28 Yi Zhou , Naman Goel

Building robust deep learning-based models requires diverse training data, ideally from several sources. However, these datasets cannot be combined easily because of patient privacy concerns or regulatory hurdles, especially if medical data…

Image and Video Processing · Electrical Eng. & Systems 2021-07-20 Holger R. Roth , Dong Yang , Wenqi Li , Andriy Myronenko , Wentao Zhu , Ziyue Xu , Xiaosong Wang , Daguang Xu

Autonomous vehicles (AVs) must interact with a diverse set of human drivers in heterogeneous geographic areas. Ideally, fleets of AVs should share trajectory data to continually re-train and improve trajectory forecasting models from…

Machine Learning · Computer Science 2021-12-03 Manabu Nakanoya , Junha Im , Hang Qiu , Sachin Katti , Marco Pavone , Sandeep Chinchali

Real-life deployment of federated Learning (FL) often faces non-IID data, which leads to poor accuracy and slow convergence. Personalized FL (pFL) tackles these issues by tailoring local models to individual data sources and using weighted…

Machine Learning · Computer Science 2025-04-30 Weihang Chen , Cheng Yang , Jie Ren , Zhiqiang Li , Zheng Wang

Federated learning (FL) is a promising technique that enables a large amount of edge computing devices to collaboratively train a global learning model. Due to privacy concerns, the raw data on devices could not be available for centralized…

Machine Learning · Computer Science 2020-11-24 Miao Yang , Akitanoshou Wong , Hongbin Zhu , Haifeng Wang , Hua Qian

The Federated Learning (FL) workflow of training a centralized model with distributed data is growing in popularity. However, until recently, this was the realm of contributing clients with similar computing capability. The fast expanding…

Machine Learning · Computer Science 2022-03-23 Hongrui Shi , Valentin Radu

Federated Learning (FL) aims at unburdening the training of deep models by distributing computation across multiple devices (clients) while safeguarding data privacy. On top of that, Federated Continual Learning (FCL) also accounts for data…

Machine Learning · Computer Science 2025-05-27 Riccardo Salami , Pietro Buzzega , Matteo Mosconi , Mattia Verasani , Simone Calderara

Federated Learning (FL) is emerging as a popular, promising decentralized learning framework that enables collaborative training among clients, with no need to share private data between them or to a centralized server. However, considering…

Machine Learning · Computer Science 2023-10-12 Yue Niu , Saurav Prakash , Souvik Kundu , Sunwoo Lee , Salman Avestimehr

Personalized federated learning aims to address data heterogeneity across local clients in federated learning. However, current methods blindly incorporate either full model parameters or predefined partial parameters in personalized…

Machine Learning · Computer Science 2024-01-17 Kexin Lv , Rui Ye , Xiaolin Huang , Jie Yang , Siheng Chen