English
Related papers

Related papers: pFedSOP : Accelerating Training Of Personalized Fe…

200 papers

Personalized Federated Learning (PFL) aims to train customized models for clients with highly heterogeneous data distributions while preserving data privacy. Existing approaches often rely on heuristics like clustering or model…

Artificial Intelligence · Computer Science 2026-03-13 Ping Guo , Tiantian Zhang , Xi Lin , Xiang Li , Zhi-Ri Tang , Qingfu Zhang

Large language models (LLMs) have emerged as important components across various fields, yet their training requires substantial computation resources and abundant labeled data. It poses a challenge to robustly training LLMs for individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Jiaxing QI , Zhongzhi Luan , Shaohan Huang , Carol Fung , Hailong Yang , Depei Qian

Federated learning (FL) is a distributed machine learning approach that allows multiple clients to collaboratively train a model without sharing their raw data. To prevent sensitive information from being inferred through the model updates…

Machine Learning · Computer Science 2024-09-23 Zhenxiao Zhang , Yuanxiong Guo , Yanmin Gong

We consider federated learning (FL), where the training data is distributed across a large number of clients. The standard optimization method in this setting is Federated Averaging (FedAvg), which performs multiple local first-order…

Machine Learning · Computer Science 2021-09-07 Sebastian Bischoff , Stephan Günnemann , Martin Jaggi , Sebastian U. Stich

The federated learning (FL) paradigm emerges to preserve data privacy during model training by only exposing clients' model parameters rather than original data. One of the biggest challenges in FL lies in the non-IID (not identical and…

Machine Learning · Computer Science 2023-05-26 Jiahao Tan , Yipeng Zhou , Gang Liu , Jessie Hui Wang , Shui Yu

Lately, Personalized Federated Learning (PFL) has emerged as a prevalent paradigm to deliver personalized models by collaboratively training while simultaneously adapting to each client's local applications. Existing PFL methods typically…

Traditional Federated Learning (FL) methods typically train a single global model collaboratively without exchanging raw data. In contrast, Personalized Federated Learning (PFL) techniques aim to create multiple models that are better…

Machine Learning · Computer Science 2024-04-23 Emilio Cantu-Cervini

Federated Learning (FL) is a distributed machine learning approach that enables model training in communication efficient and privacy-preserving manner. The standard optimization method in FL is Federated Averaging (FedAvg), which performs…

Machine Learning · Computer Science 2023-09-21 Zeyi Tao , Jindi Wu , Qun Li

Federated learning (FL) is a new paradigm that enables many clients to jointly train a machine learning (ML) model under the orchestration of a parameter server while keeping the local data not being exposed to any third party. However, the…

Machine Learning · Computer Science 2022-04-27 Yiwei Li , Shuai Wang , Tsung-Hui Chang , Chong-Yung Chi

Federated learning is a machine learning approach where multiple devices collaboratively learn with the help of a parameter server by sharing only their local updates. While gradient-based optimization techniques are widely adopted in this…

Machine Learning · Computer Science 2024-06-12 Ahmed Elbakary , Chaouki Ben Issaid , Mohammad Shehab , Karim Seddik , Tamer ElBatt , Mehdi Bennis

Federated learning (FL) is a heavily promoted approach for training ML models on sensitive data, e.g., text typed by users on their smartphones. FL is expressly designed for training on data that are unbalanced and non-iid across the…

Machine Learning · Computer Science 2022-03-07 Tao Yu , Eugene Bagdasaryan , Vitaly Shmatikov

Real-life deployment of federated Learning (FL) often faces non-IID data, which leads to poor accuracy and slow convergence. Personalized FL (pFL) tackles these issues by tailoring local models to individual data sources and using weighted…

Machine Learning · Computer Science 2025-04-30 Weihang Chen , Cheng Yang , Jie Ren , Zhiqiang Li , Zheng Wang

Personalized federated learning (FL) facilitates collaborations between multiple clients to learn personalized models without sharing private data. The mechanism mitigates the statistical heterogeneity commonly encountered in the system,…

Machine Learning · Computer Science 2022-09-23 Zichen Ma , Yu Lu , Wenye Li , Shuguang Cui

Federated learning (FL) can help promote data privacy by training a shared model in a de-centralized manner on the physical devices of clients. In the presence of highly heterogeneous distributions of local data, personalized FL strategy…

Machine Learning · Statistics 2022-10-12 Zhe Liu , Yue Hui , Fuchun Peng

Federated Learning (FL) enables training ML models on edge clients without sharing data. However, the federated model's performance on local data varies, disincentivising the participation of clients who benefit little from FL. Fair FL…

Machine Learning · Computer Science 2023-05-05 Alex Iacob , Pedro P. B. Gusmão , Nicholas D. Lane

Federated learning (FL) is a decentralized machine learning technique that enables multiple clients to collaboratively train models without requiring clients to reveal their raw data to each other. Although traditional FL trains a single…

Machine Learning · Computer Science 2023-11-22 Junki Mori , Tomoyuki Yoshiyama , Furukawa Ryo , Isamu Teranishi

Personalized federated learning (PFL) studies effective model personalization to address the data heterogeneity issue among clients in traditional federated learning (FL). Existing PFL approaches mainly generate personalized models by…

Machine Learning · Computer Science 2025-01-06 Danni Peng , Yuan Wang , Huazhu Fu , Jinpeng Jiang , Yong Liu , Rick Siow Mong Goh , Qingsong Wei

Federated Learning (FL) seeks to distribute model training across local clients without collecting data in a centralized data-center, hence removing data-privacy concerns. A major challenge for FL is data heterogeneity (where each client's…

Machine Learning · Computer Science 2022-09-22 Junjiao Tian , James Seale Smith , Zsolt Kira

Federated learning (FL) is an emerging distributed machine learning paradigm that avoids data sharing among training nodes so as to protect data privacy. Under coordination of the FL server, each client conducts model training using its own…

Machine Learning · Computer Science 2021-01-01 Binbin Guo , Yuan Mei , Danyang Xiao , Weigang Wu , Ye Yin , Hongli Chang

Federated Learning (FL) has emerged as a key approach for distributed machine learning, enhancing online personalization while ensuring user data privacy. Instead of sending private data to a central server as in traditional approaches, FL…

Information Retrieval · Computer Science 2023-09-19 Francesco Fabbri , Xianghang Liu , Jack R. McKenzie , Bartlomiej Twardowski , Tri Kurniawan Wijaya