English
Related papers

Related papers: Multi-Layer Personalized Federated Learning for Mi…

200 papers

The increasing size of data generated by smartphones and IoT devices motivated the development of Federated Learning (FL), a framework for on-device collaborative training of machine learning models. First efforts in FL focused on learning…

Machine Learning · Computer Science 2022-11-08 Othmane Marfoq , Giovanni Neglia , Aurélien Bellet , Laetitia Kameni , Richard Vidal

Federated Learning (FL) faces major challenges regarding communication overhead and model privacy when training large language models (LLMs), especially in healthcare applications. To address these, we introduce Selective Attention…

Computation and Language · Computer Science 2025-04-22 Yue Li , Lihong Zhang

Personalized Federated Learning (pFL) holds immense promise for tailoring machine learning models to individual users while preserving data privacy. However, achieving optimal performance in pFL often requires a careful balancing act…

Machine Learning · Computer Science 2024-09-12 Azal Ahmad Khan , Ahmad Faraz Khan , Haider Ali , Ali Anwar

Data heterogeneity across clients in federated learning (FL) settings is a widely acknowledged challenge. In response, personalized federated learning (PFL) emerged as a framework to curate local models for clients' tasks. In PFL, a common…

Machine Learning · Computer Science 2023-12-27 Yutong Dai , Zeyuan Chen , Junnan Li , Shelby Heinecke , Lichao Sun , Ran Xu

Federated learning (FL) is a distributed machine learning approach involving multiple clients collaboratively training a shared model. Such a system has the advantage of more training data from multiple clients, but data can be…

Machine Learning · Computer Science 2021-08-24 Sone Kyaw Pye , Han Yu

Standard federated learning approaches suffer when client data distributions have sufficient heterogeneity. Recent methods addressed the client data heterogeneity issue via personalized federated learning (PFL) - a class of FL algorithms…

Machine Learning · Computer Science 2024-04-04 Rishub Tamirisa , Chulin Xie , Wenxuan Bao , Andy Zhou , Ron Arel , Aviv Shamsian

Federated learning enables distributed clients to collaborate on training while storing their data locally to protect client privacy. However, due to the heterogeneity of data, models, and devices, the final global model may need to perform…

Machine Learning · Computer Science 2024-06-25 Wolong Xing , Zhenkui Shi , Hongyan Peng , Xiantao Hu , Xianxian Li

Federated Learning provides a privacy-preserving paradigm for distributed learning, but suffers from statistical heterogeneity across clients. Personalized Federated Learning (PFL) mitigates this issue by considering client-specific models.…

Machine Learning · Statistics 2026-02-17 Ala Emrani , Amir Najafi , Abolfazl Motahari

Federated learning (FL) enables collaborative model training across distributed clients without centralizing data. However, existing approaches such as Federated Averaging (FedAvg) often perform poorly with heterogeneous data distributions,…

Machine Learning · Computer Science 2025-08-05 Gyuejeong Lee , Daeyoung Choi

Multimodal Federated Learning (MFL) enables clients with heterogeneous data modalities to collaboratively train models without sharing raw data, offering a privacy-preserving framework that leverages complementary cross-modal information.…

Machine Learning · Computer Science 2026-03-06 Min Tan , Junchao Ma , Yinfu Feng , Jiajun Ding , Wenwen Pan , Tingting Han , Qian Zheng , Zhenzhong Kuang , Zhou Yu

Personalized decision-making can be implemented in a Federated learning (FL) framework that can collaboratively train a decision model by extracting knowledge across intelligent clients, e.g. smartphones or enterprises. FL can mitigate the…

Machine Learning · Computer Science 2023-02-01 Guodong Long , Ming Xie , Tao Shen , Tianyi Zhou , Xianzhi Wang , Jing Jiang , Chengqi Zhang

Subgraph Federated Learning (FL) aims to train Graph Neural Networks (GNNs) across distributed private subgraphs, but it suffers from severe data heterogeneity. To mitigate data heterogeneity, weighted model aggregation personalizes each…

Machine Learning · Computer Science 2026-03-23 Minku Kang , Hogun Park

As methods to create discrimination-aware models develop, they focus on centralized ML, leaving federated learning (FL) unexplored. FL is a rising approach for collaborative ML, in which an aggregator orchestrates multiple parties to train…

Machine Learning · Computer Science 2020-12-07 Annie Abay , Yi Zhou , Nathalie Baracaldo , Shashank Rajamoni , Ebube Chuba , Heiko Ludwig

Real-life deployment of federated Learning (FL) often faces non-IID data, which leads to poor accuracy and slow convergence. Personalized FL (pFL) tackles these issues by tailoring local models to individual data sources and using weighted…

Machine Learning · Computer Science 2025-04-30 Weihang Chen , Cheng Yang , Jie Ren , Zhiqiang Li , Zheng Wang

Personalized federated learning becomes a hot research topic that can learn a personalized learning model for each client. Existing personalized federated learning models prefer to aggregate similar clients with similar data distribution to…

Machine Learning · Computer Science 2024-03-15 Xu Yang , Jiyuan Feng , Songyue Guo , Ye Wang , Ye Ding , Binxing Fang , Qing Liao

We present PeFLL, a new personalized federated learning algorithm that improves over the state-of-the-art in three aspects: 1) it produces more accurate models, especially in the low-data regime, and not only for clients present during its…

Machine Learning · Computer Science 2025-01-17 Jonathan Scott , Hossein Zakerinia , Christoph H. Lampert

To support real-world decision-making, it is crucial for models to be well-calibrated, i.e., to assign reliable confidence estimates to their predictions. Uncertainty quantification is particularly important in personalized federated…

Machine Learning · Computer Science 2024-10-21 Boning Zhang , Dongzhu Liu , Osvaldo Simeone , Guanchu Wang , Dimitrios Pezaros , Guangxu Zhu

Federated Learning (FL) often adopts differential privacy (DP) to protect client data, but the added noise required for privacy guarantees can substantially degrade model accuracy. To resolve this challenge, we propose model-splitting…

Machine Learning · Computer Science 2025-10-01 Yiwei Li , Shuai Wang , Zhuojun Tian , Xiuhua Wang , Shijian Su

Federated learning has emerged as a promising approach for training machine learning models on decentralized data sources while preserving data privacy. However, challenges such as communication bottlenecks, heterogeneity of client devices,…

Machine Learning · Computer Science 2023-12-27 Anna Vettoruzzo , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

Analytic Federated Learning (AFL) is an enhanced gradient-free federated learning (FL) paradigm designed to accelerate training by updating the global model in a single step with closed-form least-square (LS) solutions. However, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-20 Shunxian Gu , Chaoqun You , Deke Guo , Zhihao Qu , Bangbang Ren , Zaipeng Xie , Lailong Luo