English
Related papers

Related papers: PerAda: Parameter-Efficient Federated Learning Per…

200 papers

Personalized federated learning (PFL) is a popular framework that allows clients to have different models to address application scenarios where clients' data are in different domains. The typical model of a client in PFL features a global…

Machine Learning · Computer Science 2023-07-27 Guogang Zhu , Xuefeng Liu , Shaojie Tang , Jianwei Niu , Xinghao Wu , Jiaxing Shen

Federated learning (FL), a novel branch of distributed machine learning (ML), develops global models through a private procedure without direct access to local datasets. However, it is still possible to access the model updates (gradient…

Machine Learning · Computer Science 2024-06-27 Mahtab Talaei , Iman Izadi

Mobile devices, including smartphones and laptops, generate decentralized and heterogeneous data, presenting significant challenges for traditional centralized machine learning models due to substantial communication costs and privacy…

Machine Learning · Computer Science 2024-11-12 Mayank Kumar Kundalwal , Anurag Saraswat , Ishan Mishra , Deepak Mishra

As people pay more and more attention to privacy protection, Federated Learning (FL), as a promising distributed machine learning paradigm, is receiving more and more attention. However, due to the biased distribution of data on devices in…

Machine Learning · Computer Science 2023-02-27 Yuquan Zhang , Yongquan Zhang

The prevalent personalized federated learning (PFL) usually pursues a trade-off between personalization and generalization by maintaining a shared global model to guide the training process of local models. However, the sole global model…

Machine Learning · Computer Science 2022-05-03 Xueyang Tang , Song Guo , Jingcai Guo

Federated learning is an efficient framework designed to facilitate collaborative model training across multiple distributed devices while preserving user data privacy. A significant challenge of federated learning is data-level…

Machine Learning · Computer Science 2024-08-26 Shunxin Guo , Hongsong Wang , Shuxia Lin , Zhiqiang Kou , Xin Geng

Statistical heterogeneity in Federated Learning (FL) often leads to negative transfer, where a single global model fails to serve diverse client distributions. Personalized federated learning (pFL) aims to address this by tailoring models…

Machine Learning · Computer Science 2026-03-31 Brianna Mueller , W. Nick Street

Federated learning (FL) enables collaborative training of deep learning models without requiring data to leave local clients, thereby preserving client privacy. The aggregation process on the server plays a critical role in the performance…

Machine Learning · Computer Science 2025-04-18 Leming Wu , Yaochu Jin , Kuangrong Hao , Han Yu

The proliferation of edge devices has brought Federated Learning (FL) to the forefront as a promising paradigm for decentralized and collaborative model training while preserving the privacy of clients' data. However, FL struggles with a…

Machine Learning · Computer Science 2024-05-14 Mahdi Morafah , Matthias Reisser , Bill Lin , Christos Louizos

Existing parameter-efficient fine-tuning (PEFT) methods primarily fall into two categories: addition-based and selective in-situ adaptation. The former, such as LoRA, introduce additional modules to adapt the model to downstream tasks,…

Machine Learning · Computer Science 2025-10-23 Zhi Zhang , Yixian Shen , Congfeng Cao , Ekaterina Shutova

Federated learning (FL) has emerged as a prominent approach for collaborative training of machine learning models across distributed clients while preserving data privacy. However, the quest to balance acceleration and stability becomes a…

Machine Learning · Computer Science 2024-05-21 Liuzhi Zhou , Yu He , Kun Zhai , Xiang Liu , Sen Liu , Xingjun Ma , Guangnan Ye , Yu-Gang Jiang , Hongfeng Chai

Parameter-efficient fine-tuning methods, such as LoRA, offer a practical way to adapt large vision and language models to client tasks. However, this becomes particularly challenging under task-level heterogeneity in federated deployments.…

Machine Learning · Computer Science 2026-02-24 Yinan Zou , Md Kamran Chowdhury Shisher , Christopher G. Brinton , Vishrant Tripathi

As AI becomes more personal, e.g., Agentic AI, there is an increasing need for personalizing models for various use cases. Personalized federated learning (PFL) enables each client to collaboratively leverage other clients' knowledge for…

Machine Learning · Computer Science 2026-03-10 Minhyuk Seo , Taeheon Kim , Hankook Lee , Jonghyun Choi , Tinne Tuytelaars

Federated learning is gaining popularity as a distributed machine learning method that can be used to deploy AI-dependent IoT applications while protecting client data privacy and security. Due to the differences of clients, a single global…

Machine Learning · Computer Science 2022-02-21 Xingjian Cao , Gang Sun , Hongfang Yu , Mohsen Guizani

Ensuring fairness is critical when applying artificial intelligence to high-stakes domains such as healthcare, where predictive models trained on imbalanced and demographically skewed data risk exacerbating existing disparities. Federated…

Computers and Society · Computer Science 2025-05-15 Qiming Wu , Siqi Li , Doudou Zhou , Nan Liu

For modern artificial intelligence (AI) applications such as large language models (LLMs), the training paradigm has recently shifted to pre-training followed by fine-tuning. Furthermore, owing to dwindling open repositories of data and…

Machine Learning · Computer Science 2025-12-02 Haifeng Wen , Hong Xing , Osvaldo Simeone

Recent advancements in federated learning (FL) seek to increase client-level performance by fine-tuning client parameters on local data or personalizing architectures for the local task. Existing methods for such personalization either…

Machine Learning · Computer Science 2024-06-11 Rishub Tamirisa , John Won , Chengjun Lu , Ron Arel , Andy Zhou

The rapid proliferation of large language models (LLMs) has created an unprecedented demand for fine-tuning models for specialized domains, such as medical science. While federated learning (FL) offers a decentralized and privacy-preserving…

Machine Learning · Computer Science 2025-06-25 Amir Faiyaz , Tara Salman

Decentralized Federated Learning (DFL) has become popular due to its robustness and avoidance of centralized coordination. In this paradigm, clients actively engage in training by exchanging models with their networked neighbors. However,…

Machine Learning · Computer Science 2024-07-24 Qianyu Long , Qiyuan Wang , Christos Anagnostopoulos , Daning Bi

Personalized federated learning (pFL) aims to adapt models to client specific data distributions, yet it often fails to reliably preserve personalized information. Local training is hindered by high variance gradients induced by limited and…

Machine Learning · Computer Science 2026-05-05 Dongwon Kim , Gyuejeong Lee