English
Related papers

Related papers: Co-LoRA: Collaborative Model Personalization on He…

200 papers

Federated learning (FL) is a distributed machine learning approach involving multiple clients collaboratively training a shared model. Such a system has the advantage of more training data from multiple clients, but data can be…

Machine Learning · Computer Science 2021-08-24 Sone Kyaw Pye , Han Yu

Federated learning (FL) is an appealing paradigm that allows a group of machines (a.k.a. clients) to learn collectively while keeping their data local. However, due to the heterogeneity between the clients' data distributions, the model…

Machine Learning · Computer Science 2024-10-01 Youssef Allouah , Abdellah El Mrini , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot

Traditional Federated Learning (FL) methods typically train a single global model collaboratively without exchanging raw data. In contrast, Personalized Federated Learning (PFL) techniques aim to create multiple models that are better…

Machine Learning · Computer Science 2024-04-23 Emilio Cantu-Cervini

Personalized Federated Learning (PFL) aims to train customized models for clients with highly heterogeneous data distributions while preserving data privacy. Existing approaches often rely on heuristics like clustering or model…

Artificial Intelligence · Computer Science 2026-03-13 Ping Guo , Tiantian Zhang , Xi Lin , Xiang Li , Zhi-Ri Tang , Qingfu Zhang

Federated learning (FL) is a decentralized machine learning technique that enables multiple clients to collaboratively train models without requiring clients to reveal their raw data to each other. Although traditional FL trains a single…

Machine Learning · Computer Science 2023-11-22 Junki Mori , Tomoyuki Yoshiyama , Furukawa Ryo , Isamu Teranishi

The advent of smart meters has enabled pervasive collection of energy consumption data for training short-term load forecasting (STLF) models. In response to privacy concerns, federated learning (FL) has been proposed as a…

Machine Learning · Computer Science 2023-09-26 Shourya Bose , Kibaek Kim

Multi-agent learning faces a fundamental tension: leveraging distributed collaboration without sacrificing the personalization needed for diverse agents. This tension intensifies when aiming for full personalization while adapting to…

Machine Learning · Statistics 2026-03-11 Chenyu Zhang , Navid Azizan

Federated learning (FL) has become a prevalent distributed machine learning paradigm with improved privacy. After learning, the resulting federated model should be further personalized to each different client. While several methods have…

Machine Learning · Computer Science 2021-03-09 Bingyan Liu , Yao Guo , Xiangqun Chen

Personalized Federated Learning (PFL) aims to learn personalized models for each client based on the knowledge across all clients in a privacy-preserving manner. Existing PFL methods generally assume that the underlying global data across…

Machine Learning · Computer Science 2023-03-28 Yang Lu , Pinxin Qian , Gang Huang , Hanzi Wang

In the age of data-driven decision making, preserving privacy while providing personalized experiences has become paramount. Personalized Federated Learning (PFL) offers a promising framework by decentralizing the learning process, thus…

Machine Learning · Computer Science 2025-01-31 Kevin Cooper , Michael Geller

Personalized Federated Learning (pFL) not only can capture the common priors from broad range of distributed data, but also support customized models for heterogeneous clients. Researches over the past few years have applied the weighted…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-10 Xiaosong Ma , Jie Zhang , Song Guo , Wenchao Xu

Recent advances of generative learning models are accompanied by the growing interest in federated learning (FL) based on generative adversarial network (GAN) models. In the context of FL, GAN can capture the underlying client data…

Machine Learning · Computer Science 2023-08-25 Achintha Wijesinghe , Songyang Zhang , Zhi Ding

Federated learning systems have been identified as an efficient approach to scaling distributed model training with a large amount of participants or data owners while guaranteeing data privacy. To apply the current most popular pre-trained…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-04 Qianli Liu , Zhaorui Zhang , Xin Yao , Benben Liu

Personalization aims to characterize individual preferences and is widely applied across many fields. However, conventional personalized methods operate in a centralized manner, potentially exposing raw data when pooling individual…

Machine Learning · Computer Science 2025-08-06 Hao Di , Yi Yang , Haishan Ye , Xiangyu Chang

Parameter-efficient fine-tuning methods, such as LoRA, offer a practical way to adapt large vision and language models to client tasks. However, this becomes particularly challenging under task-level heterogeneity in federated deployments.…

Machine Learning · Computer Science 2026-02-24 Yinan Zou , Md Kamran Chowdhury Shisher , Christopher G. Brinton , Vishrant Tripathi

In Federated Learning, heterogeneity in client data distributions often means that a single global model does not have the best performance for individual clients. Consider for example training a next-word prediction model for keyboards:…

Machine Learning · Computer Science 2025-05-06 Ljubomir Rokvic , Panayiotis Danassis , Boi Faltings

To protect privacy and meet legal regulations, federated learning (FL) has gained significant attention for training speech-to-text (S2T) systems, including automatic speech recognition (ASR) and speech translation (ST). However, the…

Computation and Language · Computer Science 2025-01-22 Yichao Du , Zhirui Zhang , Linan Yue , Xu Huang , Yuqing Zhang , Tong Xu , Linli Xu , Enhong Chen

Federated Learning provides a privacy-preserving paradigm for distributed learning, but suffers from statistical heterogeneity across clients. Personalized Federated Learning (PFL) mitigates this issue by considering client-specific models.…

Machine Learning · Statistics 2026-02-17 Ala Emrani , Amir Najafi , Abolfazl Motahari

Federated Learning (FL) empowers multiple clients to collaboratively train machine learning models without sharing local data, making it highly applicable in heterogeneous Internet of Things (IoT) environments. However, intrinsic…

Machine Learning · Computer Science 2025-01-29 Xi Chen , Qin Li , Haibin Cai , Ting Wang

The advent of smart meters has enabled pervasive collection of energy consumption data for training short-term load forecasting models. In response to privacy concerns, federated learning (FL) has been proposed as a privacy-preserving…

Machine Learning · Computer Science 2024-04-03 Shourya Bose , Yu Zhang , Kibaek Kim