English
Related papers

Related papers: Bi-level Personalization for Federated Foundation …

200 papers

Statistical heterogeneity across clients in a Federated Learning (FL) system increases the algorithm convergence time and reduces the generalization performance, resulting in a large communication overhead in return for a poor model. To…

Machine Learning · Computer Science 2023-04-26 Mohamad Mestoukirdi , Matteo Zecchin , David Gesbert , Qianrui Li

Personalized Federated Learning (PFL) aims to train customized models for clients with highly heterogeneous data distributions while preserving data privacy. Existing approaches often rely on heuristics like clustering or model…

Artificial Intelligence · Computer Science 2026-03-13 Ping Guo , Tiantian Zhang , Xi Lin , Xiang Li , Zhi-Ri Tang , Qingfu Zhang

Federated recommendation aims to collect global knowledge by aggregating local models from massive devices, to provide recommendations while ensuring privacy. Current methods mainly leverage aggregation functions invented by federated…

Cryptography and Security · Computer Science 2024-06-07 Honglei Zhang , Haoxuan Li , Jundong Chen , Sen Cui , Kunda Yan , Abudukelimu Wuerkaixi , Xin Zhou , Zhiqi Shen , Yidong Li

Federated prognostics enable clients (e.g., companies, factories, and production lines) to collaboratively develop a failure time prediction model while keeping each client's data local and confidential. However, traditional federated…

Machine Learning · Computer Science 2026-04-22 Yuhan Hu , Xiaolei Fang

Personalized federated learning (PFL) addresses a critical challenge of collaboratively training customized models for clients with heterogeneous and scarce local data. Conventional federated learning, which relies on a single consensus…

Machine Learning · Computer Science 2025-10-24 Ke Xing , Yanjie Dong , Xiaoyi Fan , Runhao Zeng , Victor C. M. Leung , M. Jamal Deen , Xiping Hu

Consider two data providers, each maintaining private records of different feature sets about common entities. They aim to learn a linear model jointly in a federated setting, namely, data is local and a shared model is trained from locally…

Machine Learning · Computer Science 2017-11-30 Stephen Hardy , Wilko Henecka , Hamish Ivey-Law , Richard Nock , Giorgio Patrini , Guillaume Smith , Brian Thorne

In many applications of federated learning (FL), clients desire models that are personalized using their local data, yet are also robust in the sense that they retain general global knowledge. However, the presence of data heterogeneity…

Machine Learning · Computer Science 2023-10-10 Liam Collins , Shanshan Wu , Sewoong Oh , Khe Chai Sim

Federated learning (FL) addresses privacy concerns in training language models by enabling multiple clients to contribute to the training, without sending their data to others. However, non-IID (identically and independently distributed)…

Machine Learning · Computer Science 2025-01-28 Jong-Ik Park , Carlee Joe-Wong

Federated learning enables collaborative model training without sharing raw data, but data heterogeneity consistently challenges the performance of the global model. Traditional optimization methods often rely on collaborative global model…

Machine Learning · Computer Science 2025-09-29 Weiqi Yue , Wenbiao Li , Yuzhou Jiang , Anisa Halimi , Roger French , Erman Ayday

Personalized medication aims to tailor healthcare to individual patient characteristics. However, the heterogeneity of patient data across healthcare systems presents significant challenges to achieving accurate and effective personalized…

Artificial Intelligence · Computer Science 2024-12-10 Jiechao Gao , Yuangang Li

Knowledge sharing and model personalization are two key components in the conceptual framework of personalized federated learning (PFL). Existing PFL methods focus on proposing new model personalization mechanisms while simply implementing…

Machine Learning · Computer Science 2022-05-03 Fengwen Chen , Guodong Long , Zonghan Wu , Tianyi Zhou , Jing Jiang

Personalized federated learning has received an upsurge of attention due to the mediocre performance of conventional federated learning (FL) over heterogeneous data. Unlike conventional FL which trains a single global consensus model,…

Machine Learning · Computer Science 2023-09-08 Jun Luo , Matias Mendieta , Chen Chen , Shandong Wu

We study a new form of federated learning where the clients train personalized local models and make predictions jointly with the server-side shared model. Using this new federated learning framework, the complexity of the central shared…

Machine Learning · Computer Science 2020-03-31 Alekh Agarwal , John Langford , Chen-Yu Wei

Federated Learning (FL) is a distributed learning paradigm where clients collaboratively train a model while keeping their own data private. With an increasing scale of clients and models, FL encounters two key challenges, client drift due…

Machine Learning · Computer Science 2025-01-20 Jianhui Sun , Xidong Wu , Heng Huang , Aidong Zhang

In recent advancements in machine learning, federated learning allows a network of distributed clients to collaboratively develop a global model without needing to share their local data. This technique aims to safeguard privacy, countering…

Machine Learning · Computer Science 2024-07-18 Davide Domini , Gianluca Aguzzi , Nicolas Farabegoli , Mirko Viroli , Lukas Esterle

The federated learning (FL) paradigm emerges to preserve data privacy during model training by only exposing clients' model parameters rather than original data. One of the biggest challenges in FL lies in the non-IID (not identical and…

Machine Learning · Computer Science 2023-05-26 Jiahao Tan , Yipeng Zhou , Gang Liu , Jessie Hui Wang , Shui Yu

Foundation models are now a major focus of leading technology organizations due to their ability to generalize across diverse tasks. Existing approaches for adapting foundation models to new applications often rely on Federated Learning…

Machine Learning · Computer Science 2025-06-24 Jong-Ik Park , Srinivasa Pranav , José M. F. Moura , Carlee Joe-Wong

Personalization in federated learning (FL) functions as a coordinator for clients with high variance in data or behavior. Ensuring the convergence of these clients' models relies on how closely users collaborate with those with similar…

Machine Learning · Computer Science 2023-02-24 Eunjeong Jeong , Marios Kountouris

Personalization methods in federated learning aim to balance the benefits of federated and local training for data availability, communication cost, and robustness to client heterogeneity. Approaches that require clients to communicate all…

Machine Learning · Computer Science 2022-04-28 Karan Singhal , Hakim Sidahmed , Zachary Garrett , Shanshan Wu , Keith Rush , Sushant Prakash

Federated learning is an efficient framework designed to facilitate collaborative model training across multiple distributed devices while preserving user data privacy. A significant challenge of federated learning is data-level…

Machine Learning · Computer Science 2024-08-26 Shunxin Guo , Hongsong Wang , Shuxia Lin , Zhiqiang Kou , Xin Geng