English
Related papers

Related papers: Personalized Federated Learning under Model Dissim…

200 papers

Federated learning (FL), which has gained increasing attention recently, enables distributed devices to train a common machine learning (ML) model for intelligent inference cooperatively without data sharing. However, problems in practical…

Machine Learning · Computer Science 2022-11-01 Yujie Zhou , Zhidu Li , Tong Tang , Ruyan Wang

To leverage enormous unlabeled data on distributed edge devices, we formulate a new problem in federated learning called Federated Unsupervised Representation Learning (FURL) to learn a common representation model without supervision while…

Machine Learning · Computer Science 2020-10-20 Fengda Zhang , Kun Kuang , Zhaoyang You , Tao Shen , Jun Xiao , Yin Zhang , Chao Wu , Yueting Zhuang , Xiaolin Li

Federated Learning (FL) seeks to distribute model training across local clients without collecting data in a centralized data-center, hence removing data-privacy concerns. A major challenge for FL is data heterogeneity (where each client's…

Machine Learning · Computer Science 2022-09-22 Junjiao Tian , James Seale Smith , Zsolt Kira

The recent trend towards Personalized Federated Learning (PFL) has garnered significant attention as it allows for the training of models that are tailored to each client while maintaining data privacy. However, current PFL techniques…

Machine Learning · Computer Science 2023-05-03 Yue Wu , Shuaicheng Zhang , Wenchao Yu , Yanchi Liu , Quanquan Gu , Dawei Zhou , Haifeng Chen , Wei Cheng

Data heterogeneity poses a fundamental challenge in federated learning (FL), especially when clients differ not only in distribution but also in the reliability of their predictions across individual examples. While personalized FL (PFL)…

Machine Learning · Computer Science 2025-09-29 Amr Abourayya , Jens Kleesiek , Bharat Rao , Michael Kamp

Federated Learning (FL) aims to learn a single global model that enables the central server to help the model training in local clients without accessing their local data. The key challenge of FL is the heterogeneity of local data in…

Machine Learning · Computer Science 2023-04-17 Sicong Liang , Junchao Tian , Shujun Yang , Yu Zhang

Federated learning enables distributed clients to collaborate on training while storing their data locally to protect client privacy. However, due to the heterogeneity of data, models, and devices, the final global model may need to perform…

Machine Learning · Computer Science 2024-06-25 Wolong Xing , Zhenkui Shi , Hongyan Peng , Xiantao Hu , Xianxian Li

This work tackles the challenges of data heterogeneity and communication limitations in decentralized federated learning. We focus on creating a collaboration graph that guides each client in selecting suitable collaborators for training…

Machine Learning · Computer Science 2024-06-11 Salma Kharrat , Marco Canini , Samuel Horvath

Personalized Federated Learning (PFL) aims to learn personalized models for each client based on the knowledge across all clients in a privacy-preserving manner. Existing PFL methods generally assume that the underlying global data across…

Machine Learning · Computer Science 2023-03-28 Yang Lu , Pinxin Qian , Gang Huang , Hanzi Wang

Different from conventional federated learning, personalized federated learning (PFL) is able to train a customized model for each individual client according to its unique requirement. The mainstream approach is to adopt a kind of weighted…

Machine Learning · Computer Science 2023-07-18 Jiahao Liu , Jiang Wu , Jinyu Chen , Miao Hu , Yipeng Zhou , Di Wu

Federated Learning (FL) is a distributed machine learning paradigm that achieves a globally robust model through decentralized computation and periodic model synthesis, primarily focusing on the global model's accuracy over aggregated…

Machine Learning · Computer Science 2024-11-27 Han Liang , Ziwei Zhan , Weijie Liu , Xiaoxi Zhang , Chee Wei Tan , Xu Chen

Heterogeneous federated learning (HFL) aims to ensure effective and privacy-preserving collaboration among different entities. As newly joined clients require significant adjustments and additional training to align with the existing…

Machine Learning · Computer Science 2026-01-29 Kaile Wang , Jiannong Cao , Yu Yang , Xiaoyin Li , Mingjin Zhang

Federated Learning (FL) enables decentralised model training across distributed clients without requiring data centralisation. However, the generalisation performance of the global model is usually degraded by data heterogeneity across…

Machine Learning · Computer Science 2026-05-11 Ozgu Goksu , Nicolas Pugeault

Federated learning faces huge challenges from model overfitting due to the lack of data and statistical diversity among clients. To address these challenges, this paper proposes a novel personalized federated learning method via Bayesian…

Machine Learning · Computer Science 2022-06-17 Xu Zhang , Yinchuan Li , Wenpeng Li , Kaiyang Guo , Yunfeng Shao

As a promising paradigm federated Learning (FL) is widely used in privacy-preserving machine learning, which allows distributed devices to collaboratively train a model while avoiding data transmission among clients. Despite its immense…

Machine Learning · Computer Science 2023-08-29 Jinglong Shen , Xiucheng Wang , Nan Cheng , Longfei Ma , Conghao Zhou , Yuan Zhang

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

This paper focuses on addressing the practical yet challenging problem of model heterogeneity in federated learning, where clients possess models with different network structures. To track this problem, we propose a novel framework called…

Machine Learning · Computer Science 2023-10-30 Jiaqi Wang , Xingyi Yang , Suhan Cui , Liwei Che , Lingjuan Lyu , Dongkuan Xu , Fenglong Ma

Federated learning (FL) is a rapidly growing privacy-preserving collaborative machine learning paradigm. In practical FL applications, local data from each data silo reflect local usage patterns. Therefore, there exists heterogeneity of…

Machine Learning · Computer Science 2022-02-01 Shenglai Zeng , Zonghang Li , Hongfang Yu , Yihong He , Zenglin Xu , Dusit Niyato , Han Yu

In modern federated learning, one of the main challenges is to account for inherent heterogeneity and the diverse nature of data distributions for different clients. This problem is often addressed by introducing personalization of the…

Machine Learning · Statistics 2023-12-19 Nikita Kotelevskii , Samuel Horváth , Karthik Nandakumar , Martin Takáč , Maxim Panov

Federated Learning (FL) enables privacy-preserving collaborative model training, but its effectiveness is often limited by client data heterogeneity. We introduce a client-selection algorithm that (i) dynamically forms nonoverlapping…

Machine Learning · Computer Science 2025-10-16 Alessandro Licciardi , Roberta Raineri , Anton Proskurnikov , Lamberto Rondoni , Lorenzo Zino