English
Related papers

Related papers: FedRD: Reducing Divergences for Generalized Federa…

200 papers

Federated Learning is a machine learning paradigm where we aim to train machine learning models in a distributed fashion. Many clients/edge devices collaborate with each other to train a single model on the central. Clients do not share…

Machine Learning · Computer Science 2022-11-28 Mann Patel

Federated learning (FL) is an appealing paradigm that allows a group of machines (a.k.a. clients) to learn collectively while keeping their data local. However, due to the heterogeneity between the clients' data distributions, the model…

Machine Learning · Computer Science 2024-10-01 Youssef Allouah , Abdellah El Mrini , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot

Federated Learning (FL) facilitates the fine-tuning of Foundation Models (FMs) using distributed data sources, with Low-Rank Adaptation (LoRA) gaining popularity due to its low communication costs and strong performance. While recent work…

Machine Learning · Computer Science 2025-05-27 Zihao Peng , Jiandian Zeng , Boyuan Li , Guo Li , Shengbo Chen , Tian Wang

Federated learning, an emerging machine learning paradigm, enables clients to collaboratively train a model without exchanging local data. Clients participating in the training process significantly impact the convergence rate, learning…

Machine Learning · Computer Science 2024-08-30 Fares Fourati , Salma Kharrat , Vaneet Aggarwal , Mohamed-Slim Alouini , Marco Canini

Federated Learning (FL) is a privacy-constrained decentralized machine learning paradigm in which clients enable collaborative training without compromising private data. However, how to learn a robust global model in the data-heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Kangyang Luo , Shuai Wang , Yexuan Fu , Xiang Li , Yunshi Lan , Ming Gao

Multimodal Federated Learning (MFL) enables clients with heterogeneous data modalities to collaboratively train models without sharing raw data, offering a privacy-preserving framework that leverages complementary cross-modal information.…

Machine Learning · Computer Science 2026-03-06 Min Tan , Junchao Ma , Yinfu Feng , Jiajun Ding , Wenwen Pan , Tingting Han , Qian Zheng , Zhenzhong Kuang , Zhou Yu

Federated Learning is a distributed learning paradigm with two key challenges that differentiate it from traditional distributed optimization: (1) significant variability in terms of the systems characteristics on each device in the network…

Machine Learning · Computer Science 2020-04-23 Tian Li , Anit Kumar Sahu , Manzil Zaheer , Maziar Sanjabi , Ameet Talwalkar , Virginia Smith

Heterogeneity in federated learning (FL) is a critical and challenging aspect that significantly impacts model performance and convergence. In this paper, we propose a novel framework by formulating heterogeneous FL as a hierarchical…

Optimization and Control · Mathematics 2025-09-11 Yuyang Qiu , Kibaek Kim , Farzad Yousefian

Federated Learning (FL) enables collaborative model training across multiple clients without sharing their private data. However, data heterogeneity across clients leads to client drift, which degrades the overall generalization performance…

Machine Learning · Computer Science 2026-03-02 Alina Devkota , Jacob Thrasher , Donald Adjeroh , Binod Bhattarai , Prashnna K. Gyawali

Federated learning is an emerging distributed machine learning framework aiming at protecting data privacy. Data heterogeneity is one of the core challenges in federated learning, which could severely degrade the convergence rate and…

Machine Learning · Statistics 2025-11-27 Feifei Wang , Huiyun Tang , Yang Li

Heterogeneity across clients in federated learning (FL) usually hinders the optimization convergence and generalization performance when the aggregation of clients' knowledge occurs in the gradient space. For example, clients may differ in…

Machine Learning · Computer Science 2022-03-08 Yue Tan , Guodong Long , Lu Liu , Tianyi Zhou , Qinghua Lu , Jing Jiang , Chengqi Zhang

Federated Learning (FL) aims to learn a single global model that enables the central server to help the model training in local clients without accessing their local data. The key challenge of FL is the heterogeneity of local data in…

Machine Learning · Computer Science 2023-04-17 Sicong Liang , Junchao Tian , Shujun Yang , Yu Zhang

Federated Learning (FL) has emerged as an essential framework for distributed machine learning, especially with its potential for privacy-preserving data processing. However, existing FL frameworks struggle to address statistical and model…

Machine Learning · Computer Science 2025-04-02 Fucheng Guo , Zeyu Luan , Qing Li , Dan Zhao , Yong Jiang

Federated learning is a privacy-preserving machine learning technique that learns a shared model across decentralized clients. It can alleviate privacy concerns of personal re-identification, an important computer vision task. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Weiming Zhuang , Yonggang Wen , Xuesen Zhang , Xin Gan , Daiying Yin , Dongzhan Zhou , Shuai Zhang , Shuai Yi

Federated Learning (FL) has shown great potential as a privacy-preserving solution to learning from decentralized data that are only accessible to end devices (i.e., clients). In many scenarios, however, a large proportion of the clients…

Machine Learning · Computer Science 2022-01-31 Wentai Wu , Ligang He , Weiwei Lin , Carsten Maple

Federated learning (FL) has emerged as a promising collaborative and secure paradigm for training a model from decentralized data without compromising privacy. Group fairness and client fairness are two dimensions of fairness that are…

Machine Learning · Computer Science 2023-12-12 Cong Su , Guoxian Yu , Jun Wang , Hui Li , Qingzhong Li , Han Yu

Federated Learning offers a solution for decentralised model training, addressing the difficulties associated with distributed data and privacy in machine learning. However, the fact of data heterogeneity in federated learning frequently…

Machine Learning · Computer Science 2025-09-10 Ozgu Goksu , Nicolas Pugeault

Federated learning (FL) is increasingly adopted in domains like healthcare, where data privacy is paramount. A fundamental challenge in these systems is statistical heterogeneity-the fact that data distributions vary significantly across…

Machine Learning · Computer Science 2026-02-12 Zijian Wang , Xiaofei Zhang , Xin Zhang , Yukun Liu , Qiong Zhang

Federated learning (FL) enables collaborative training of a global model in the centralized server with data from multiple parties while preserving privacy. However, data heterogeneity can significantly degrade the performance of the global…

Machine Learning · Computer Science 2025-11-11 Yong Zhang , Feng Liang , Guanghu Yuan , Min Yang , Chengming Li , Xiping Hu

Federated learning (FL for simplification) is a distributed machine learning technique that utilizes global servers and collaborative clients to achieve privacy-preserving global model training without direct data sharing. However,…

Machine Learning · Computer Science 2022-11-28 Mingjia Shi , Yuhao Zhou , Qing Ye , Jiancheng Lv