English
Related papers

Related papers: Understanding and Improving Model Averaging in Fed…

200 papers

Federated Learning (FL) marks a transformative approach to distributed model training by combining locally optimized models from various clients into a unified global model. While FL preserves data privacy by eliminating centralized…

Machine Learning · Computer Science 2026-01-08 Pranab Sahoo , Ashutosh Tripathi , Sriparna Saha , Samrat Mondal

Federated Learning (FL) enables collaborative training across multiple clients while preserving data privacy, yet it struggles with data heterogeneity, where clients' data are not distributed independently and identically (non-IID). This…

Machine Learning · Computer Science 2025-12-16 Incheol Baek , Hyungbin Kim , Minseo Kim , Yon Dohn Chung

Despite recent advancements in federated learning (FL) for medical image diagnosis, addressing data heterogeneity among clients remains a significant challenge for practical implementation. A primary hurdle in FL arises from the non-IID…

Machine Learning · Computer Science 2024-07-09 Pranab Sahoo , Ashutosh Tripathi , Sriparna Saha , Samrat Mondal

Federated Learning (FL) typically aggregates client model parameters using a weighting approach determined by sample proportions. However, this naive weighting method may lead to unfairness and degradation in model performance due to…

Machine Learning · Computer Science 2023-11-13 Mingwei Xu , Xiaofeng Cao , Ivor W. Tsang , James T. Kwok

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

In Federated Learning, a common approach for aggregating local models across clients is periodic averaging of the full model parameters. It is, however, known that different layers of neural networks can have a different degree of model…

Machine Learning · Computer Science 2022-01-04 Sunwoo Lee , Tuo Zhang , Chaoyang He , Salman Avestimehr

Federated learning (FL) enables multiple clients to train a model while keeping their data private collaboratively. Previous studies have shown that data heterogeneity between clients leads to drifts across client updates. However, there…

Machine Learning · Computer Science 2023-10-02 Tailin Zhou , Jun Zhang , Danny H. K. Tsang

As methods to create discrimination-aware models develop, they focus on centralized ML, leaving federated learning (FL) unexplored. FL is a rising approach for collaborative ML, in which an aggregator orchestrates multiple parties to train…

Machine Learning · Computer Science 2020-12-07 Annie Abay , Yi Zhou , Nathalie Baracaldo , Shashank Rajamoni , Ebube Chuba , Heiko Ludwig

Federated learning (FL) has emerged as a groundbreaking paradigm in machine learning (ML), offering privacy-preserving collaborative model training across diverse datasets. Despite its promise, FL faces significant hurdles in…

Machine Learning · Computer Science 2025-06-24 Christian Internò , Markus Olhofer , Yaochu Jin , Barbara Hammer

Federated Learning (FL) is a distributed learning approach that trains machine learning models across multiple devices while keeping their local data private. However, FL often faces challenges due to data heterogeneity, leading to…

Machine Learning · Computer Science 2025-10-21 Dun Zeng , Zheshun Wu , Shiyu Liu , Yu Pan , Xiaoying Tang , Zenglin Xu

Federated Learning (FL) has emerged as a crucial distributed training paradigm, enabling discrete devices to collaboratively train a shared model under the coordination of a central server, while leveraging their locally stored private…

Machine Learning · Computer Science 2024-09-02 Wenhao Yuan , Xuehe Wang

Federated Learning (FL) is a decentralized machine learning (ML) technique that allows a number of participants to train an ML model collaboratively without having to share their private local datasets with others. When participants are…

Machine Learning · Computer Science 2023-12-19 Youssra Cheriguene , Wael Jaafar , Halim Yanikomeroglu , Chaker Abdelaziz Kerrache

Federated learning (FL) is a promising strategy for performing privacy-preserving, distributed learning with a network of clients (i.e., edge devices). However, the data distribution among clients is often non-IID in nature, making…

Machine Learning · Computer Science 2022-04-15 Matias Mendieta , Taojiannan Yang , Pu Wang , Minwoo Lee , Zhengming Ding , Chen Chen

Model heterogeneous federated learning (MHeteroFL) enables FL clients to collaboratively train models with heterogeneous structures in a distributed fashion. However, existing MHeteroFL methods rely on training loss to transfer knowledge…

Machine Learning · Computer Science 2024-06-04 Liping Yi , Han Yu , Chao Ren , Gang Wang , Xiaoguang Liu , Xiaoxiao Li

Federated learning (FL) systems face performance challenges in dealing with heterogeneous devices and non-identically distributed data across clients. We propose a dynamic global model aggregation method within Asynchronous Federated…

Machine Learning · Computer Science 2024-02-02 Jikun Gao , Ioannis Mavromatis , Peizheng Li , Pietro Carnelli , Aftab Khan

Federated Learning (FL) has surged in prominence due to its capability of collaborative model training without direct data sharing. However, the vast disparity in local data distributions among clients, often termed the Non-Independent…

Machine Learning · Computer Science 2024-12-12 Zheshun Wu , Zenglin Xu , Dun Zeng , Qifan Wang , Jie Liu

Federated Learning (FL) is a rising approach towards collaborative and privacy-preserving machine learning where large-scale medical datasets remain localized to each client. However, the issue of data heterogeneity among clients often…

Machine Learning · Computer Science 2024-10-01 Shuang Zeng , Pengxin Guo , Shuai Wang , Jianbo Wang , Yuyin Zhou , Liangqiong Qu

As privacy concerns and data regulations grow, federated learning (FL) has emerged as a promising approach for training machine learning models across decentralized data sources without sharing raw data. However, a significant challenge in…

Machine Learning · Computer Science 2025-06-04 Jungwon Seo , Ferhat Ozgur Catak , Chunming Rong

Federated averaging (FedAvg) is a popular federated learning (FL) technique that updates the global model by averaging local models and then transmits the updated global model to devices for their local model update. One main limitation of…

Machine Learning · Computer Science 2021-12-15 Luong Trung Nguyen , Junhan Kim , Byonghyo Shim

Federated Learning (FL) is a collaborative machine learning framework that allows multiple users to train models utilizing their local data in a distributed manner. However, considerable statistical heterogeneity in local data across…

Machine Learning · Computer Science 2024-09-10 Qi Le , Enmao Diao , Xinran Wang , Vahid Tarokh , Jie Ding , Ali Anwar