English
Related papers

Related papers: Stabilizing and Improving Federated Learning with …

200 papers

Data heterogeneity across clients in federated learning (FL) settings is a widely acknowledged challenge. In response, personalized federated learning (PFL) emerged as a framework to curate local models for clients' tasks. In PFL, a common…

Machine Learning · Computer Science 2023-12-27 Yutong Dai , Zeyuan Chen , Junnan Li , Shelby Heinecke , Lichao Sun , Ran Xu

Federated Learning (FL) is a promising decentralized learning framework and has great potentials in privacy preservation and in lowering the computation load at the cloud. Recent work showed that FedAvg and FedProx - the two widely-adopted…

Machine Learning · Statistics 2022-02-16 Lili Su , Jiaming Xu , Pengkun Yang

Federated learning on heterogeneous (non-IID) client data experiences slow convergence due to client drift. To address this challenge, we propose Kuramoto-FedAvg, a federated optimization algorithm that reframes the weight aggregation step…

Machine Learning · Computer Science 2025-05-27 Aggrey Muhebwa , Khotso Selialia , Fatima Anwar , Khalid K. Osman

Federated learning achieves effective performance in modeling decentralized data. In practice, client data are not well-labeled, which makes it potential for federated unsupervised learning (FUSL) with non-IID data. However, the performance…

Machine Learning · Computer Science 2024-03-26 Xinting Liao , Weiming Liu , Chaochao Chen , Pengyang Zhou , Fengyuan Yu , Huabin Zhu , Binhui Yao , Tao Wang , Xiaolin Zheng , Yanchao Tan

Federated learning (FL) is a distributed deep learning method which enables multiple participants, such as mobile phones and IoT devices, to contribute a neural network model while their private training data remains in local devices. This…

Machine Learning · Computer Science 2021-07-27 Moming Duan , Duo Liu , Xianzhang Chen , Yujuan Tan , Jinting Ren , Lei Qiao , Liang Liang

Federated learning is a powerful paradigm for large-scale machine learning, but it faces significant challenges due to unreliable network connections, slow communication, and substantial data heterogeneity across clients. FedAvg and…

Machine Learning · Computer Science 2024-03-06 Ziheng Cheng , Xinmeng Huang , Pengfei Wu , Kun Yuan

Federated learning (FL) is an emerging distributed training paradigm that aims to learn a common global model without exchanging or transferring the data that are stored locally at different clients. The Federated Averaging (FedAvg)-based…

Machine Learning · Computer Science 2024-02-20 Xiaolu Wang , Zijian Li , Shi Jin , Jun Zhang

Federated learning (FL) is a machine learning paradigm where a shared central model is learned across distributed edge devices while the training data remains on these devices. Federated Averaging (FedAvg) is the leading optimization method…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-22 Yujing Chen , Yue Ning , Martin Slawski , Huzefa Rangwala

Federated Learning (FL) models often experience client drift caused by heterogeneous data, where the distribution of data differs across clients. To address this issue, advanced research primarily focuses on manipulating the existing…

Machine Learning · Computer Science 2024-03-15 Zhenheng Tang , Yonggang Zhang , Shaohuai Shi , Xinmei Tian , Tongliang Liu , Bo Han , Xiaowen Chu

Federated learning enables many local devices to train a deep learning model jointly without sharing the local data. Currently, most of federated training schemes learns a global model by averaging the parameters of local models. However,…

Machine Learning · Computer Science 2021-10-26 Zhenwei Dai , Chen Dun , Yuxin Tang , Anastasios Kyrillidis , Anshumali Shrivastava

Heterogeneity arising from label distribution skew and data scarcity can cause inaccuracy and unfairness in intelligent communication applications that heavily rely on distributed computing. To deal with it, this paper proposes a novel…

Machine Learning · Computer Science 2025-09-18 Chenghao Huang , Xiaolu Chen , Yanru Zhang , Hao Wang

Federated learning is proposed as an alternative to centralized machine learning since its client-server structure provides better privacy protection and scalability in real-world applications. In many applications, such as smart homes with…

Machine Learning · Computer Science 2022-02-21 Yuchen Zhao , Payam Barnaghi , Hamed Haddadi

The Federated Learning setting has a central server coordinating the training of a model on a network of devices. One of the challenges is variable training performance when the dataset has a class imbalance. In this paper, we address this…

Machine Learning · Computer Science 2020-11-13 Dipankar Sarkar , Ankur Narang , Sumit Rai

A central challenge in training classification models in the real-world federated system is learning with non-IID data. To cope with this, most of the existing works involve enforcing regularization in local optimization or improving the…

Machine Learning · Computer Science 2021-10-29 Mi Luo , Fei Chen , Dapeng Hu , Yifan Zhang , Jian Liang , Jiashi Feng

Federated learning (FL) enhances data privacy with collaborative in-situ training on decentralized clients. Nevertheless, FL encounters challenges due to non-independent and identically distributed (non-i.i.d) data, leading to potential…

Machine Learning · Computer Science 2024-01-29 Weiming Zhuang , Lingjuan Lyu

Federated learning is an emerging distributed machine learning framework for privacy preservation. However, models trained in federated learning usually have worse performance than those trained in the standard centralized learning mode,…

Machine Learning · Computer Science 2021-06-15 Hangyu Zhu , Jinjin Xu , Shiqing Liu , Yaochu Jin

Federated Learning (FL) heavily depends on label quality for its performance. However, the label distribution among individual clients is always both noisy and heterogeneous. The high loss incurred by client-specific samples in…

Machine Learning · Computer Science 2024-03-26 Xinyuan Ji , Zhaowei Zhu , Wei Xi , Olga Gadyatskaya , Zilong Song , Yong Cai , Yang Liu

Due to the scarcity of industrial data, individual equipment users, particularly start-ups, struggle to independently train a comprehensive fault diagnosis model; federated learning enables collaborative training while ensuring data…

Artificial Intelligence · Computer Science 2026-04-10 Zexiao Wang , Yankai Wang , Xiaoqiang Liao , Xinguo Ming , Weiming Shen

Most existing federated learning methods assume that clients have fully labeled data to train on, while in reality, it is hard for the clients to get task-specific labels due to users' privacy concerns, high labeling costs, or lack of…

Machine Learning · Computer Science 2023-02-24 Nan Yang , Dong Yuan , Charles Z Liu , Yongkun Deng , Wei Bao

Federated Averaging remains the most widely used aggregation strategy in federated learning due to its simplicity and scalability. However, its performance degrades significantly in non-IID data settings, where client distributions are…

Machine Learning · Computer Science 2025-03-07 Marco Arazzi , Mert Cihangiroglu , Antonino Nocera