English
Related papers

Related papers: Towards Fast and Stable Federated Learning: Confro…

200 papers

Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client…

Machine Learning · Computer Science 2021-08-13 Zihan Chen , Kai Fong Ernest Chong , Tony Q. S. Quek

Federated Learning (FL) has emerged as a promising distributed learning paradigm that enables multiple clients to learn a global model collaboratively without sharing their private data. However, the effectiveness of FL is highly dependent…

Machine Learning · Computer Science 2023-12-27 Zhongyi Cai , Ye Shi , Wei Huang , Jingya Wang

Federated learning offers a paradigm to the challenge of preserving privacy in distributed machine learning. However, datasets distributed across each client in the real world are inevitably heterogeneous, and if the datasets can be…

Machine Learning · Computer Science 2024-09-19 Xiuhua Lu , Peng Li , Xuefeng Jiang

Data heterogeneity among Federated Learning (FL) users poses a significant challenge, resulting in reduced global model performance. The community has designed various techniques to tackle this issue, among which Knowledge Distillation…

Machine Learning · Computer Science 2024-10-08 Momin Ahmad Khan , Yasra Chandio , Fatima Muhammad Anwar

Federated learning (FL), as a collaborative distributed training paradigm with several edge computing devices under the coordination of a centralized server, is plagued by inconsistent local stationary points due to the heterogeneity of the…

Systems and Control · Electrical Eng. & Systems 2023-02-14 Yixing Liu , Yan Sun , Zhengtao Ding , Li Shen , Bo Liu , Dacheng Tao

Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes…

Machine Learning · Computer Science 2022-06-07 Zhe Qu , Xingyu Li , Rui Duan , Yao Liu , Bo Tang , Zhuo Lu

Federated Learning (FL) is a machine learning paradigm that safeguards privacy by retaining client data on edge devices. However, optimizing FL in practice can be challenging due to the diverse and heterogeneous nature of the learning…

Machine Learning · Computer Science 2024-06-11 Yongxin Guo , Xiaoying Tang , Tao Lin

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Federated Learning (FL) is a rising approach towards collaborative and privacy-preserving machine learning where large-scale medical datasets remain localized to each client. However, the issue of data heterogeneity among clients often…

Machine Learning · Computer Science 2024-10-01 Shuang Zeng , Pengxin Guo , Shuai Wang , Jianbo Wang , Yuyin Zhou , Liangqiong Qu

The key premise of federated learning (FL) is to train ML models across a diverse set of data-owners (clients), without exchanging local data. An overarching challenge to this date is client heterogeneity, which may arise not only from…

Deep learning models are prone to forgetting information learned in the past when trained on new data. This problem becomes even more pronounced in the context of federated learning (FL), where data is decentralized and subject to…

Machine Learning · Computer Science 2023-07-19 Sara Babakniya , Zalan Fabian , Chaoyang He , Mahdi Soltanolkotabi , Salman Avestimehr

Federated learning is a popular paradigm for machine learning. Ideally, federated learning works best when all clients share a similar data distribution. However, it is not always the case in the real world. Therefore, the topic of…

Machine Learning · Computer Science 2022-12-20 Yuchuan Huang , Chen Hu

Federated learning is a decentralized collaborative training paradigm preserving stakeholders' data ownership while improving performance and generalization. However, statistical heterogeneity among client datasets degrades system…

Machine Learning · Computer Science 2025-09-09 Vasilis Siomos , Jonathan Passerat-Palmbach , Giacomo Tarroni

Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distributions, limiting its effectiveness in real-world deployments.…

Machine Learning · Computer Science 2025-04-22 Kun Zhai , Yifeng Gao , Difan Zou , Guangnan Ye , Siheng Chen , Xingjun Ma , Yu-Gang Jiang

We present a federated learning framework that is designed to robustly deliver good predictive performance across individual clients with heterogeneous data. The proposed approach hinges upon a superquantile-based learning objective that…

Machine Learning · Computer Science 2023-08-04 Krishna Pillutla , Yassine Laguel , Jérôme Malick , Zaid Harchaoui

In the federated learning setting, multiple clients jointly train a model under the coordination of the central server, while the training data is kept on the client to ensure privacy. Normally, inconsistent distribution of data across…

Machine Learning · Computer Science 2020-12-21 Wei Huang , Tianrui Li , Dexian Wang , Shengdong Du , Junbo Zhang

With the explosive growth of data, continual learning capability is increasingly important for neural networks. Due to catastrophic forgetting, neural networks inevitably forget the knowledge of old tasks after learning new ones. In visual…

Machine Learning · Computer Science 2024-02-26 Shengyang Huang , Jianwen Mo

Federated learning (FL) aims to collaboratively train a shared model across multiple clients without transmitting their local data. Data heterogeneity is a critical challenge in realistic FL settings, as it causes significant performance…

Machine Learning · Computer Science 2023-11-15 Yuwei Wang , Runhan Li , Hao Tan , Xuefeng Jiang , Sheng Sun , Min Liu , Bo Gao , Zhiyuan Wu

Federated learning is a distributed machine learning approach in which a single server and multiple clients collaboratively build machine learning models without sharing datasets on clients. A challenging issue of federated learning is data…

Machine Learning · Computer Science 2022-06-28 Koji Matsuda , Yuya Sasaki , Chuan Xiao , Makoto Onizuka

Federated Continual Learning (FCL) has recently emerged as a crucial research area, as data from distributed clients typically arrives as a stream, requiring sequential learning. This paper explores a more practical and challenging FCL…

Machine Learning · Computer Science 2025-06-17 Minh-Duong Nguyen , Le-Tuan Nguyen , Quoc-Viet Pham