English
Related papers

Related papers: Neural Collapse Inspired Federated Learning with N…

200 papers

Federated Learning (FL) enables collaborative model training across distributed clients while preserving data privacy, but remains challenging when client data are highly heterogeneous. These challenges are further amplified in multi-label…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Can Peng , Yuyuan Liu , Yingyu Yang , Pramit Saha , Qianye Yang , J. Alison Noble

Federated Learning is an emerging learning paradigm that allows training models from samples distributed across a large network of clients while respecting privacy and communication restrictions. Despite its success, federated learning…

Machine Learning · Computer Science 2022-06-07 Isidoros Tziotis , Zebang Shen , Ramtin Pedarsani , Hamed Hassani , Aryan Mokhtari

Federated learning is a promising framework to train neural networks with widely distributed data. However, performance degrades heavily with heterogeneously distributed data. Recent work has shown this is due to the final layer of the…

Machine Learning · Computer Science 2024-03-06 Ha Min Son , Moon-Hyun Kim , Tai-Myoung Chung , Chao Huang , Xin Liu

Federated learning is a machine learning paradigm that leverages edge computing on client devices to optimize models while maintaining user privacy by ensuring that local data remains on the device. However, since all data is collected by…

Machine Learning · Computer Science 2025-06-11 Jingqiao Tang , Ryan Bausback , Feng Bao , Richard Archibald

With the growth of machine learning techniques, privacy of data of users has become a major concern. Most of the machine learning algorithms rely heavily on large amount of data which may be collected from various sources. Collecting these…

Machine Learning · Computer Science 2023-11-17 Mahfuzur Rahman Chowdhury , Muhammad Ibrahim

Federated Learning (FL) is a distributed learning paradigm where clients collaboratively train a model while keeping their own data private. With an increasing scale of clients and models, FL encounters two key challenges, client drift due…

Machine Learning · Computer Science 2025-01-20 Jianhui Sun , Xidong Wu , Heng Huang , Aidong Zhang

Federated Learning (FL) is a distributed learning paradigm that enables a large number of resource-limited nodes to collaboratively train a model without data sharing. The non-independent-and-identically-distributed (non-i.i.d.) data…

Machine Learning · Computer Science 2022-02-04 Hongda Wu , Ping Wang

We present a federated learning approach for learning a client adaptable, robust model when data is non-identically and non-independently distributed (non-IID) across clients. By simulating heterogeneous clients, we show that adding learned…

Machine Learning · Computer Science 2020-07-10 Laura Rieger , Rasmus M. Th. Høegh , Lars K. Hansen

The label distribution skew induced data heterogeniety has been shown to be a significant obstacle that limits the model performance in federated learning, which is particularly developed for collaborative model training over decentralized…

Machine Learning · Computer Science 2023-03-16 Jian Xu , Meiling Yang , Wenbo Ding , Shao-Lun Huang

We tackle the problem of Federated Learning in the non i.i.d. case, in which local models drift apart, inhibiting learning. Building on an analogy with Lifelong Learning, we adapt a solution for catastrophic forgetting to Federated…

Machine Learning · Computer Science 2019-10-18 Neta Shoham , Tomer Avidor , Aviv Keren , Nadav Israel , Daniel Benditkis , Liron Mor-Yosef , Itai Zeitak

Federated Learning (FL) enables collaborative model training across large-scale distributed service nodes while preserving data privacy, making it a cornerstone of intelligent service systems in edge-cloud environments. However, in…

Machine Learning · Computer Science 2026-02-03 Zhiwei Ling , Hailiang Zhao , Chao Zhang , Xiang Ao , Ziqi Wang , Cheng Zhang , Zhen Qin , Xinkui Zhao , Kingsum Chow , Yuanqing Wu , MengChu Zhou

Classical federated learning approaches yield significant performance degradation in the presence of Non-IID data distributions of participants. When the distribution of each local dataset is highly different from the global one, the local…

Machine Learning · Computer Science 2022-08-23 Mahdi Morafah , Saeed Vahidian , Weijia Wang , Bill Lin

Partially class-disjoint data (PCDD), a common yet under-explored data formation where each client contributes a part of classes (instead of all classes) of samples, severely challenges the performance of federated algorithms. Without full…

Machine Learning · Computer Science 2024-05-30 Ziqing Fan , Ruipeng Zhang , Jiangchao Yao , Bo Han , Ya Zhang , Yanfeng Wang

Federated Learning is a novel framework that allows multiple devices or institutions to train a machine learning model collaboratively while preserving their data private. This decentralized approach is prone to suffer the consequences of…

Machine Learning · Computer Science 2021-11-29 Marcos F. Criado , Fernando E. Casado , Roberto Iglesias , Carlos V. Regueiro , Senén Barro

Recently, federated learning has emerged as a promising approach for training a global model using data from multiple organizations without leaking their raw data. Nevertheless, directly applying federated learning to real-world tasks faces…

Machine Learning · Computer Science 2022-04-19 Bingzhe Wu , Zhipeng Liang , Yuxuan Han , Yatao Bian , Peilin Zhao , Junzhou Huang

Federated learning aims to train models collaboratively across different clients without the sharing of data for privacy considerations. However, one major challenge for this learning paradigm is the {\em data heterogeneity} problem, which…

Machine Learning · Computer Science 2024-04-09 Yujun Shi , Jian Liang , Wenqing Zhang , Vincent Y. F. Tan , Song Bai

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Online continual learning suffers from an underfitted solution due to insufficient training for prompt model update (e.g., single-epoch training). To address the challenge, we propose an efficient online continual learning method using the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Minhyuk Seo , Hyunseo Koh , Wonje Jeung , Minjae Lee , San Kim , Hankook Lee , Sungjun Cho , Sungik Choi , Hyunwoo Kim , Jonghyun Choi

Federated learning is a communication-efficient training process that alternates between local training at the edge devices and averaging the updated local model at the central server. Nevertheless, it is impractical to achieve a perfect…

Machine Learning · Computer Science 2019-11-04 Fan Ang , Li Chen , Nan Zhao , Yunfei Chen , Weidong Wang , F. Richard Yu

Federated learning is a distributed learning framework that takes full advantage of private data samples kept on edge devices. In real-world federated learning systems, these data samples are often decentralized and Non-Independently…

Machine Learning · Computer Science 2023-03-03 Dun Zeng , Xiangjing Hu , Shiyu Liu , Yue Yu , Qifan Wang , Zenglin Xu