English
Related papers

Related papers: Dataset Distillation-based Hybrid Federated Learni…

200 papers

Federated learning (FL) and federated distillation (FD) are distributed learning paradigms that train UE models with enhanced privacy, each offering different trade-offs between noise robustness and learning speed. To mitigate their…

Machine Learning · Computer Science 2026-01-09 Yongjun Kim , Hyeongjun Park , Hwanjin Kim , Junil Choi

Federated learning is designed to enhance data security and privacy, but faces challenges when dealing with heterogeneous data in long-tailed and non-IID distributions. This paper explores an overlooked scenario where tail classes are…

Machine Learning · Computer Science 2024-03-14 Zhuoxin Chen , Zhenyu Wu , Yang Ji

Federated learning is an important privacy-preserving multi-party learning paradigm, involving collaborative learning with others and local updating on private data. Model heterogeneity and catastrophic forgetting are two crucial…

Machine Learning · Computer Science 2023-09-29 Wenke Huang , Mang Ye , Zekun Shi , Bo Du

Federated learning (FL) is a rapidly growing privacy-preserving collaborative machine learning paradigm. In practical FL applications, local data from each data silo reflect local usage patterns. Therefore, there exists heterogeneity of…

Machine Learning · Computer Science 2022-02-01 Shenglai Zeng , Zonghang Li , Hongfang Yu , Yihong He , Zenglin Xu , Dusit Niyato , Han Yu

Federated learning enables edge devices to collaboratively train a global model while maintaining data privacy by keeping data localized. However, the Non-IID nature of data distribution across devices often hinders model convergence and…

Machine Learning · Computer Science 2025-11-25 Youngjoon Lee , Jinu Gong , Joonhyuk Kang

Federated Learning (FL) enables collaborative model training across decentralized devices while preserving data privacy. However, real-world FL deployments face critical challenges such as data imbalances, including label noise and non-IID…

Machine Learning · Computer Science 2026-01-13 Siqi Zhu , Joshua D. Kaggie

Federated learning (FL) offers a privacy-preserving approach to machine learning for multiple collaborators without sharing raw data. However, the existence of non-independent and non-identically distributed (non-IID) datasets across…

Cryptography and Security · Computer Science 2024-06-17 Yuping Yan , Yizhi Wang , Yingchao Yu , Yaochu Jin

Empirical studies show that federated learning exhibits convergence issues in Non Independent and Identically Distributed (IID) setups. However, these studies only focus on label distribution shifts, or concept shifts (e.g. ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Matthis Manthe , Carole Lartizien , Stefan Duffner

On-device machine learning (ML) enables the training process to exploit a massive amount of user-generated private data samples. To enjoy this benefit, inter-device communication overhead should be minimized. With this end, we propose…

Machine Learning · Computer Science 2023-10-20 Eunjeong Jeong , Seungeun Oh , Hyesung Kim , Jihong Park , Mehdi Bennis , Seong-Lyun Kim

In the realm of real-world devices, centralized servers in Federated Learning (FL) present challenges including communication bottlenecks and susceptibility to a single point of failure. Additionally, contemporary devices inherently exhibit…

Machine Learning · Computer Science 2024-08-15 Yasser H. Khalil , Amir H. Estiri , Mahdi Beitollahi , Nader Asadi , Sobhan Hemati , Xu Li , Guojun Zhang , Xi Chen

Federated Reinforcement Learning (FedRL) improves sample efficiency while preserving privacy; however, most existing studies assume homogeneous agents, limiting its applicability in real-world scenarios. This paper investigates FedRL in…

Machine Learning · Computer Science 2025-02-04 Wenzheng Jiang , Ji Wang , Xiongtao Zhang , Weidong Bao , Cheston Tan , Flint Xiaofeng Fan

Federated learning is a paradigm of joint learning in which clients collaborate by sharing model parameters instead of data. However, in the non-iid setting, the global model experiences client drift, which can seriously affect the final…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jiaze Li , Haoran Xu , Wanyi Wu , Changwei Wang , Shuaiguang Li , Jianzhong Ju , Zhenbo Luo , Jian Luan , Youyang Qu , Longxiang Gao , Xudong Yang , Lumin Xing

With the rapid development of low-cost consumer electronics and cloud computing, Internet-of-Things (IoT) devices are widely adopted for supporting next-generation distributed systems such as smart cities and industrial control systems. IoT…

Cryptography and Security · Computer Science 2024-01-23 Jiyuan Shen , Wenzhuo Yang , Zhaowei Chu , Jiani Fan , Dusit Niyato , Kwok-Yan Lam

Federated learning (FL) enables collaboratively training a model while keeping the training data decentralized and private. However, one significant impediment to training a model using FL, especially large models, is the resource…

Machine Learning · Computer Science 2023-12-12 Seyed Mahmoud Sajjadi Mohammadabadi , Syed Zawad , Feng Yan , Lei Yang

Federated learning (FL) is an important paradigm for training global models from decentralized data in a privacy-preserving way. Existing FL methods usually assume the global model can be trained on any participating client. However, in…

Machine Learning · Computer Science 2022-07-19 Ruixuan Liu , Fangzhao Wu , Chuhan Wu , Yanlin Wang , Lingjuan Lyu , Hong Chen , Xing Xie

Federated learning is a novel decentralized learning architecture. During the training process, the client and server must continuously upload and receive model parameters, which consumes a lot of network transmission resources. Some…

Machine Learning · Computer Science 2025-04-14 Yan-Ann Chen , Guan-Lin Chen

Federated learning (FL) enables distributed training while preserving data privacy, but stragglers-slow or incapable clients-can significantly slow down the total training time and degrade performance. To mitigate the impact of stragglers,…

Machine Learning · Computer Science 2024-09-11 Honggu Kang , Seohyeon Cha , Jinwoo Shin , Jongmyeong Lee , Joonhyuk Kang

As Federated Learning (FL) expands, the challenge of non-independent and identically distributed (non-IID) data becomes critical. Clustered Federated Learning (CFL) addresses this by training multiple specialized models, each representing a…

Machine Learning · Statistics 2026-01-21 Michael Ben Ali , Omar El-Rifai , Imen Megdiche , André Peninou , Olivier Teste

Federated learning (FL) is a distributed training technology that enhances data privacy in mobile edge networks by allowing data owners to collaborate without transmitting raw data to the edge server. However, data heterogeneity and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yu Qiao , Apurba Adhikary , Kitae Kim , Eui-Nam Huh , Zhu Han , Choong Seon Hong

Federated learning (FL) is a distributed learning methodology that allows multiple nodes to cooperatively train a deep learning model, without the need to share their local data. It is a promising solution for telemonitoring systems that…

Machine Learning · Computer Science 2021-07-15 Alaa Awad Abdellatif , Naram Mhaisen , Amr Mohamed , Aiman Erbad , Mohsen Guizani , Zaher Dawy , Wassim Nasreddine