English
Related papers

Related papers: Data-Free Knowledge Distillation for Heterogeneous…

200 papers

As privacy concerns continue to grow, federated learning (FL) has gained significant attention as a promising privacy-preserving technology, leading to considerable advancements in recent years. Unlike traditional machine learning, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-05 Boyu Fan , Siyang Jiang , Xiang Su , Sasu Tarkoma , Pan Hui

While existing federated learning approaches primarily focus on aggregating local models to construct a global model, in realistic settings, some clients may be reluctant to share their private models due to the inclusion of…

Machine Learning · Computer Science 2025-07-01 Lingzhi Gao , Zhenyuan Zhang , Chao Wu

Federated learning (FL) is a privacy-preserving collaboratively machine learning paradigm. Traditional FL requires all data owners (a.k.a. FL clients) to train the same local model. This design is not well-suited for scenarios involving…

Machine Learning · Computer Science 2024-04-22 Liping Yi , Han Yu , Zhuan Shi , Gang Wang , Xiaoguang Liu , Lizhen Cui , Xiaoxiao Li

Traditionally, federated learning (FL) aims to train a single global model while collaboratively using multiple clients and a server. Two natural challenges that FL algorithms face are heterogeneity in data across clients and collaboration…

Machine Learning · Computer Science 2022-07-06 Kaan Ozkara , Navjot Singh , Deepesh Data , Suhas Diggavi

Federated learning (FL) is a distributed training paradigm that enables collaborative learning across clients without sharing local data, thereby preserving privacy. However, the increasing scale and complexity of modern deep models often…

Machine Learning · Computer Science 2025-05-20 Honggu Kang , Seohyeon Cha , Joonhyuk Kang

In federated learning, the heterogeneity of client data has a great impact on the performance of model training. Many heterogeneity issues in this process are raised by non-independently and identically distributed (non-IID) data. To…

Machine Learning · Computer Science 2026-03-25 Xiufang Shi , Wei Zhang , Yuheng Li , Mincheng Wu , Zhenyu Wen , Shibo He , Tejal Shah , Rajiv Ranjan

The robustness of federated learning (FL) is vital for the distributed training of an accurate global model that is shared among large number of clients. The collaborative learning framework by typically aggregating model updates is…

Federated learning (FL) is a decentralized learning paradigm widely adopted in resource-constrained Internet of Things (IoT) environments. These devices, typically relying on TinyML models, collaboratively train global models by sharing…

Machine Learning · Computer Science 2026-02-10 Pouria Arefijamal , Mahdi Ahmadlou , Bardia Safaei , Jörg Henkel

Federated learning (FL) aims to train models collaboratively across clients without sharing data for privacy-preserving. However, one major challenge is the data heterogeneity issue, which refers to the biased labeling preferences at…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Huan Wang , Haoran Li , Huaming Chen , Jun Yan , Jiahua Shi , Jun Shen

The increasing demand for intelligent services and privacy protection of mobile and Internet of Things (IoT) devices motivates the wide application of Federated Edge Learning (FEL), in which devices collaboratively train on-device Machine…

Machine Learning · Computer Science 2024-03-06 Zhiyuan Wu , Sheng Sun , Yuwei Wang , Min Liu , Xuefeng Jiang , Runhan Li , Bo Gao

With an increasing number of smart devices like internet of things (IoT) devices deployed in the field, offloadingtraining of neural networks (NNs) to a central server becomes more and more infeasible. Recent efforts toimprove users'…

Machine Learning · Computer Science 2023-07-19 Kilian Pfeiffer , Martin Rapp , Ramin Khalili , Jörg Henkel

Federated Learning (FL) has surged in prominence due to its capability of collaborative model training without direct data sharing. However, the vast disparity in local data distributions among clients, often termed the Non-Independent…

Machine Learning · Computer Science 2024-12-12 Zheshun Wu , Zenglin Xu , Dun Zeng , Qifan Wang , Jie Liu

Federated learning (FL) refers to a distributed machine learning framework involving learning from several decentralized edge clients without sharing local dataset. This distributed strategy prevents data leakage and enables on-device…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-28 Taki Hasan Rafi , Faiza Anan Noor , Tahmid Hussain , Dong-Kyu Chae , Zhaohui Yang

Cooperative training methods for distributed machine learning are typically based on the exchange of local gradients or local model parameters. The latter approach is known as Federated Learning (FL). An alternative solution with reduced…

Signal Processing · Electrical Eng. & Systems 2020-02-05 Jin-Hyun Ahn , Osvaldo Simeone , Joonhyuk Kang

To eliminate the requirement of fully-labeled data for supervised model training in traditional Federated Learning (FL), extensive attention has been paid to the application of Self-supervised Learning (SSL) approaches on FL to tackle the…

Machine Learning · Computer Science 2022-11-15 Yi Liu , Song Guo , Jie Zhang , Qihua Zhou , Yingchun Wang , Xiaohan Zhao

In recent years, One-shot Federated Learning methods based on Diffusion Models have garnered increasing attention due to their remarkable performance. However, most of these methods require the deployment of foundation models on client…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Mingzhao Yang , Shangchao Su , Bin Li , Xiangyang Xue

Knowledge distillation has recently become popular as a method of model aggregation on the server for federated learning. It is generally assumed that there are abundant public unlabeled data on the server. However, in reality, there exists…

Machine Learning · Computer Science 2022-10-06 Shangchao Su , Bin Li , Xiangyang Xue

Federated Learning(FL) is popular as a privacy-preserving machine learning paradigm for generating a single model on decentralized data. However, statistical heterogeneity poses a significant challenge for FL. As a subfield of FL,…

Machine Learning · Computer Science 2024-10-22 Keting Yin , Jiayi Mao

Federated Learning (FL) enables multiple clients to collaboratively learn in a distributed way, allowing for privacy protection. However, the real-world non-IID data will lead to client drift which degrades the performance of FL.…

Machine Learning · Computer Science 2023-08-22 Yunlu Yan , Chun-Mei Feng , Mang Ye , Wangmeng Zuo , Ping Li , Rick Siow Mong Goh , Lei Zhu , C. L. Philip Chen

Federated Learning(FL) is a privacy-preserving machine learning paradigm where a global model is trained in-situ across a large number of distributed edge devices. These systems are often comprised of millions of user devices and only a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-05 Yuanli Wang , Lei Huang