English
Related papers

Related papers: Federated Distillation on Edge Devices: Efficient …

200 papers

With the rapid expansion of edge devices, such as IoT devices, where crucial data needed for machine learning applications is generated, it becomes essential to promote their participation in privacy-preserving Federated Learning (FL)…

Machine Learning · Computer Science 2025-01-03 Hongrui Shi , Valentin Radu , Po Yang

Heterogeneity of data distributed across clients limits the performance of global models trained through federated learning, especially in the settings with highly imbalanced class distributions of local datasets. In recent years,…

Machine Learning · Computer Science 2023-04-11 Huancheng Chen , Johnny , Wang , Haris Vikalo

Federated learning provides a privacy-preserving manner to collaboratively train models on data distributed over multiple local clients via the coordination of a global server. In this paper, we focus on label distribution skew in federated…

Machine Learning · Computer Science 2024-09-23 Jianghu Lu , Shikun Li , Kexin Bao , Pengju Wang , Zhenxing Qian , Shiming Ge

With the rapid development of low-cost consumer electronics and cloud computing, Internet-of-Things (IoT) devices are widely adopted for supporting next-generation distributed systems such as smart cities and industrial control systems. IoT…

Cryptography and Security · Computer Science 2024-01-23 Jiyuan Shen , Wenzhuo Yang , Zhaowei Chu , Jiani Fan , Dusit Niyato , Kwok-Yan Lam

Federated learning enables multiple clients to collaboratively learn a global model by periodically aggregating the clients' models without transferring the local data. However, due to the heterogeneity of the system and data, many…

Machine Learning · Computer Science 2021-09-14 Dezhong Yao , Wanning Pan , Yutong Dai , Yao Wan , Xiaofeng Ding , Hai Jin , Zheng Xu , Lichao Sun

Cooperative training methods for distributed machine learning typically assume noiseless and ideal communication channels. This work studies some of the opportunities and challenges arising from the presence of wireless communication links.…

Information Theory · Computer Science 2019-07-08 Jin-Hyun Ahn , Osvaldo Simeone , Joonhyuk Kang

Federated learning has become a promising solution for collaboration among medical institutions. However, data owned by each institution would be highly heterogeneous and the distribution is always non-independent and identical distribution…

Machine Learning · Computer Science 2024-12-25 Guochen Yan , Luyuan Xie , Xinyi Gao , Wentao Zhang , Qingni Shen , Yuejian Fang , Zhonghai Wu

In this paper, cyber-attack prevention for the prosumer-based electric vehicle (EV) charging stations (EVCSs) is investigated, which covers two aspects: 1) cyber-attack detection on prosumers' network traffic (NT) data, and 2) cyber-attack…

Cryptography and Security · Computer Science 2024-12-18 Luyao Zou , Quang Hieu Vo , Kitae Kim , Huy Q. Le , Chu Myaet Thwal , Chaoning Zhang , Choong Seon Hong

Federated learning (FL) operates in heterogeneous environments, where variations in data distributions and asymmetric model design often result in negative transfer. While federated knowledge distillation (FKD) avoids direct model parameter…

Machine Learning · Computer Science 2026-05-08 Quang-Huy Nguyen , Jiaqi Wang , Wei-shinn Ku

Dataset Distillation (DD) is a powerful technique for reducing large datasets into compact, representative synthetic datasets, accelerating Machine Learning training. However, traditional DD methods operate in a centralized manner, which…

Cryptography and Security · Computer Science 2025-03-07 Marco Arazzi , Mert Cihangiroglu , Serena Nicolazzo , Antonino Nocera

Federated Learning (FL) is a promising technique for the collaborative training of deep neural networks across multiple devices while preserving data privacy. Despite its potential benefits, FL is hindered by excessive communication costs…

Machine Learning · Computer Science 2024-02-27 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi , Nirvana Meratnia

Federated learning (FL) supports distributed training of a global machine learning model across multiple devices with the help of a central server. However, data heterogeneity across different devices leads to the client model drift issue…

Machine Learning · Computer Science 2023-10-06 Xu Zhou , Xinyu Lei , Cong Yang , Yichun Shi , Xiao Zhang , Jingwen Shi

Federated Edge Learning (FEL) has emerged as a promising approach for enabling edge devices to collaboratively train machine learning models while preserving data privacy. Despite its advantages, practical FEL deployment faces significant…

Machine Learning · Computer Science 2024-10-15 Quyang Pan , Sheng Sun , Zhiyuan Wu , Yuwei Wang , Min Liu , Bo Gao , Jingyuan Wang

Federated learning (FL) offers a privacy-preserving paradigm for machine learning, but its application in intrusion detection systems (IDS) within IoT networks is challenged by severe class imbalance, non-IID data, and high communication…

Machine Learning · Computer Science 2025-10-28 Gurpreet Singh , Keshav Sood , P. Rajalakshmi , Yong Xiang

Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy…

Machine Learning · Computer Science 2023-10-12 Zhiqin Yang , Yonggang Zhang , Yu Zheng , Xinmei Tian , Hao Peng , Tongliang Liu , Bo Han

Knowledge Distillation (KD) aims to transfer knowledge in a teacher-student framework, by providing the predictions of the teacher network to the student network in the training stage to help the student network generalize better. It can…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 SeongUk Park , Nojun Kwak

While existing federated learning approaches primarily focus on aggregating local models to construct a global model, in realistic settings, some clients may be reluctant to share their private models due to the inclusion of…

Machine Learning · Computer Science 2025-07-01 Lingzhi Gao , Zhenyuan Zhang , Chao Wu

Federated Learning (FL) presents significant potential for collaborative optimization without data sharing. Since synthetic data is sent to the server, leveraging the popular concept of dataset distillation, this FL framework protects real…

Machine Learning · Computer Science 2025-10-29 Haozhi Shi , Weiying Xie , Hangyu Ye , Daixun Li , Jitao Ma , Yunsong Li , Leyuan Fang

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

Machine Learning · Computer Science 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

Personalized Federated Learning (PFL) focuses on tailoring models to individual IIoT clients in federated learning by addressing data heterogeneity and diverse user needs. Although existing studies have proposed effective PFL solutions from…

Artificial Intelligence · Computer Science 2024-12-03 Yingchao Wang , Wenqi Niu