English
Related papers

Related papers: Robust Knowledge Distillation in Federated Learnin…

200 papers

Federated Learning (FL) is a novel framework of decentralized machine learning. Due to the decentralized feature of FL, it is vulnerable to adversarial attacks in the training procedure, e.g. , backdoor attacks. A backdoor attack aims to…

Machine Learning · Computer Science 2022-08-15 Yifan Wang , Wei Fan , Keke Yang , Naji Alhusaini , Jing Li

Data heterogeneity among Federated Learning (FL) users poses a significant challenge, resulting in reduced global model performance. The community has designed various techniques to tackle this issue, among which Knowledge Distillation…

Machine Learning · Computer Science 2024-10-08 Momin Ahmad Khan , Yasra Chandio , Fatima Muhammad Anwar

This paper proposes an ensemble learning model that is resistant to adversarial attacks. To build resilience, we introduced a training process where each member learns a radically distinct latent space. Member models are added one at a time…

Image and Video Processing · Electrical Eng. & Systems 2021-01-08 Ali Mirzaeian , Jana Kosecka , Houman Homayoun , Tinoosh Mohsenin , Avesta Sasan

Benefiting from well-trained deep neural networks (DNNs), model compression have captured special attention for computing resource limited equipment, especially edge devices. Knowledge distillation (KD) is one of the widely used compression…

Machine Learning · Computer Science 2024-06-06 Jinyin Chen , Xiaoming Zhao , Haibin Zheng , Xiao Li , Sheng Xiang , Haifeng Guo

The robustness of federated learning (FL) is vital for the distributed training of an accurate global model that is shared among large number of clients. The collaborative learning framework by typically aggregating model updates is…

Federated Learning (FL) is a distributed and privacy-preserving machine learning paradigm that coordinates multiple clients to train a model while keeping the raw data localized. However, this traditional FL poses some challenges, including…

Machine Learning · Computer Science 2026-05-12 Laiqiao Qin , Tianqing Zhu , Wanlei Zhou , Philip S. Yu

Federated learning allows clients to collaboratively train a global model without uploading raw data for privacy preservation. This feature, i.e., the inability to review participants' datasets, has recently been found responsible for…

Machine Learning · Computer Science 2023-12-19 Yihang Lin , Pengyuan Zhou , Zhiqian Wu , Yong Liao

Federated Learning (FL) is a promising approach enabling multiple clients to train Deep Neural Networks (DNNs) collaboratively without sharing their local training data. However, FL is susceptible to backdoor (or targeted poisoning)…

Cryptography and Security · Computer Science 2023-08-23 Phillip Rieger , Torsten Krauß , Markus Miettinen , Alexandra Dmitrienko , Ahmad-Reza Sadeghi

Federated Learning (FL) as a distributed learning paradigm that aggregates information from diverse clients to train a shared global model, has demonstrated great success. However, malicious clients can perform poisoning attacks and model…

Machine Learning · Computer Science 2021-06-16 Chulin Xie , Minghao Chen , Pin-Yu Chen , Bo Li

Federated Learning (FL) has emerged as a prominent alternative to the traditional centralized learning approach. Generally speaking, FL is a decentralized approach that allows for collaborative training of Machine Learning (ML) models…

Machine Learning · Computer Science 2024-03-19 S. Jamal Seyedmohammadi , S. Kawa Atapour , Jamshid Abouei , Arash Mohammadi

Federated learning is a prominent framework that enables clients (e.g., mobile devices or organizations) to train a collaboratively global model under a central server's orchestration while keeping local training datasets' privacy. However,…

Machine Learning · Computer Science 2021-07-20 Farnaz Tahmasebian , Jian Lou , Li Xiong

Federated Learning (FL) is a popular distributed machine learning paradigm that enables jointly training a global model without sharing clients' data. However, its repetitive server-client communication gives room for backdoor attacks with…

Machine Learning · Computer Science 2023-01-20 Pei Fang , Jinghui Chen

Federated Learning (FL) is designed to protect the data privacy of each client during the training process by transmitting only models instead of the original data. However, the trained model may memorize certain information about the…

Machine Learning · Computer Science 2022-01-25 Chen Wu , Sencun Zhu , Prasenjit Mitra

Federated learning (FL) operates in heterogeneous environments, where variations in data distributions and asymmetric model design often result in negative transfer. While federated knowledge distillation (FKD) avoids direct model parameter…

Machine Learning · Computer Science 2026-05-08 Quang-Huy Nguyen , Jiaqi Wang , Wei-shinn Ku

Knowledge distillation (KD) is one of the most potent ways for model compression. The key idea is to transfer the knowledge from a deep teacher model (T) to a shallower student (S). However, existing methods suffer from performance…

Machine Learning · Computer Science 2020-02-24 Mengya Gao , Yujun Shen , Quanquan Li , Chen Change Loy

Federated learning (FL) is a distributed training technology that enhances data privacy in mobile edge networks by allowing data owners to collaborate without transmitting raw data to the edge server. However, data heterogeneity and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yu Qiao , Apurba Adhikary , Kitae Kim , Eui-Nam Huh , Zhu Han , Choong Seon Hong

In recent years, federated learning (FL) has emerged as a promising technique for training machine learning models in a decentralized manner while also preserving data privacy. The non-independent and identically distributed (non-i.i.d.)…

Machine Learning · Computer Science 2024-02-15 Yousef Alsenani , Rahul Mishra , Khaled R. Ahmed , Atta Ur Rahman

While federated learning is promising for privacy-preserving collaborative learning without revealing local data, it remains vulnerable to white-box attacks and struggles to adapt to heterogeneous clients. Federated distillation (FD), built…

Machine Learning · Computer Science 2023-12-18 Jiawei Shao , Fangzhao Wu , Jun Zhang

As a distributed machine learning paradigm, Federated Learning (FL) enables large-scale clients to collaboratively train a model without sharing their raw data. However, due to the lack of data auditing for untrusted clients, FL is…

Machine Learning · Computer Science 2025-09-10 Yanxin Yang , Ming Hu , Xiaofei Xie , Yue Cao , Pengyu Zhang , Yihao Huang , Mingsong Chen

As a special type of multimedia data, Lithography Hotspot Detection (LHD) training often requires stronger privacy protection than conventional multimedia data, and federated learning provides a promising potential solution to this…

Machine Learning · Computer Science 2026-05-01 Yuqi Li , Xingyou Lin , Yanli Li , Kai Zhang , Chuanguang Yang , Zhongliang Guo , Jianping Gou , Tingwen Huang , Yingli Tian
‹ Prev 1 2 3 10 Next ›