English
Related papers

Related papers: Robust Knowledge Distillation in Federated Learnin…

200 papers

Federated Learning (FL) seeks to train a model collaboratively without sharing private training data from individual clients. Despite its promise, FL encounters challenges such as high communication costs for large-scale models and the…

Machine Learning · Computer Science 2024-04-15 Lin Li , Jianping Gou , Baosheng Yu , Lan Du , Zhang Yiand Dacheng Tao

Federated Learning (FL) allows multiple clients to collaboratively train a Neural Network (NN) model on their private data without revealing the data. Recently, several targeted poisoning attacks against FL have been introduced. These…

Cryptography and Security · Computer Science 2022-01-04 Phillip Rieger , Thien Duc Nguyen , Markus Miettinen , Ahmad-Reza Sadeghi

Federated Learning (FL) is a decentralized machine learning method that enables participants to collaboratively train a model without sharing their private data. Despite its privacy and scalability benefits, FL is susceptible to backdoor…

Cryptography and Security · Computer Science 2024-09-11 Yujie Zhang , Neil Gong , Michael K. Reiter

Knowledge Distillation (KD) is essential for compressing large models, yet relying on pre-trained "teacher" models downloaded from third-party repositories introduces serious security risks--most notably backdoor attacks. Existing KD…

Cryptography and Security · Computer Science 2026-05-26 Shanmin Wang , Dongdong Zhao

The improvement in the performance of efficient and lightweight models (i.e., the student model) is achieved through knowledge distillation (KD), which involves transferring knowledge from more complex models (i.e., the teacher model).…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Seonghak Kim , Gyeongdo Ham , Yucheol Cho , Daeshik Kim

Federated Learning (FL) is a distributed machine learning paradigm which coordinates multiple clients to collaboratively train a global model via a central server. Sequential Federated Learning (SFL) is a newly-emerging FL training…

Machine Learning · Computer Science 2025-07-14 Haotian Xu , Jinrui Zhou , Xichong Zhang , Mingjun Xiao , He Sun , Yin Xu

Federated learning is a distributed framework designed to address privacy concerns. However, it introduces new attack surfaces, which are especially prone when data is non-Independently and Identically Distributed. Existing approaches fail…

Cryptography and Security · Computer Science 2025-05-27 Hyejun Jeong , Hamin Son , Seohu Lee , Jayun Hyun , Tai-Myoung Chung

Federated learning is vulnerable to various attacks, such as model poisoning and backdoor attacks, even if some existing defense strategies are used. To address this challenge, we propose an attack-adaptive aggregation strategy to defend…

Machine Learning · Computer Science 2021-08-09 Ching Pui Wan , Qifeng Chen

Federated learning enables thousands of participants to construct a deep learning model without sharing their private training data with each other. For example, multiple smartphones can jointly train a next-word predictor for keyboards…

Cryptography and Security · Computer Science 2019-08-07 Eugene Bagdasaryan , Andreas Veit , Yiqing Hua , Deborah Estrin , Vitaly Shmatikov

Federated Learning is an emerging privacy-preserving distributed machine learning approach to building a shared model by performing distributed training locally on participating devices (clients) and aggregating the local models into a…

Machine Learning · Computer Science 2021-04-15 Sreya Francis , Irene Tenison , Irina Rish

Federated learning is a distributed learning paradigm that facilitates the collaborative training of a global model across multiple clients while preserving the privacy of local datasets. To address inherent challenges related to data…

Cryptography and Security · Computer Science 2025-06-03 Chengcheng Zhu , Jiale Zhang , Di Wu , Guodong Long

Federated learning enables training high-utility models across several clients without directly sharing their private data. As a downside, the federated setting makes the model vulnerable to various adversarial attacks in the presence of…

Machine Learning · Computer Science 2024-03-12 Xiaoyang Wang , Dimitrios Dimitriadis , Sanmi Koyejo , Shruti Tople

Federated Learning (FL) algorithms using Knowledge Distillation (KD) have received increasing attention due to their favorable properties with respect to privacy, non-i.i.d. data and communication cost. These methods depart from…

Machine Learning · Computer Science 2025-03-18 Christophe Roux , Max Zimmer , Sebastian Pokutta

Knowledge distillation (KD) is a vital technique for deploying deep neural networks (DNNs) on resource-constrained devices by transferring knowledge from large teacher models to lightweight student models. While teacher models from…

Cryptography and Security · Computer Science 2025-09-30 Yukun Chen , Boheng Li , Yu Yuan , Leyi Qi , Yiming Li , Tianwei Zhang , Zhan Qin , Kui Ren

Federated learning (FL) is a distributed machine learning paradigm where enormous scattered clients (e.g. mobile devices or IoT devices) collaboratively train a model under the orchestration of a central server (e.g. service provider),…

Cryptography and Security · Computer Science 2022-01-12 Yongkang Wang , Dihua Zhai , Yufeng Zhan , Yuanqing Xia

Collaborative learning has emerged as a key paradigm in large-scale intelligent systems, enabling distributed agents to cooperatively train their models while addressing their privacy concerns. Central to this paradigm is knowledge…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-24 Pengchao Han , Xi Huang , Yi Fang , Guojun Han

Due to its distributed methodology alongside its privacy-preserving features, Federated Learning (FL) is vulnerable to training time adversarial attacks. In this study, our focus is on backdoor attacks in which the adversary's goal is to…

Machine Learning · Computer Science 2021-02-11 Omid Aramoon , Pin-Yu Chen , Gang Qu , Yuan Tian

Federated Learning (FL) facilitates collaborative model training among distributed clients while ensuring that raw data remains on local devices.Despite this advantage, FL systems are still exposed to risks from malicious or unreliable…

Cryptography and Security · Computer Science 2026-01-30 Deepthy K Bhaskar , Minimol B , Binu V P

Federated learning (FL) is a machine learning (ML) approach that allows the use of distributed data without compromising personal privacy. However, the heterogeneous distribution of data among clients in FL can make it difficult for the…

Machine Learning · Computer Science 2023-03-07 Thuy Dung Nguyen , Tuan Nguyen , Phi Le Nguyen , Hieu H. Pham , Khoa Doan , Kok-Seng Wong

Recently, innovative model aggregation methods based on knowledge distillation (KD) have been proposed for federated learning (FL). These methods not only improved the robustness of model aggregation over heterogeneous learning environment,…

Machine Learning · Computer Science 2023-12-29 Ho Man Kwan , Shenghui Song