English
Related papers

Related papers: A Knowledge Distillation-Based Backdoor Attack in …

200 papers

Large pre-trained transformer-based language models have achieved impressive results on a wide range of NLP tasks. In the past few years, Knowledge Distillation(KD) has become a popular paradigm to compress a computationally expensive model…

Computation and Language · Computer Science 2020-10-13 Xinyin Ma , Yongliang Shen , Gongfan Fang , Chen Chen , Chenghao Jia , Weiming Lu

Vertical federated learning (VFL) is a cloud-edge collaboration paradigm that enables edge nodes, comprising resource-constrained Internet of Things (IoT) devices, to cooperatively train artificial intelligence (AI) models while retaining…

Machine Learning · Computer Science 2023-04-25 Peng Chen , Xin Du , Zhihui Lu , Hongfeng Chai

Federated Learning (FL) is a collaborative machine learning technique where multiple clients work together with a central server to train a global model without sharing their private data. However, the distribution shift across non-IID…

Machine Learning · Computer Science 2024-06-11 Xiaoting Lyu , Yufei Han , Wei Wang , Jingkai Liu , Yongsheng Zhu , Guangquan Xu , Jiqiang Liu , Xiangliang Zhang

The distributed nature of training makes Federated Learning (FL) vulnerable to backdoor attacks, where malicious model updates aim to compromise the global model's performance on specific tasks. Existing defense methods show limited…

Machine Learning · Computer Science 2025-03-20 Jiahao Xu , Zikai Zhang , Rui Hu

In a practical setting, how to enable robust Federated Learning (FL) systems, both in terms of generalization and personalization abilities, is one important research question. It is a challenging issue due to the consequences of non-i.i.d.…

Machine Learning · Computer Science 2024-12-04 Huy Q. Le , Minh N. H. Nguyen , Shashi Raj Pandey , Chaoning Zhang , Choong Seon Hong

Online Knowledge Distillation (KD) is recently highlighted to train large models in Federated Learning (FL) environments. Many existing studies adopt the logit ensemble method to perform KD on the server side. However, they often assume…

Machine Learning · Computer Science 2026-01-09 Jihyun Lim , Junhyuk Jo , Tuo Zhang , Sunwoo Lee

Existing research primarily focuses on backdoor attacks and defenses within the generic federated learning scenario, where all clients collaborate to train a single global model. A recent study conducted by Qin et al. (2023) marks the…

Cryptography and Security · Computer Science 2024-04-09 Tiandi Ye , Cen Chen , Yinggui Wang , Xiang Li , Ming Gao

Vertical federated learning (VFL) system has recently become prominent as a concept to process data distributed across many individual sources without the need to centralize it. Multiple participants collaboratively train models based on…

Cryptography and Security · Computer Science 2024-11-14 Qi Pang , Yuanyuan Yuan , Shuai Wang , Wenting Zheng

Federated learning (FL) is a popular distributed learning paradigm in machine learning, which enables multiple clients to collaboratively train models under the guidance of a server without exposing private client data. However, FL's…

Machine Learning · Computer Science 2026-05-01 Zehui Tang , Yuchen Liu , Feihu Huang

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

Machine Learning · Computer Science 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

The growth of the Internet of Things has amplified the need for secure data interactions in cloud-edge ecosystems, where sensitive information is constantly processed across various system layers. Intrusion detection systems are commonly…

Cryptography and Security · Computer Science 2025-04-16 Soad Almabdy , Amjad Ullah

Federated learning (FL) has become an emerging machine learning technique lately due to its efficacy in safeguarding the client's confidential information. Nevertheless, despite the inherent and additional privacy-preserving mechanisms…

Cryptography and Security · Computer Science 2021-09-22 Md Tamjid Hossain , Shafkat Islam , Shahriar Badsha , Haoting Shen

Federated Distillation (FD) offers an innovative approach to distributed machine learning, leveraging knowledge distillation for efficient and flexible cross-device knowledge transfer without necessitating the upload of extensive model…

Machine Learning · Computer Science 2024-07-26 Yuhan Tang , Aoxu Zhang , Zhiyuan Wu , Bo Gao , Tian Wen , Yuwei Wang , Sheng Sun

Federated Learning (FL) is a distributed machine learning scheme in which clients jointly participate in the collaborative training of a global model by sharing model information rather than their private datasets. In light of concerns…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Kangyang Luo , Shuai Wang , Yexuan Fu , Renrong Shao , Xiang Li , Yunshi Lan , Ming Gao , Jinlong Shu

Federated Learning (FL) has emerged as a machine learning approach able to preserve the privacy of user's data. Applying FL, clients train machine learning models on a local dataset and a central server aggregates the learned parameters…

Cryptography and Security · Computer Science 2024-09-27 Luiz Leite , Yuri Santo , Bruno L. Dalmazo , André Riker

Federated Learning (FL) has emerged as a compelling paradigm for privacy-preserving distributed machine learning, allowing multiple clients to collaboratively train a global model by transmitting locally computed gradients to a central…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hao Fang , Wenbo Yu , Bin Chen , Xuan Wang , Shu-Tao Xia , Qing Liao , Ke Xu

Distributed learning frameworks often rely on exchanging model parameters across workers, instead of revealing their raw data. A prime example is federated learning that exchanges the gradients or weights of each neural network model. Under…

Machine Learning · Computer Science 2020-11-05 Hyowoon Seo , Jihong Park , Seungeun Oh , Mehdi Bennis , Seong-Lyun Kim

As a special type of multimedia data, Lithography Hotspot Detection (LHD) training often requires stronger privacy protection than conventional multimedia data, and federated learning provides a promising potential solution to this…

Machine Learning · Computer Science 2026-05-01 Yuqi Li , Xingyou Lin , Yanli Li , Kai Zhang , Chuanguang Yang , Zhongliang Guo , Jianping Gou , Tingwen Huang , Yingli Tian

Dataset Distillation (DD) is a powerful technique for reducing large datasets into compact, representative synthetic datasets, accelerating Machine Learning training. However, traditional DD methods operate in a centralized manner, which…

Cryptography and Security · Computer Science 2025-03-07 Marco Arazzi , Mert Cihangiroglu , Serena Nicolazzo , Antonino Nocera

Backdoor attacks represent a subtle yet effective class of cyberattacks targeting AI models, primarily due to their stealthy nature. The model behaves normally on clean data but exhibits malicious behavior only when the attacker embeds a…

Machine Learning · Computer Science 2025-09-29 Sujeevan Aseervatham , Achraf Kerzazi , Younès Bennani