English
Related papers

Related papers: DROP: Poison Dilution via Knowledge Distillation f…

200 papers

Many recent works on knowledge distillation have provided ways to transfer the knowledge of a trained network for improving the learning process of a new one, but finding a good technique for knowledge distillation is still an open problem.…

Machine Learning · Computer Science 2018-12-17 Byeongho Heo , Minsik Lee , Sangdoo Yun , Jin Young Choi

As a distributed machine learning paradigm, Federated Learning (FL) enables large-scale clients to collaboratively train a model without sharing their raw data. However, due to the lack of data auditing for untrusted clients, FL is…

Machine Learning · Computer Science 2025-09-10 Yanxin Yang , Ming Hu , Xiaofei Xie , Yue Cao , Pengyu Zhang , Yihao Huang , Mingsong Chen

Data poisoning is a type of adversarial attack on training data where an attacker manipulates a fraction of data to degrade the performance of machine learning model. Therefore, applications that rely on external data-sources for training…

Machine Learning · Computer Science 2021-04-28 Sanjay Seetharaman , Shubham Malaviya , Rosni KV , Manish Shukla , Sachin Lodha

Neural networks (NNs) are already deployed in hardware today, becoming valuable intellectual property (IP) as many hours are invested in their training and optimization. Therefore, attackers may be interested in copying, reverse…

Cryptography and Security · Computer Science 2022-04-04 Mahdieh Grailoo , Zain Ul Abideen , Mairo Leier , Samuel Pagliarini

Data poisoning is one of the most relevant security threats against machine learning and data-driven technologies. Since many applications rely on untrusted training data, an attacker can easily craft malicious samples and inject them into…

Cryptography and Security · Computer Science 2021-12-01 Nicolas M. Müller , Simon Roschmann , Konstantin Böttinger

Neural networks provide state-of-the-art results for most machine learning tasks. Unfortunately, neural networks are vulnerable to adversarial examples: given an input $x$ and any target classification $t$, it is possible to find a new…

Cryptography and Security · Computer Science 2017-03-23 Nicholas Carlini , David Wagner

Federated Learning (FL) is a distributed learning paradigm that enables different parties to train a model together for high quality and strong privacy protection. In this scenario, individual participants may get compromised and perform…

Cryptography and Security · Computer Science 2023-03-01 Kaiyuan Zhang , Guanhong Tao , Qiuling Xu , Siyuan Cheng , Shengwei An , Yingqi Liu , Shiwei Feng , Guangyu Shen , Pin-Yu Chen , Shiqing Ma , Xiangyu Zhang

Federated learning is a popular strategy for training models on distributed, sensitive data, while preserving data privacy. Prior work identified a range of security threats on federated learning protocols that poison the data or the model.…

Cryptography and Security · Computer Science 2022-08-30 Giorgio Severi , Matthew Jagielski , Gökberk Yar , Yuxuan Wang , Alina Oprea , Cristina Nita-Rotaru

Knowledge distillation from proprietary LLM APIs poses a growing threat to model providers, yet defenses against this attack remain fragmented and unevaluated. We present DistillGuard, a framework for systematically evaluating output-level…

Cryptography and Security · Computer Science 2026-03-10 Bo Jiang

Dataset Distillation (DD) is a powerful technique for reducing large datasets into compact, representative synthetic datasets, accelerating Machine Learning training. However, traditional DD methods operate in a centralized manner, which…

Cryptography and Security · Computer Science 2025-03-07 Marco Arazzi , Mert Cihangiroglu , Serena Nicolazzo , Antonino Nocera

Despite their accuracy, neural network-based classifiers are still prone to manipulation through adversarial perturbations. Those perturbations are designed to be misclassified by the neural network, while being perceptually identical to…

Machine Learning · Computer Science 2019-07-15 Ziv Katzir , Yuval Elovici

Federated Distillation (FD) offers an innovative approach to distributed machine learning, leveraging knowledge distillation for efficient and flexible cross-device knowledge transfer without necessitating the upload of extensive model…

Machine Learning · Computer Science 2024-07-26 Yuhan Tang , Aoxu Zhang , Zhiyuan Wu , Bo Gao , Tian Wen , Yuwei Wang , Sheng Sun

Federated Learning (FL) is a novel client-server distributed learning framework that can protect data privacy. However, recent works show that FL is vulnerable to poisoning attacks. Many defenses with robust aggregators (AGRs) are proposed…

Cryptography and Security · Computer Science 2024-07-26 Yuxin Yang , Qiang Li , Chenfei Nie , Yuan Hong , Meng Pang , Binghui Wang

Data heterogeneity among Federated Learning (FL) users poses a significant challenge, resulting in reduced global model performance. The community has designed various techniques to tackle this issue, among which Knowledge Distillation…

Machine Learning · Computer Science 2024-10-08 Momin Ahmad Khan , Yasra Chandio , Fatima Muhammad Anwar

Dataset distillation (DD) enhances training efficiency and reduces bandwidth by condensing large datasets into smaller synthetic ones. It enables models to achieve performance comparable to those trained on the raw full dataset and has…

Cryptography and Security · Computer Science 2025-02-07 Ziyuan Yang , Ming Yan , Yi Zhang , Joey Tianyi Zhou

Federated learning is a distributed learning paradigm that facilitates the collaborative training of a global model across multiple clients while preserving the privacy of local datasets. To address inherent challenges related to data…

Cryptography and Security · Computer Science 2025-06-03 Chengcheng Zhu , Jiale Zhang , Di Wu , Guodong Long

Federated Learning has been introduced as a new machine learning paradigm enhancing the use of local devices. At a server level, FL regularly aggregates models learned locally on distributed clients to obtain a more general model. Current…

Machine Learning · Computer Science 2022-07-19 Anastasiia Usmanova , François Portet , Philippe Lalanda , German Vega

While Federated learning (FL) is attractive for pulling privacy-preserving distributed training data, the credibility of participating clients and non-inspectable data pose new security threats, of which poisoning attacks are particularly…

Cryptography and Security · Computer Science 2023-09-20 Zizhen Liu , Weiyang He , Chip-Hong Chang , Jing Ye , Huawei Li , Xiaowei Li

Federated learning (FL) is an emerging paradigm for distributed training of large-scale deep neural networks in which participants' data remains on their own devices with only model updates being shared with a central server. However, the…

Machine Learning · Computer Science 2020-08-13 Vale Tolpegin , Stacey Truex , Mehmet Emre Gursoy , Ling Liu

Manipulation of local training data and local updates, i.e., the poisoning attack, is the main threat arising from the collaborative nature of the federated learning (FL) paradigm. Most existing poisoning attacks aim to manipulate local…

Machine Learning · Computer Science 2025-05-30 Huazi Pan , Yanjun Zhang , Leo Yu Zhang , Scott Adams , Abbas Kouzani , Suiyang Khoo