English
Related papers

Related papers: Phantom Transfer: Data-level Defences are Insuffic…

200 papers

Modern NLP models are often trained on public datasets drawn from diverse sources, rendering them vulnerable to data poisoning attacks. These attacks can manipulate the model's behavior in ways engineered by the attacker. One such tactic…

Computation and Language · Computer Science 2024-05-21 Xuanli He , Qiongkai Xu , Jun Wang , Benjamin I. P. Rubinstein , Trevor Cohn

Advances in distributed machine learning can empower future communications and networking. The emergence of federated learning (FL) has provided an efficient framework for distributed machine learning, which, however, still faces many…

Cryptography and Security · Computer Science 2022-02-15 Zhilin Wang , Qiao Kang , Xinyi Zhang , Qin Hu

Federated learning is a popular strategy for training models on distributed, sensitive data, while preserving data privacy. Prior work identified a range of security threats on federated learning protocols that poison the data or the model.…

Cryptography and Security · Computer Science 2022-08-30 Giorgio Severi , Matthew Jagielski , Gökberk Yar , Yuxuan Wang , Alina Oprea , Cristina Nita-Rotaru

Federated Learning (FL), a privacy-preserving machine learning framework, faces significant data-related challenges. For example, the lack of suitable public datasets leads to ineffective information exchange, especially in heterogeneous…

Cryptography and Security · Computer Science 2025-04-22 Xi Li , Chen Wu , Jiaqi Wang

Machine learning is vulnerable to a wide variety of attacks. It is now well understood that by changing the underlying data distribution, an adversary can poison the model trained with it or introduce backdoors. In this paper we present a…

Machine Learning · Computer Science 2021-06-08 Ilia Shumailov , Zakhar Shumaylov , Dmitry Kazhdan , Yiren Zhao , Nicolas Papernot , Murat A. Erdogdu , Ross Anderson

Backdoor attacks embed malicious triggers into training data, enabling attackers to manipulate neural network behavior during inference while maintaining high accuracy on benign inputs. However, existing backdoor attacks face limitations…

Cryptography and Security · Computer Science 2025-05-27 Zhou Feng , Jiahao Chen , Chunyi Zhou , Yuwen Pu , Qingming Li , Shouling Ji

Data-poisoning based backdoor attacks aim to insert backdoor into models by manipulating training datasets without controlling the training process of the target model. Existing attack methods mainly focus on designing triggers or fusion…

Cryptography and Security · Computer Science 2023-07-17 Zihao Zhu , Mingda Zhang , Shaokui Wei , Li Shen , Yanbo Fan , Baoyuan Wu

Federated learning is particularly susceptible to model poisoning and backdoor attacks because individual users have direct control over the training data and model updates. At the same time, the attack power of an individual user is…

Machine Learning · Computer Science 2022-10-18 Yuxin Wen , Jonas Geiping , Liam Fowl , Hossein Souri , Rama Chellappa , Micah Goldblum , Tom Goldstein

As machine learning models are increasingly fine-tuned on synthetic data, there is a critical risk of subtle misalignments spreading through interconnected AI systems. This paper investigates subliminal corruption, which we define as…

Machine Learning · Computer Science 2025-10-23 Reya Vir , Sarvesh Bhatnagar

The increasing use of large language models (LLMs) trained by third parties raises significant security concerns. In particular, malicious actors can introduce backdoors through poisoning attacks to generate undesirable outputs. While such…

Cryptography and Security · Computer Science 2024-07-19 Shuli Jiang , Swanand Ravindra Kadhe , Yi Zhou , Farhan Ahmed , Ling Cai , Nathalie Baracaldo

Text-to-image diffusion models achieve high-fidelity image generation from natural language prompts. ControlNets extend these models by enabling conditioning on structural inputs (e.g., edge maps, depth, pose), providing fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Raz Lapid , Almog Dubin

Deep Neural Network (DNN) models have vulnerabilities related to security concerns, with attackers usually employing complex hacking techniques to expose their structures. Data poisoning-enabled perturbation attacks are complex adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Mohammed Hassanin , Ibrahim Radwan , Nour Moustafa , Murat Tahtali , Neeraj Kumar

This paper explores previously unknown backdoor risks in HyperNet-based personalized federated learning (HyperNetFL) through poisoning attacks. Based upon that, we propose a novel model transferring attack (called HNTroj), i.e., the first…

Machine Learning · Computer Science 2023-12-12 Phung Lai , NhatHai Phan , Issa Khalil , Abdallah Khreishah , Xintao Wu

Data poisoning attacks pose significant threats to machine learning models by introducing malicious data into the training process, thereby degrading model performance or manipulating predictions. Detecting and sifting out poisoned data is…

Cryptography and Security · Computer Science 2025-07-10 Haoqi He , Xiaokai Lin , Jiancai Chen , Yan Xiao

In the last decade, the use of Machine Learning techniques in anomaly-based intrusion detection systems has seen much success. However, recent studies have shown that Machine learning in general and deep learning specifically are vulnerable…

Cryptography and Security · Computer Science 2023-03-14 Islam Debicha , Thibault Debatty , Jean-Michel Dricot , Wim Mees , Tayeb Kenaza

Recent studies have shown that deep learning models are very vulnerable to poisoning attacks. Many defense methods have been proposed to address this issue. However, traditional poisoning attacks are not as threatening as commonly believed.…

Machine Learning · Computer Science 2025-12-12 Yuhao He , Jinyu Tian , Xianwei Zheng , Li Dong , Yuanman Li , Jiantao Zhou

Data-poisoning backdoor attacks are serious security threats to machine learning models, where an adversary can manipulate the training dataset to inject backdoors into models. In this paper, we focus on in-training backdoor defense, aiming…

Cryptography and Security · Computer Science 2024-10-16 Shaokui Wei , Hongyuan Zha , Baoyuan Wu

The adversarial machine learning literature is largely partitioned into evasion attacks on testing data and poisoning attacks on training data. In this work, we show that adversarial examples, originally intended for attacking pre-trained…

Machine Learning · Computer Science 2021-06-22 Liam Fowl , Micah Goldblum , Ping-yeh Chiang , Jonas Geiping , Wojtek Czaja , Tom Goldstein

Targeted clean-label data poisoning is a type of adversarial attack on machine learning systems in which an adversary injects a few correctly-labeled, minimally-perturbed samples into the training data, causing a model to misclassify a…

Machine Learning · Computer Science 2020-08-14 Neehar Peri , Neal Gupta , W. Ronny Huang , Liam Fowl , Chen Zhu , Soheil Feizi , Tom Goldstein , John P. Dickerson

Adversarial attacks by malicious actors on machine learning systems, such as introducing poison triggers into training datasets, pose significant risks. The challenge in resolving such an attack arises in practice when only a subset of the…

Machine Learning · Computer Science 2024-09-12 Stefan Schoepf , Jack Foster , Alexandra Brintrup