English
Related papers

Related papers: Deep Partition Aggregation: Provable Defense again…

200 papers

Recent research has highlighted the vulnerability of Deep Neural Networks (DNNs) against data poisoning attacks. These attacks aim to inject poisoning samples into the models' training dataset such that the trained models have inference…

Cryptography and Security · Computer Science 2025-06-03 Pengfei He , Han Xu , Jie Ren , Yingqian Cui , Hui Liu , Charu C. Aggarwal , Jiliang Tang

We consider availability data poisoning attacks, where an adversary aims to degrade the overall test accuracy of a machine learning model by crafting small perturbations to its training data. Existing poisoning strategies can achieve the…

Cryptography and Security · Computer Science 2024-06-07 Yiyong Liu , Michael Backes , Xiao Zhang

Data poisoning is an attack on machine learning models wherein the attacker adds examples to the training set to manipulate the behavior of the model at test time. This paper explores poisoning attacks on neural nets. The proposed attacks…

Machine Learning · Computer Science 2018-11-13 Ali Shafahi , W. Ronny Huang , Mahyar Najibi , Octavian Suciu , Christoph Studer , Tudor Dumitras , Tom Goldstein

Due to its distributed nature, federated learning is vulnerable to poisoning attacks, in which malicious clients poison the training process via manipulating their local training data and/or local model updates sent to the cloud server,…

Cryptography and Security · Computer Science 2022-10-05 Xiaoyu Cao , Zaixi Zhang , Jinyuan Jia , Neil Zhenqiang Gong

Machine learning algorithms are vulnerable to poisoning attacks: An adversary can inject malicious points in the training dataset to influence the learning process and degrade the algorithm's performance. Optimal poisoning attacks have…

Machine Learning · Computer Science 2019-09-26 Luis Muñoz-González , Bjarne Pfitzner , Matteo Russo , Javier Carnerero-Cano , Emil C. Lupu

Federated learning (FL) enables privacy-preserving model training by keeping data decentralized. However, it remains vulnerable to label-flipping attacks, where malicious clients manipulate labels to poison the global model. Despite their…

Predictions of certifiably robust classifiers remain constant in a neighborhood of a point, making them resilient to test-time attacks with a guarantee. In this work, we present a previously unrecognized threat to robust machine learning…

Machine Learning · Computer Science 2021-03-31 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Decentralized federated learning (DFL) is inherently vulnerable to data poisoning attacks, as malicious clients can transmit manipulated gradients to neighboring clients. Existing defense methods either reject suspicious gradients per…

Machine Learning · Computer Science 2025-07-08 Bin Li , Xiaoye Miao , Yan Zhang , Jianwei Yin

Poisoning-based backdoor attacks expose vulnerabilities in the data preparation stage of deep neural network (DNN) training. The DNNs trained on the poisoned dataset will be embedded with a backdoor, making them behave well on clean data…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Binxiao Huang , Jason Chun Lok , Chang Liu , Ngai Wong

In a backdoor attack, an adversary injects corrupted data into a model's training dataset in order to gain control over its predictions on images with a specific attacker-defined trigger. A typical corrupted training example requires…

Machine Learning · Computer Science 2023-10-31 Rishi D. Jha , Jonathan Hayase , Sewoong Oh

Recent work on adversarial attack has shown that Projected Gradient Descent (PGD) Adversary is a universal first-order adversary, and the classifier adversarially trained by PGD is robust against a wide range of first-order attacks. It is…

Machine Learning · Computer Science 2018-12-07 Tianhang Zheng , Changyou Chen , Kui Ren

Federated Learning (FL) is a novel client-server distributed learning framework that can protect data privacy. However, recent works show that FL is vulnerable to poisoning attacks. Many defenses with robust aggregators (AGRs) are proposed…

Cryptography and Security · Computer Science 2024-07-26 Yuxin Yang , Qiang Li , Chenfei Nie , Yuan Hong , Meng Pang , Binghui Wang

Federated learning (FL) has garnered significant attention as a prominent privacy-preserving Machine Learning (ML) paradigm. Decentralized FL (DFL) eschews traditional FL's centralized server architecture, enhancing the system's robustness…

Machine Learning · Computer Science 2025-02-10 Chao Feng , Yunlong Li , Yuanzhe Gao , Alberto Huertas Celdrán , Jan von der Assen , Gérôme Bovet , Burkhard Stiller

With the rise of third parties in the machine learning pipeline, the service provider in "Machine Learning as a Service" (MLaaS), or external data contributors in online learning, or the retraining of existing models, the need to ensure the…

Cryptography and Security · Computer Science 2021-05-20 Jialin Wen , Benjamin Zi Hao Zhao , Minhui Xue , Alina Oprea , Haifeng Qian

Deep neural networks are highly susceptible to backdoor attacks, yet most defense methods to date rely on balanced data, overlooking the pervasive class imbalance in real-world scenarios that can amplify backdoor threats. This paper…

Cryptography and Security · Computer Science 2026-02-03 Miao Lin , Feng Yu , Rui Ning , Lusi Li , Jiawei Chen , Qian Lou , Mengxin Zheng , Chunsheng Xin , Hongyi Wu

Despite their impressive performance, deep neural networks (DNNs) are widely known to be vulnerable to adversarial attacks, which makes it challenging for them to be deployed in security-sensitive applications, such as autonomous driving.…

Machine Learning · Computer Science 2020-10-09 Philipp Benz , Chaoning Zhang , Tooba Imtiaz , In So Kweon

Manipulation of local training data and local updates, i.e., the poisoning attack, is the main threat arising from the collaborative nature of the federated learning (FL) paradigm. Most existing poisoning attacks aim to manipulate local…

Machine Learning · Computer Science 2025-05-30 Huazi Pan , Yanjun Zhang , Leo Yu Zhang , Scott Adams , Abbas Kouzani , Suiyang Khoo

The unprecedented availability of training data fueled the rapid development of powerful neural networks in recent years. However, the need for such large amounts of data leads to potential threats such as poisoning attacks: adversarial…

Machine Learning · Computer Science 2024-03-21 Fabio De Gaspari , Dorjan Hitaj , Luigi V. Mancini

Recently researchers have proposed using deep learning-based systems for malware detection. Unfortunately, all deep learning classification systems are vulnerable to adversarial attacks. Previous work has studied adversarial attacks against…

Cryptography and Security · Computer Science 2017-12-19 Jack W. Stokes , De Wang , Mady Marinescu , Marc Marino , Brian Bussone

Federated learning is used to train a shared model in a decentralized way without clients sharing private data with each other. Federated learning systems are susceptible to poisoning attacks when malicious clients send false updates to the…

Machine Learning · Computer Science 2023-08-21 Sungwon Han , Sungwon Park , Fangzhao Wu , Sundong Kim , Bin Zhu , Xing Xie , Meeyoung Cha