English
Related papers

Related papers: Explore the Effect of Data Selection on Poison Eff…

200 papers

Despite the remarkable success of deep neural networks (DNNs), the security threat of adversarial attacks poses a significant challenge to the reliability of DNNs. In this paper, both theoretically and empirically, we discover a universal…

Machine Learning · Computer Science 2025-06-10 Ran Wang , Xinlei Zhou , Meng Hu , Rihao Li , Wenhui Wu , Yuheng Jia

Data poisoning is an attack on machine learning models wherein the attacker adds examples to the training set to manipulate the behavior of the model at test time. This paper explores poisoning attacks on neural nets. The proposed attacks…

Machine Learning · Computer Science 2018-11-13 Ali Shafahi , W. Ronny Huang , Mahyar Najibi , Octavian Suciu , Christoph Studer , Tudor Dumitras , Tom Goldstein

Poisoning attack is identified as a severe security threat to machine learning algorithms. In many applications, for example, deep neural network (DNN) models collect public data as the inputs to perform re-training, where the input data…

Cryptography and Security · Computer Science 2017-03-07 Chaofei Yang , Qing Wu , Hai Li , Yiran Chen

Data poisoning and backdoor attacks manipulate victim models by maliciously modifying training data. In light of this growing threat, a recent survey of industry professionals revealed heightened fear in the private sector regarding data…

Cryptography and Security · Computer Science 2020-11-20 Eitan Borgnia , Valeriia Cherepanova , Liam Fowl , Amin Ghiasi , Jonas Geiping , Micah Goldblum , Tom Goldstein , Arjun Gupta

In recent years, many backdoor attacks based on training data poisoning have been proposed. However, in practice, those backdoor attacks are vulnerable to image compressions. When backdoor instances are compressed, the feature of specific…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Mingfu Xue , Xin Wang , Shichang Sun , Yushu Zhang , Jian Wang , Weiqiang Liu

Predicitions made by neural networks can be fraudulently altered by so-called poisoning attacks. A special case are backdoor poisoning attacks. We study suitable detection methods and introduce a new method called Heatmap Clustering. There,…

Machine Learning · Computer Science 2022-04-28 Lukas Schulth , Christian Berghoff , Matthias Neu

The generalization bound is a crucial theoretical tool for assessing the generalizability of learning methods and there exist vast literatures on generalizability of normal learning, adversarial learning, and data poisoning. Unlike other…

Machine Learning · Computer Science 2024-06-05 Lijia Yu , Shuang Liu , Yibo Miao , Xiao-Shan Gao , Lijun Zhang

Deep neural networks (DNNs) have demonstrated effectiveness in various fields. However, DNNs are vulnerable to backdoor attacks, which inject a unique pattern, called trigger, into the input to cause misclassification to an attack-chosen…

Cryptography and Security · Computer Science 2024-07-17 Siyuan Cheng , Guangyu Shen , Kaiyuan Zhang , Guanhong Tao , Shengwei An , Hanxi Guo , Shiqing Ma , Xiangyu Zhang

As machine learning (ML) classifiers increasingly oversee the automated monitoring of network traffic, studying their resilience against adversarial attacks becomes critical. This paper focuses on poisoning attacks, specifically backdoor…

Cryptography and Security · Computer Science 2023-06-05 Giorgio Severi , Simona Boboila , Alina Oprea , John Holodnak , Kendra Kratkiewicz , Jason Matterer

As deep neural networks (DNNs) are growing larger, their requirements for computational resources become huge, which makes outsourcing training more popular. Training in a third-party platform, however, may introduce potential risks that a…

Machine Learning · Computer Science 2021-10-28 Dongxian Wu , Yisen Wang

In a backdoor attack, an attacker injects corrupted examples into the training set. The goal of the attacker is to cause the final trained model to predict the attacker's desired target label when a predefined trigger is added to test…

Machine Learning · Computer Science 2022-10-13 Jonathan Hayase , Sewoong Oh

Federated Learning systems are increasingly subjected to a multitude of model poisoning attacks from clients. Among these, edge-case attacks that target a small fraction of the input space are nearly impossible to detect using existing…

Machine Learning · Computer Science 2024-08-15 Kiran Purohit , Soumi Das , Sourangshu Bhattacharya , Santu Rana

Collecting training data from untrusted sources exposes machine learning services to poisoning adversaries, who maliciously manipulate training data to degrade the model accuracy. When trained on offline datasets, poisoning adversaries have…

Machine Learning · Computer Science 2021-10-27 Tianyu Pang , Xiao Yang , Yinpeng Dong , Hang Su , Jun Zhu

Federated learning security research has predominantly focused on backdoor threats from a minority of malicious clients that intentionally corrupt model updates. This paper challenges this paradigm by investigating a more pervasive and…

Cryptography and Security · Computer Science 2026-02-18 Haodong Zhao , Jinming Hu , Gongshen Liu

The success of a deep neural network (DNN) heavily relies on the details of the training scheme; e.g., training data, architectures, hyper-parameters, etc. Recent backdoor attacks suggest that an adversary can take advantage of such…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Nazmul Karim , Abdullah Al Arafat , Umar Khalid , Zhishan Guo , Naznin Rahnavard

Modern machine learning (ML) systems demand substantial training data, often resorting to external sources. Nevertheless, this practice renders them vulnerable to backdoor poisoning attacks. Prior backdoor defense strategies have primarily…

Machine Learning · Computer Science 2024-03-19 Soumyadeep Pal , Yuguang Yao , Ren Wang , Bingquan Shen , Sijia Liu

Federated Learning (FL) is susceptible to poisoning attacks, wherein compromised clients manipulate the global model by modifying local datasets or sending manipulated model updates. Experienced defenders can readily detect and mitigate the…

Cryptography and Security · Computer Science 2024-06-19 Yi Liu , Cong Wang , Xingliang Yuan

Recent works have demonstrated that deep learning models are vulnerable to backdoor poisoning attacks, where these attacks instill spurious correlations to external trigger patterns or objects (e.g., stickers, sunglasses, etc.). We find…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Tong Wu , Tianhao Wang , Vikash Sehwag , Saeed Mahloujifar , Prateek Mittal

Despite decades of development, existing IDSs still face challenges in improving detection accuracy, evasion, and detection of unknown attacks. To solve these problems, many researchers have focused on designing and developing IDSs that use…

Cryptography and Security · Computer Science 2025-01-28 Mofe O. Jeje

Deep neural networks are vulnerable to a range of adversaries. A particularly pernicious class of vulnerabilities are backdoors, where model predictions diverge in the presence of subtle triggers in inputs. An attacker can implant a…

Machine Learning · Computer Science 2022-12-20 Goutham Ramakrishnan , Aws Albarghouthi