English
Related papers

Related papers: Towards Class-Oriented Poisoning Attacks Against N…

200 papers

This paper examines the robustness of deployed few-shot meta-learning systems when they are fed an imperceptibly perturbed few-shot dataset. We attack amortized meta-learners, which allows us to craft colluding sets of inputs that are…

Machine Learning · Computer Science 2022-11-24 Elre T. Oldewage , John Bronskill , Richard E. Turner

Federated learning (FL) is an emerging paradigm for distributed training of large-scale deep neural networks in which participants' data remains on their own devices with only model updates being shared with a central server. However, the…

Machine Learning · Computer Science 2020-08-13 Vale Tolpegin , Stacey Truex , Mehmet Emre Gursoy , Ling Liu

As in-the-wild data are increasingly involved in the training stage, machine learning applications become more susceptible to data poisoning attacks. Such attacks typically lead to test-time accuracy degradation or controlled misprediction.…

Cryptography and Security · Computer Science 2022-11-02 Yufei Chen , Chao Shen , Yun Shen , Cong Wang , Yang Zhang

Model poisoning attacks on federated learning (FL) intrude in the entire system via compromising an edge model, resulting in malfunctioning of machine learning models. Such compromised models are tampered with to perform adversary-desired…

Machine Learning · Computer Science 2022-05-11 Yuwei Sun , Hideya Ochiai , Jun Sakuma

This paper investigates the critical issue of data poisoning attacks on AI models, a growing concern in the ever-evolving landscape of artificial intelligence and cybersecurity. As advanced technology systems become increasingly prevalent…

Cryptography and Security · Computer Science 2025-03-13 Halima I. Kure , Pradipta Sarkar , Ahmed B. Ndanusa , Augustine O. Nwajana

Recent studies revealed that deep neural networks (DNNs) are exposed to backdoor threats when training with third-party resources (such as training samples or backbones). The backdoored model has promising performance in predicting benign…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Chengxiao Luo , Yiming Li , Yong Jiang , Shu-Tao Xia

Machine learning is susceptible to poisoning attacks, in which an attacker controls a small fraction of the training data and chooses that data with the goal of inducing some behavior unintended by the model developer in the trained model.…

Machine Learning · Computer Science 2023-11-21 Evan Rose , Fnu Suya , David Evans

Deep learning models are often trained on distributed, web-scale datasets crawled from the internet. In this paper, we introduce two new dataset poisoning attacks that intentionally introduce malicious examples to a model's performance. Our…

Poisoning attacks, in which an attacker adversarially manipulates the training dataset of a machine learning (ML) model, pose a significant threat to ML security. Beta Poisoning is a recently proposed poisoning attack that disrupts model…

Cryptography and Security · Computer Science 2025-08-05 Nilufer Gulciftci , M. Emre Gursoy

Machine Learning (ML) models have become a very powerful tool to extract information from large datasets and use it to make accurate predictions and automated decisions. However, ML models can be vulnerable to external attacks, causing them…

Machine Learning · Computer Science 2025-01-14 Monse Guedes-Ayala , Lars Schewe , Zeynep Suvak , Miguel Anjos

The performance of a machine learning-based malware classifier depends on the large and updated training set used to induce its model. In order to maintain an up-to-date training set, there is a need to continuously collect benign and…

Cryptography and Security · Computer Science 2020-11-02 Tzvika Shapira , David Berend , Ishai Rosenberg , Yang Liu , Asaf Shabtai , Yuval Elovici

Neural networks are widely known to be vulnerable to backdoor attacks, a method that poisons a portion of the training data to make the target model perform well on normal data sets, while outputting attacker-specified or random categories…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Yong Li , Han Gao

Data poisoning -- the process by which an attacker takes control of a model by making imperceptible changes to a subset of the training data -- is an emerging threat in the context of neural networks. Existing attacks for data poisoning…

Machine Learning · Computer Science 2021-02-23 W. Ronny Huang , Jonas Geiping , Liam Fowl , Gavin Taylor , Tom Goldstein

Although ImageNet was initially proposed as a dataset for performance benchmarking in the domain of computer vision, it also enabled a variety of other research efforts. Adversarial machine learning is one such research effort, employing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Utku Ozbulak , Maura Pintor , Arnout Van Messem , Wesley De Neve

There has been recent interest in leveraging federated learning (FL) for radio signal classification tasks. In FL, model parameters are periodically communicated from participating devices, training on their own local datasets, to a central…

Signal Processing · Electrical Eng. & Systems 2023-01-24 Su Wang , Rajeev Sahay , Christopher G. Brinton

Many state-of-the-art ML models have outperformed humans in various tasks such as image classification. With such outstanding performance, ML models are widely used today. However, the existence of adversarial attacks and data poisoning…

Machine Learning · Computer Science 2021-12-07 Jing Lin , Long Dang , Mohamed Rahouti , Kaiqi Xiong

Poisoning attack is identified as a severe security threat to machine learning algorithms. In many applications, for example, deep neural network (DNN) models collect public data as the inputs to perform re-training, where the input data…

Cryptography and Security · Computer Science 2017-03-07 Chaofei Yang , Qing Wu , Hai Li , Yiran Chen

Under a commonly-studied backdoor poisoning attack against classification models, an attacker adds a small trigger to a subset of the training data, such that the presence of this trigger at test time causes the classifier to always predict…

Machine Learning · Computer Science 2021-10-06 Mingjie Sun , Siddhant Agarwal , J. Zico Kolter

Backdoors and poisoning attacks are a major threat to the security of machine-learning and vision systems. Often, however, these attacks leave visible artifacts in the images that can be visually detected and weaken the efficacy of the…

Cryptography and Security · Computer Science 2020-03-20 Erwin Quiring , Konrad Rieck

Clean-label poisoning attacks inject innocuous looking (and "correctly" labeled) poison images into training data, causing a model to misclassify a targeted image after being trained on this data. We consider transferable poisoning attacks…

Machine Learning · Statistics 2019-05-17 Chen Zhu , W. Ronny Huang , Ali Shafahi , Hengduo Li , Gavin Taylor , Christoph Studer , Tom Goldstein