English
Related papers

Related papers: Manipulating Machine Learning: Poisoning Attacks a…

200 papers

Adversarial attacks can generate adversarial inputs by applying small but intentionally worst-case perturbations to samples from the dataset, which leads to even state-of-the-art deep neural networks outputting incorrect answers with high…

Machine Learning · Computer Science 2024-01-08 Shorya Sharma

Deep learning has emerged as a strong and efficient framework that can be applied to a broad spectrum of complex learning problems which were difficult to solve using the traditional machine learning techniques in the past. In the last few…

Machine Learning · Computer Science 2018-10-02 Anirban Chakraborty , Manaar Alam , Vishal Dey , Anupam Chattopadhyay , Debdeep Mukhopadhyay

Deep neural networks are vulnerable to adversarial attacks, such as backdoor attacks in which a malicious adversary compromises a model during training such that specific behaviour can be triggered at test time by attaching a specific word…

Cryptography and Security · Computer Science 2022-10-21 You Guo , Jun Wang , Trevor Cohn

One of the most concerning threats for modern AI systems is data poisoning, where the attacker injects maliciously crafted training data to corrupt the system's behavior at test time. Availability poisoning is a particularly worrisome…

Machine Learning · Computer Science 2021-03-24 Antonio Emanuele Cinà , Sebastiano Vascon , Ambra Demontis , Battista Biggio , Fabio Roli , Marcello Pelillo

Despite the large body of academic work on machine learning security, little is known about the occurrence of attacks on machine learning systems in the wild. In this paper, we report on a quantitative study with 139 industrial…

Machine Learning · Computer Science 2023-03-13 Kathrin Grosse , Lukas Bieringer , Tarek Richard Besold , Battista Biggio , Katharina Krombholz

Stealing attack against controlled information, along with the increasing number of information leakage incidents, has become an emerging cyber security threat in recent years. Due to the booming development and deployment of advanced…

Cryptography and Security · Computer Science 2021-11-16 Yuantian Miao , Chao Chen , Lei Pan , Qing-Long Han , Jun Zhang , Yang Xiang

This paper advances the understanding of how the size of a machine learning model affects its vulnerability to poisoning, despite state-of-the-art defenses. Given isotropic random honest feature vectors and the geometric median (or clipped…

Machine Learning · Computer Science 2024-09-27 Lê-Nguyên Hoang

The increasing access to data poses both opportunities and risks in deep learning, as one can manipulate the behaviors of deep learning models with malicious training samples. Such attacks are known as data poisoning. Recent advances in…

Machine Learning · Computer Science 2023-06-29 Wenxiao Wang , Soheil Feizi

Neural network classifiers are vulnerable to data poisoning attacks, as attackers can degrade or even manipulate their predictions thorough poisoning only a few training samples. However, the robustness of heuristic defenses is hard to…

Machine Learning · Computer Science 2020-10-14 Ruoxin Chen , Jie Li , Chentao Wu , Bin Sheng , Ping Li

Ensuring the reliability of machine learning-based intrusion detection systems remains a critical challenge in Internet of Things (IoT) environments, particularly as data poisoning attacks increasingly threaten the integrity of model…

This paper investigates some of the risks introduced by "LLM poisoning," the intentional or unintentional introduction of malicious or biased data during model training. We demonstrate how a seemingly improved LLM, fine-tuned on a limited…

Cryptography and Security · Computer Science 2025-11-05 Patrick Karlsen , Even Eilertsen

Adversarial attacks have exposed a significant security vulnerability in state-of-the-art machine learning models. Among these models include deep reinforcement learning agents. The existing methods for attacking reinforcement learning…

Machine Learning · Computer Science 2020-01-17 Matthew Inkawhich , Yiran Chen , Hai Li

This paper examines the robustness of deployed few-shot meta-learning systems when they are fed an imperceptibly perturbed few-shot dataset. We attack amortized meta-learners, which allows us to craft colluding sets of inputs that are…

Machine Learning · Computer Science 2022-11-24 Elre T. Oldewage , John Bronskill , Richard E. Turner

Despite their tremendous success in a range of domains, deep learning systems are inherently susceptible to two types of manipulations: adversarial inputs -- maliciously crafted samples that deceive target deep neural network (DNN) models,…

Machine Learning · Computer Science 2020-11-24 Ren Pang , Hua Shen , Xinyang Zhang , Shouling Ji , Yevgeniy Vorobeychik , Xiapu Luo , Alex Liu , Ting Wang

Data poisoning attacks are a potential threat to machine learning (ML) models, aiming to manipulate training datasets to disrupt their performance. Existing defenses are mostly designed to mitigate specific poisoning attacks or are aligned…

Cryptography and Security · Computer Science 2025-10-28 Anum Paracha , Junaid Arshad , Mohamed Ben Farah , Khalid Ismail

Poisoning attack is identified as a severe security threat to machine learning algorithms. In many applications, for example, deep neural network (DNN) models collect public data as the inputs to perform re-training, where the input data…

Cryptography and Security · Computer Science 2017-03-07 Chaofei Yang , Qing Wu , Hai Li , Yiran Chen

In recent years, there has been a growing interest in the effects of data poisoning attacks on data-driven control methods. Poisoning attacks are well-known to the Machine Learning community, which, however, make use of assumptions, such as…

Systems and Control · Electrical Eng. & Systems 2023-05-17 Alessio Russo

Many of today's machine learning (ML) systems are built by reusing an array of, often pre-trained, primitive models, each fulfilling distinct functionality (e.g., feature extraction). The increasing use of primitive models significantly…

Cryptography and Security · Computer Science 2018-12-04 Yujie Ji , Xinyang Zhang , Shouling Ji , Xiapu Luo , Ting Wang

Backdoors and poisoning attacks are a major threat to the security of machine-learning and vision systems. Often, however, these attacks leave visible artifacts in the images that can be visually detected and weaken the efficacy of the…

Cryptography and Security · Computer Science 2020-03-20 Erwin Quiring , Konrad Rieck

Federated learning allows multiple users to collaboratively train a shared classification model while preserving data privacy. This approach, where model updates are aggregated by a central server, was shown to be vulnerable to poisoning…

Machine Learning · Computer Science 2020-12-17 Chien-Lun Chen , Leana Golubchik , Marco Paolieri