English
Related papers

Related papers: Are Targeted Data Poisoning Attacks as Effective a…

200 papers

We study indiscriminate poisoning for linear learners where an adversary injects a few crafted examples into the training data with the goal of forcing the induced model to incur higher test error. Inspired by the observation that linear…

Machine Learning · Computer Science 2023-11-13 Fnu Suya , Xiao Zhang , Yuan Tian , David Evans

We introduce a new class of attacks on machine learning models. We show that an adversary who can poison a training dataset can cause models trained on this dataset to leak significant private details of training points belonging to other…

Cryptography and Security · Computer Science 2022-10-07 Florian Tramèr , Reza Shokri , Ayrton San Joaquin , Hoang Le , Matthew Jagielski , Sanghyun Hong , Nicholas Carlini

The widespread adoption of generative models such as Stable Diffusion and ChatGPT has made them increasingly attractive targets for malicious exploitation, particularly through data poisoning. Existing poisoning attacks compromising…

Machine Learning · Computer Science 2025-11-10 Mathias Lundteigen Mohus , Jingyue Li , Zhirong Yang

Adversarial attacks alter NLP model predictions by perturbing test-time inputs. However, it is much less understood whether, and how, predictions can be manipulated with small, concealed changes to the training data. In this work, we…

Computation and Language · Computer Science 2021-04-13 Eric Wallace , Tony Z. Zhao , Shi Feng , Sameer Singh

Given the volume of data needed to train modern machine learning models, external suppliers are increasingly used. However, incorporating external data poses data poisoning risks, wherein attackers manipulate their data to degrade model…

Cryptography and Security · Computer Science 2023-06-01 Yi Zeng , Minzhou Pan , Himanshu Jahagirdar , Ming Jin , Lingjuan Lyu , Ruoxi Jia

Poisoning attacks can compromise the safety of large language models (LLMs) by injecting malicious documents into their training data. Existing work has studied pretraining poisoning assuming adversaries control a percentage of the training…

Backdoor attacks represent a subtle yet effective class of cyberattacks targeting AI models, primarily due to their stealthy nature. The model behaves normally on clean data but exhibits malicious behavior only when the attacker embeds a…

Machine Learning · Computer Science 2025-09-29 Sujeevan Aseervatham , Achraf Kerzazi , Younès Bennani

Poisoning attacks have emerged as a significant security threat to machine learning algorithms. It has been demonstrated that adversaries who make small changes to the training set, such as adding specially crafted data points, can hurt the…

Machine Learning · Computer Science 2021-12-14 Samuel Deng , Sanjam Garg , Somesh Jha , Saeed Mahloujifar , Mohammad Mahmoody , Abhradeep Thakurta

As machine learning systems grow in scale, so do their training data requirements, forcing practitioners to automate and outsource the curation of training data in order to achieve state-of-the-art performance. The absence of trustworthy…

Machine Learning · Computer Science 2021-04-02 Micah Goldblum , Dimitris Tsipras , Chulin Xie , Xinyun Chen , Avi Schwarzschild , Dawn Song , Aleksander Madry , Bo Li , Tom Goldstein

As pairwise ranking becomes broadly employed for elections, sports competitions, recommendations, and so on, attackers have strong motivation and incentives to manipulate the ranking list. They could inject malicious comparisons into the…

Machine Learning · Computer Science 2021-07-06 Ke Ma , Qianqian Xu , Jinshan Zeng , Xiaochun Cao , Qingming Huang

With the rise of artificial intelligence and machine learning in modern computing, one of the major concerns regarding such techniques is to provide privacy and security against adversaries. We present this survey paper to cover the most…

Cryptography and Security · Computer Science 2022-02-09 Wenjun Qiu

Our research addresses the overlooked security concerns related to data poisoning in continual learning (CL). Data poisoning - the intentional manipulation of training data to affect the predictions of machine learning models - was recently…

Cryptography and Security · Computer Science 2025-08-12 Stanisław Pawlak , Bartłomiej Twardowski , Tomasz Trzciński , Joost van de Weijer

Deploying machine learning (ML) models in the wild is challenging as it suffers from distribution shifts, where the model trained on an original domain cannot generalize well to unforeseen diverse transfer domains. To address this…

Cryptography and Security · Computer Science 2023-08-17 Tianshuo Cong , Xinlei He , Yun Shen , Yang Zhang

Federated learning (FL) is an emerging paradigm for distributed training of large-scale deep neural networks in which participants' data remains on their own devices with only model updates being shared with a central server. However, the…

Machine Learning · Computer Science 2020-08-13 Vale Tolpegin , Stacey Truex , Mehmet Emre Gursoy , Ling Liu

Backdoor and data-poisoning attacks can flip predictions with tiny training corruptions, yet a sharp theory linking poisoning strength, overparameterization, and regularization is lacking. We analyze ridge least squares with an unpenalized…

Machine Learning · Statistics 2026-01-06 Donald Flynn , Diego Granziol

We revisit the efficacy of several practical methods for approximate machine unlearning developed for large-scale deep learning. In addition to complying with data deletion requests, one often-cited potential application for unlearning…

Machine Learning · Computer Science 2026-01-16 Martin Pawelczyk , Jimmy Z. Di , Yiwei Lu , Gautam Kamath , Ayush Sekhari , Seth Neel

A backdoor data poisoning attack is an adversarial attack wherein the attacker injects several watermarked, mislabeled training examples into a training set. The watermark does not impact the test-time performance of the model on typical…

Machine Learning · Computer Science 2021-11-05 Naren Sarayu Manoj , Avrim Blum

Data Poisoning (DP) is an effective attack that causes trained classifiers to misclassify their inputs. DP attacks significantly degrade a classifier's accuracy by covertly injecting attack samples into the training set. Broadly applicable…

Machine Learning · Computer Science 2022-05-13 Xi Li , David J. Miller , Zhen Xiang , George Kesidis

Research in adversarial machine learning has shown how the performance of machine learning models can be seriously compromised by injecting even a small fraction of poisoning points into the training data. While the effects on model…

Machine Learning · Computer Science 2020-06-29 David Solans , Battista Biggio , Carlos Castillo

Deep learning (DL) models for natural language-to-code generation have become integral to modern software development pipelines. However, their heavy reliance on large amounts of data, often collected from unsanitized online sources,…

Cryptography and Security · Computer Science 2025-09-01 Cristina Improta