English
Related papers

Related papers: Inverting Gradient Attacks Makes Powerful Data Poi…

200 papers

While state-of-the-art diffusion models (DMs) excel in image generation, concerns regarding their security persist. Earlier research highlighted DMs' vulnerability to data poisoning attacks, but these studies placed stricter requirements…

Machine Learning · Computer Science 2024-06-18 Zhuoshi Pan , Yuguang Yao , Gaowen Liu , Bingquan Shen , H. Vicky Zhao , Ramana Rao Kompella , Sijia Liu

Targeted data poisoning (TDP) aims to compromise the model's prediction on a specific (test) target by perturbing a small subset of training data. Existing work on TDP has focused on an overly ideal threat model in which the same image…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Zhizhen Chen , Zhengyu Zhao , Subrat Kishore Dutta , Chenhao Lin , Chao Shen , Xiao Zhang

Machine learning models have achieved great success in supervised learning tasks for end-to-end training, which requires a large amount of labeled data that is not always feasible. Recently, many practitioners have shifted to…

Machine Learning · Computer Science 2024-02-21 Yiwei Lu , Matthew Y. R. Yang , Gautam Kamath , Yaoliang Yu

We present a data poisoning attack -- Phantom Transfer -- with the property that, even if you know precisely how the poison was placed into an otherwise benign dataset, you cannot filter it out. We achieve this by modifying subliminal…

Cryptography and Security · Computer Science 2026-02-06 Andrew Draganov , Tolga H. Dur , Anandmayi Bhongade , Mary Phuong

We study offline data poisoning attacks in contextual bandits, a class of reinforcement learning problems with important applications in online recommendation and adaptive medical treatment, among others. We provide a general attack…

Machine Learning · Computer Science 2018-08-27 Yuzhe Ma , Kwang-Sung Jun , Lihong Li , Xiaojin Zhu

Machine learning has become an important component for many systems and applications including computer vision, spam filtering, malware and network intrusion detection, among others. Despite the capabilities of machine learning algorithms…

Machine Learning · Statistics 2018-02-14 Andrea Paudice , Luis Muñoz-González , Andras Gyorgy , Emil C. Lupu

Backdoor data poisoning attacks have recently been demonstrated in computer vision research as a potential safety risk for machine learning (ML) systems. Traditional data poisoning attacks manipulate training data to induce unreliability of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Loc Truong , Chace Jones , Brian Hutchinson , Andrew August , Brenda Praggastis , Robert Jasper , Nicole Nichols , Aaron Tuor

We introduce a new class of attacks on machine learning models. We show that an adversary who can poison a training dataset can cause models trained on this dataset to leak significant private details of training points belonging to other…

Cryptography and Security · Computer Science 2022-10-07 Florian Tramèr , Reza Shokri , Ayrton San Joaquin , Hoang Le , Matthew Jagielski , Sanghyun Hong , Nicholas Carlini

Data forging attacks provide counterfactual proof that a model was trained on a given dataset, when in fact, it was trained on another. These attacks work by forging (replacing) mini-batches with ones containing distinct training examples…

Cryptography and Security · Computer Science 2025-06-11 Mohamed Suliman , Anisa Halimi , Swanand Kadhe , Nathalie Baracaldo , Douglas Leith

Machine learning systems are deployed in critical settings, but they might fail in unexpected ways, impacting the accuracy of their predictions. Poisoning attacks against machine learning induce adversarial modification of data used by a…

Machine Learning · Computer Science 2021-05-13 Matthew Jagielski , Giorgio Severi , Niklas Pousette Harger , Alina Oprea

Model inversion attacks pose a significant privacy threat to machine learning models by reconstructing sensitive data from their outputs. While various defenses have been proposed to counteract these attacks, they often come at the cost of…

Cryptography and Security · Computer Science 2024-12-11 Shuai Zhou , Dayong Ye , Tianqing Zhu , Wanlei Zhou

As machine learning becomes widely used for automated decisions, attackers have strong incentives to manipulate the results and models generated by machine learning algorithms. In this paper, we perform the first systematic study of…

Cryptography and Security · Computer Science 2021-09-29 Matthew Jagielski , Alina Oprea , Battista Biggio , Chang Liu , Cristina Nita-Rotaru , Bo Li

Recent studies have shown that distributed machine learning is vulnerable to gradient inversion attacks, where private training data can be reconstructed by analyzing the gradients of the models shared in training. Previous attacks…

Machine Learning · Computer Science 2024-10-07 Weijun Li , Qiongkai Xu , Mark Dras

The widespread adoption of generative models such as Stable Diffusion and ChatGPT has made them increasingly attractive targets for malicious exploitation, particularly through data poisoning. Existing poisoning attacks compromising…

Machine Learning · Computer Science 2025-11-10 Mathias Lundteigen Mohus , Jingyue Li , Zhirong Yang

The prevalence of data scraping from social media as a means to obtain datasets has led to growing concerns regarding unauthorized use of data. Data poisoning attacks have been proposed as a bulwark against scraping, as they make data…

Machine Learning · Computer Science 2022-10-17 Pedro Sandoval-Segura , Vasu Singla , Jonas Geiping , Micah Goldblum , Tom Goldstein , David W. Jacobs

With the growing adoption of AI and machine learning systems in real-world applications, ensuring their fairness has become increasingly critical. The majority of the work in algorithmic fairness focus on assessing and improving the…

Machine Learning · Computer Science 2025-11-12 Eunice Chan , Hanghang Tong

Deep neural networks are vulnerable to backdoor attacks, a type of adversarial attack that poisons the training data to manipulate the behavior of models trained on such data. Clean-label attacks are a more stealthy form of backdoor attacks…

Machine Learning · Computer Science 2024-07-17 Quang H. Nguyen , Nguyen Ngoc-Hieu , The-Anh Ta , Thanh Nguyen-Tang , Kok-Seng Wong , Hoang Thanh-Tung , Khoa D. Doan

We study data poisoning attacks in the online setting where training items arrive sequentially, and the attacker may perturb the current item to manipulate online learning. Importantly, the attacker has no knowledge of future training items…

Machine Learning · Computer Science 2019-06-03 Xuezhou Zhang , Xiaojin Zhu , Laurent Lessard

Fake news detection models are critical to countering disinformation but can be manipulated through adversarial attacks. In this position paper, we analyze how an attacker can compromise the performance of an online learning detector on…

Machine Learning · Computer Science 2024-01-05 Federico Siciliano , Luca Maiano , Lorenzo Papa , Federica Baccini , Irene Amerini , Fabrizio Silvestri

The concept of learned index structures relies on the idea that the input-output functionality of a database index can be viewed as a prediction task and, thus, be implemented using a machine learning model instead of traditional…

Cryptography and Security · Computer Science 2022-03-01 Evgenios M. Kornaropoulos , Silei Ren , Roberto Tamassia