中文
相关论文

相关论文: Subpopulation Data Poisoning Attacks

200 篇论文

The success of machine learning is fueled by the increasing availability of computing power and large training datasets. The training data is used to learn new models or update existing ones, assuming that it is sufficiently representative…

Indiscriminate data poisoning attacks aim to decrease a model's test accuracy by injecting a small amount of corrupted training data. Despite significant interest, existing attacks remain relatively ineffective against modern machine…

机器学习 · 计算机科学 2023-06-07 Yiwei Lu , Gautam Kamath , Yaoliang Yu

A recent line of work has uncovered a new form of data poisoning: so-called \emph{backdoor} attacks. These attacks are particularly dangerous because they do not affect a network's behavior on typical, benign data. Rather, the network only…

机器学习 · 计算机科学 2018-11-05 Brandon Tran , Jerry Li , Aleksander Madry

A number of online services nowadays rely upon machine learning to extract valuable information from data collected in the wild. This exposes learning algorithms to the threat of data poisoning, i.e., a coordinate attack in which a fraction…

Most recent studies have shown several vulnerabilities to attacks with the potential to jeopardize the integrity of the model, opening in a few recent years a new window of opportunity in terms of cyber-security. The main interest of this…

In the evolving landscape of Federated Learning (FL), a new type of attacks concerns the research community, namely Data Poisoning Attacks, which threaten the model integrity by maliciously altering training data. This paper introduces a…

密码学与安全 · 计算机科学 2024-04-22 Nick Galanis

A backdoor data poisoning attack is an adversarial attack wherein the attacker injects several watermarked, mislabeled training examples into a training set. The watermark does not impact the test-time performance of the model on typical…

机器学习 · 计算机科学 2021-11-05 Naren Sarayu Manoj , Avrim Blum

Continual learning algorithms are typically exposed to untrusted sources that contain training data inserted by adversaries and bad actors. An adversary can insert a small number of poisoned samples, such as mislabeled samples from…

机器学习 · 计算机科学 2023-11-21 Huayu Li , Gregory Ditzler

Recent studies have revealed a security threat to natural language processing (NLP) models, called the Backdoor Attack. Victim models can maintain competitive performance on clean samples while behaving abnormally on samples with a specific…

计算与语言 · 计算机科学 2021-03-30 Wenkai Yang , Lei Li , Zhiyuan Zhang , Xuancheng Ren , Xu Sun , Bin He

We propose a novel clustering mechanism based on an incompatibility property between subsets of data that emerges during model training. This mechanism partitions the dataset into subsets that generalize only to themselves, i.e., training…

机器学习 · 计算机科学 2023-04-28 Charles Jin , Melinda Sun , Martin Rinard

Federated learning (FL) is an emerging paradigm for distributed training of large-scale deep neural networks in which participants' data remains on their own devices with only model updates being shared with a central server. However, the…

机器学习 · 计算机科学 2020-08-13 Vale Tolpegin , Stacey Truex , Mehmet Emre Gursoy , Ling Liu

Data poisoning is a training-time attack that undermines the trustworthiness of learned models. In a targeted data poisoning attack, an adversary manipulates the training dataset to alter the classification of a targeted test point. Given…

机器学习 · 计算机科学 2025-11-18 Nakshatra Gupta , Sumanth Prabhu , Supratik Chakraborty , R Venkatesh

Machine learning systems trained on user-provided data are susceptible to data poisoning attacks, whereby malicious users inject false training data with the aim of corrupting the learned model. While recent work has proposed a number of…

机器学习 · 计算机科学 2017-11-27 Jacob Steinhardt , Pang Wei Koh , Percy Liang

Machine learning is becoming ubiquitous. From finance to medicine, machine learning models are boosting decision-making processes and even outperforming humans in some tasks. This huge progress in terms of prediction quality does not…

We consider availability data poisoning attacks, where an adversary aims to degrade the overall test accuracy of a machine learning model by crafting small perturbations to its training data. Existing poisoning strategies can achieve the…

密码学与安全 · 计算机科学 2024-06-07 Yiyong Liu , Michael Backes , Xiao Zhang

Web-scraped datasets are vulnerable to data poisoning, which can be used for backdooring deep image classifiers during training. Since training on large datasets is expensive, a model is trained once and re-used many times. Unlike…

机器学习 · 计算机科学 2024-01-23 Benjamin Schneider , Nils Lukas , Florian Kerschbaum

We study data poisoning attacks in the online setting where training items arrive sequentially, and the attacker may perturb the current item to manipulate online learning. Importantly, the attacker has no knowledge of future training items…

机器学习 · 计算机科学 2019-06-03 Xuezhou Zhang , Xiaojin Zhu , Laurent Lessard

The widespread adoption of generative models such as Stable Diffusion and ChatGPT has made them increasingly attractive targets for malicious exploitation, particularly through data poisoning. Existing poisoning attacks compromising…

机器学习 · 计算机科学 2025-11-10 Mathias Lundteigen Mohus , Jingyue Li , Zhirong Yang

Recent research has successfully demonstrated new types of data poisoning attacks. To address this problem, some researchers have proposed both offline and online data poisoning detection defenses which employ machine learning algorithms to…

密码学与安全 · 计算机科学 2021-05-24 Jack W. Stokes , Paul England , Kevin Kane

Machine learning models trained on data from the outside world can be corrupted by data poisoning attacks that inject malicious points into the models' training sets. A common defense against these attacks is data sanitization: first filter…

机器学习 · 统计学 2021-12-06 Pang Wei Koh , Jacob Steinhardt , Percy Liang