中文
相关论文

相关论文: You Autocomplete Me: Poisoning Vulnerabilities in …

200 篇论文

This paper investigates poisoning attacks against data-driven control methods. This work is motivated by recent trends showing that, in supervised learning, slightly modifying the data in a malicious manner can drastically deteriorate the…

系统与控制 · 电气工程与系统科学 2021-03-11 Alessio Russo , Alexandre Proutiere

We consider availability data poisoning attacks, where an adversary aims to degrade the overall test accuracy of a machine learning model by crafting small perturbations to its training data. Existing poisoning strategies can achieve the…

密码学与安全 · 计算机科学 2024-06-07 Yiyong Liu , Michael Backes , Xiao Zhang

Recent research has successfully demonstrated new types of data poisoning attacks. To address this problem, some researchers have proposed both offline and online data poisoning detection defenses which employ machine learning algorithms to…

密码学与安全 · 计算机科学 2021-05-24 Jack W. Stokes , Paul England , Kevin Kane

Deep neural networks are susceptible to poisoning attacks by purposely polluted training data with specific triggers. As existing episodes mainly focused on attack success rate with patch-based samples, defense algorithms can easily detect…

密码学与安全 · 计算机科学 2021-01-11 Jinyin Chen , Longyuan Zhang , Haibin Zheng , Xueke Wang , Zhaoyan Ming

Our research addresses the overlooked security concerns related to data poisoning in continual learning (CL). Data poisoning - the intentional manipulation of training data to affect the predictions of machine learning models - was recently…

密码学与安全 · 计算机科学 2025-08-12 Stanisław Pawlak , Bartłomiej Twardowski , Tomasz Trzciński , Joost van de Weijer

Machine learning systems are deployed in critical settings, but they might fail in unexpected ways, impacting the accuracy of their predictions. Poisoning attacks against machine learning induce adversarial modification of data used by a…

机器学习 · 计算机科学 2021-05-13 Matthew Jagielski , Giorgio Severi , Niklas Pousette Harger , Alina Oprea

One of the most concerning threats for modern AI systems is data poisoning, where the attacker injects maliciously crafted training data to corrupt the system's behavior at test time. Availability poisoning is a particularly worrisome…

Neural machine translation systems are known to be vulnerable to adversarial test inputs, however, as we show in this paper, these systems are also vulnerable to training attacks. Specifically, we propose a poisoning attack in which a…

计算与语言 · 计算机科学 2021-07-13 Jun Wang , Chang Xu , Francisco Guzman , Ahmed El-Kishky , Yuqing Tang , Benjamin I. P. Rubinstein , Trevor Cohn

Neural networks are widely known to be vulnerable to backdoor attacks, a method that poisons a portion of the training data to make the target model perform well on normal data sets, while outputting attacker-specified or random categories…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Yong Li , Han Gao

A number of online services nowadays rely upon machine learning to extract valuable information from data collected in the wild. This exposes learning algorithms to the threat of data poisoning, i.e., a coordinate attack in which a fraction…

Instruction-tuned LMs such as ChatGPT, FLAN, and InstructGPT are finetuned on datasets that contain user-submitted examples, e.g., FLAN aggregates numerous open-source datasets and OpenAI leverages examples submitted in the browser…

计算与语言 · 计算机科学 2023-05-02 Alexander Wan , Eric Wallace , Sheng Shen , Dan Klein

Data Poisoning attacks modify training data to maliciously control a model trained on such data. In this work, we focus on targeted poisoning attacks which cause a reclassification of an unmodified test image and as such breach model…

计算机视觉与模式识别 · 计算机科学 2021-05-11 Jonas Geiping , Liam Fowl , W. Ronny Huang , Wojciech Czaja , Gavin Taylor , Michael Moeller , Tom Goldstein

The advent of Large Language Models (LLMs) has marked significant achievements in language processing and reasoning capabilities. Despite their advancements, LLMs face vulnerabilities to data poisoning attacks, where the adversary inserts…

Both fair machine learning and adversarial learning have been extensively studied. However, attacking fair machine learning models has received less attention. In this paper, we present a framework that seeks to effectively generate…

机器学习 · 计算机科学 2021-10-19 Minh-Hao Van , Wei Du , Xintao Wu , Aidong Lu

We study data poisoning attacks in the online setting where training items arrive sequentially, and the attacker may perturb the current item to manipulate online learning. Importantly, the attacker has no knowledge of future training items…

机器学习 · 计算机科学 2019-06-03 Xuezhou Zhang , Xiaojin Zhu , Laurent Lessard

The widespread adoption of generative models such as Stable Diffusion and ChatGPT has made them increasingly attractive targets for malicious exploitation, particularly through data poisoning. Existing poisoning attacks compromising…

机器学习 · 计算机科学 2025-11-10 Mathias Lundteigen Mohus , Jingyue Li , Zhirong Yang

As modern neural machine translation (NMT) systems have been widely deployed, their security vulnerabilities require close scrutiny. Most recently, NMT systems have been found vulnerable to targeted attacks which cause them to produce…

计算与语言 · 计算机科学 2021-02-16 Chang Xu , Jun Wang , Yuqing Tang , Francisco Guzman , Benjamin I. P. Rubinstein , Trevor Cohn

Generally, regularization-based continual learning models limit access to the previous task data to imitate the real-world constraints related to memory and privacy. However, this introduces a problem in these models by not being able to…

机器学习 · 计算机科学 2023-07-04 Gyojin Han , Jaehyun Choi , Hyeong Gwon Hong , Junmo Kim

Recent years have witnessed significant progress in developing deep learning-based models for automated code completion. Although using source code in GitHub has been a common practice for training deep-learning-based models for code…

软件工程 · 计算机科学 2024-09-10 Yao Wan , Guanghua Wan , Shijie Zhang , Hongyu Zhang , Pan Zhou , Hai Jin , Lichao Sun

While recent works have indicated that federated learning (FL) may be vulnerable to poisoning attacks by compromised clients, their real impact on production FL systems is not fully understood. In this work, we aim to develop a…

机器学习 · 计算机科学 2021-12-14 Virat Shejwalkar , Amir Houmansadr , Peter Kairouz , Daniel Ramage