中文
相关论文

相关论文: Exploring Model Dynamics for Accumulative Poisonin…

200 篇论文

Data poisoning considers cases when an adversary manipulates the behavior of machine learning algorithms through malicious training data. Existing threat models of data poisoning center around a single metric, the number of poisoned…

机器学习 · 计算机科学 2023-12-08 Wenxiao Wang , Soheil Feizi

Poisoning attacks, in which an attacker adversarially manipulates the training dataset of a machine learning (ML) model, pose a significant threat to ML security. Beta Poisoning is a recently proposed poisoning attack that disrupts model…

密码学与安全 · 计算机科学 2025-08-05 Nilufer Gulciftci , M. Emre Gursoy

In federated learning (FL), although the original intention of available but not visible data is to allay data privacy concerns, it potentially brings new security threats, particularly poisoning attacks that target such not visible local…

密码学与安全 · 计算机科学 2026-03-20 Wei Sun , Bo Gao , Ke Xiong , Yuwei Wang , Pingyi Fan , Khaled Ben Letaief

Modern NLP models are often trained on public datasets drawn from diverse sources, rendering them vulnerable to data poisoning attacks. These attacks can manipulate the model's behavior in ways engineered by the attacker. One such tactic…

计算与语言 · 计算机科学 2024-05-21 Xuanli He , Qiongkai Xu , Jun Wang , Benjamin I. P. Rubinstein , Trevor Cohn

Privacy preserving has become increasingly critical with the emergence of social media. Unlearnable examples have been proposed to avoid leaking personal information on the Internet by degrading generalization abilities of deep learning…

机器学习 · 计算机科学 2023-12-15 Yifan Zhu , Lijia Yu , Xiao-Shan Gao

Data poisoning is a threat model in which a malicious actor tampers with training data to manipulate outcomes at inference time. A variety of defenses against this threat model have been proposed, but each suffers from at least one of the…

机器学习 · 计算机科学 2022-02-21 Jonas Geiping , Liam Fowl , Gowthami Somepalli , Micah Goldblum , Michael Moeller , Tom Goldstein

Modern applications of artificial neural networks have yielded remarkable performance gains in a wide range of tasks. However, recent studies have discovered that such modelling strategy is vulnerable to Adversarial Examples, i.e. examples…

计算机视觉与模式识别 · 计算机科学 2019-04-24 João Monteiro , Isabela Albuquerque , Zahid Akhtar , Tiago H. Falk

The widespread adoption of generative models such as Stable Diffusion and ChatGPT has made them increasingly attractive targets for malicious exploitation, particularly through data poisoning. Existing poisoning attacks compromising…

机器学习 · 计算机科学 2025-11-10 Mathias Lundteigen Mohus , Jingyue Li , Zhirong Yang

Data poisoning is a training-time attack that undermines the trustworthiness of learned models. In a targeted data poisoning attack, an adversary manipulates the training dataset to alter the classification of a targeted test point. Given…

机器学习 · 计算机科学 2025-11-18 Nakshatra Gupta , Sumanth Prabhu , Supratik Chakraborty , R Venkatesh

Modern large language models (LLMs) exhibit critical vulnerabilities to poison pill attacks: localized data poisoning that alters specific factual knowledge while preserving overall model utility. We systematically demonstrate these attacks…

密码学与安全 · 计算机科学 2025-02-27 Peng Yifeng , Wu Zhizheng , Chen Chen

In adversarial machine learning, new defenses against attacks on deep learning systems are routinely broken soon after their release by more powerful attacks. In this context, forensic tools can offer a valuable complement to existing…

密码学与安全 · 计算机科学 2022-06-17 Shawn Shan , Arjun Nitin Bhagoji , Haitao Zheng , Ben Y. Zhao

Dataset Condensation (DC) is a data-efficient learning paradigm that synthesizes small yet informative datasets, enabling models to match the performance of full-data training. However, recent work exposes a critical vulnerability of DC to…

机器学习 · 计算机科学 2026-03-31 He Yang , Dongyi Lv , Song Ma , Wei Xi , Zhi Wang , Hanlin Gu , Yajie Wang

Regression models are widely used in industrial processes, engineering, and in natural and physical sciences, yet their robustness to poisoning has received less attention. When it has, studies often assume unrealistic threat models and are…

机器学习 · 计算机科学 2026-03-03 Javier Carnerero-Cano , Luis Muñoz-González , Phillippa Spencer , Emil C. Lupu

Without direct access to the client's data, federated learning (FL) is well-known for its unique strength in data privacy protection among existing distributed machine learning techniques. However, its distributive and iterative nature…

机器学习 · 计算机科学 2026-04-14 Hanxi Guo , Hao Wang , Tao Song , Tianhang Zheng , Yang Hua , Haibing Guan , Xiangyu Zhang

Machine learning models have been widely adopted in several fields. However, most recent studies have shown several vulnerabilities from attacks with a potential to jeopardize the integrity of the model, presenting a new window of research…

Recent studies revealed that deep learning is susceptible to backdoor poisoning attacks. An adversary can embed a hidden backdoor into a model to manipulate its predictions by only modifying a few training data, without controlling the…

机器学习 · 计算机科学 2023-03-07 Xiangyu Qi , Tinghao Xie , Yiming Li , Saeed Mahloujifar , Prateek Mittal

Data-poisoning based backdoor attacks aim to insert backdoor into models by manipulating training datasets without controlling the training process of the target model. Existing attack methods mainly focus on designing triggers or fusion…

密码学与安全 · 计算机科学 2023-07-17 Zihao Zhu , Mingda Zhang , Shaokui Wei , Li Shen , Yanbo Fan , Baoyuan Wu

Data poisoning causes misclassification of test time target examples by injecting maliciously crafted samples in the training data. Existing defenses are often effective only against a specific type of targeted attack, significantly degrade…

机器学习 · 计算机科学 2022-10-19 Yu Yang , Tian Yu Liu , Baharan Mirzasoleiman

Targeted data poisoning attacks manipulate model predictions on specific test samples by injecting malicious data into training. Yet existing evaluations report average attack success rates over randomly selected targets, obscuring true…

机器学习 · 计算机科学 2026-05-25 William Xu , Chenyu Zhang , Yihan Wang , Matthew Y. R. Yang , Zuoqiu Liu , Gautam Kamath , Yaoliang Yu , Yiwei Lu

In recent years, Deep Neural Network models have been developed in different fields, where they have brought many advances. However, they have also started to be used in tasks where risk is critical. A misdiagnosis of these models can lead…

机器学习 · 计算机科学 2024-02-13 Xabier Echeberria-Barrio , Amaia Gil-Lerchundi , Jon Egana-Zubia , Raul Orduna-Urrutia