中文
相关论文

相关论文: Addressing The Devastating Effects Of Single-Task …

200 篇论文

The widespread adoption of generative models such as Stable Diffusion and ChatGPT has made them increasingly attractive targets for malicious exploitation, particularly through data poisoning. Existing poisoning attacks compromising…

机器学习 · 计算机科学 2025-11-10 Mathias Lundteigen Mohus , Jingyue Li , Zhirong Yang

With the increase in machine learning (ML) applications in different domains, incentives for deceiving these models have reached more than ever. As data is the core backbone of ML algorithms, attackers shifted their interest toward…

密码学与安全 · 计算机科学 2023-01-04 Kshitiz Aryal , Maanak Gupta , Mahmoud Abdelsalam

Indiscriminate data poisoning attacks aim to decrease a model's test accuracy by injecting a small amount of corrupted training data. Despite significant interest, existing attacks remain relatively ineffective against modern machine…

机器学习 · 计算机科学 2023-06-07 Yiwei Lu , Gautam Kamath , Yaoliang Yu

Data poisoning attacks aim to manipulate the model produced by a learning algorithm by adversarially modifying the training set. We consider differential privacy as a defensive measure against this type of attack. We show that such learners…

机器学习 · 计算机科学 2019-07-08 Yuzhe Ma , Xiaojin Zhu , Justin Hsu

Data poisoning attacks, in which a malicious adversary aims to influence a model by injecting "poisoned" data into the training process, have attracted significant recent attention. In this work, we take a closer look at existing poisoning…

机器学习 · 计算机科学 2024-02-16 Yiwei Lu , Gautam Kamath , Yaoliang Yu

Data poisoning and leakage risks impede the massive deployment of federated learning in the real world. This chapter reveals the truths and pitfalls of understanding two dominating threats: {\em training data privacy intrusion} and {\em…

机器学习 · 计算机科学 2024-09-23 Wenqi Wei , Tiansheng Huang , Zachary Yahn , Anoop Singhal , Margaret Loper , Ling Liu

Poisoning attacks, in which an attacker adversarially manipulates the training dataset of a machine learning (ML) model, pose a significant threat to ML security. Beta Poisoning is a recently proposed poisoning attack that disrupts model…

密码学与安全 · 计算机科学 2025-08-05 Nilufer Gulciftci , M. Emre Gursoy

In the domain of large language models (LLMs), in-context learning (ICL) has been recognized for its innovative ability to adapt to new tasks, relying on examples rather than retraining or fine-tuning. This paper delves into the critical…

密码学与安全 · 计算机科学 2025-06-03 Pengfei He , Han Xu , Yue Xing , Hui Liu , Makoto Yamada , Jiliang Tang

Model poisoning attacks are critical security threats to Federated Learning (FL). Existing model poisoning attacks suffer from two key limitations: 1) they achieve suboptimal effectiveness when defenses are deployed, and/or 2) they require…

密码学与安全 · 计算机科学 2025-08-14 Yueqi Xie , Minghong Fang , Neil Zhenqiang Gong

We consider availability data poisoning attacks, where an adversary aims to degrade the overall test accuracy of a machine learning model by crafting small perturbations to its training data. Existing poisoning strategies can achieve the…

密码学与安全 · 计算机科学 2024-06-07 Yiyong Liu , Michael Backes , Xiao Zhang

Data Poisoning attacks modify training data to maliciously control a model trained on such data. In this work, we focus on targeted poisoning attacks which cause a reclassification of an unmodified test image and as such breach model…

计算机视觉与模式识别 · 计算机科学 2021-05-11 Jonas Geiping , Liam Fowl , W. Ronny Huang , Wojciech Czaja , Gavin Taylor , Michael Moeller , Tom Goldstein

While recent works have indicated that federated learning (FL) may be vulnerable to poisoning attacks by compromised clients, their real impact on production FL systems is not fully understood. In this work, we aim to develop a…

机器学习 · 计算机科学 2021-12-14 Virat Shejwalkar , Amir Houmansadr , Peter Kairouz , Daniel Ramage

Data Poisoning (DP) is an effective attack that causes trained classifiers to misclassify their inputs. DP attacks significantly degrade a classifier's accuracy by covertly injecting attack samples into the training set. Broadly applicable…

机器学习 · 计算机科学 2022-05-13 Xi Li , David J. Miller , Zhen Xiang , George Kesidis

State-of-the-art machine learning models are vulnerable to data poisoning attacks whose purpose is to undermine the integrity of the model. However, the current literature on data poisoning attacks is mainly focused on ad hoc techniques…

机器学习 · 计算机科学 2021-02-12 Pooya Tavallali , Vahid Behzadan , Peyman Tavallali , Mukesh Singhal

Data poisoning is an adversarial scenario where an attacker feeds a specially crafted sequence of samples to an online model in order to subvert learning. We introduce Lethean Attack, a novel data poisoning technique that induces…

密码学与安全 · 计算机科学 2020-11-26 Eyal Perry

Predictions of certifiably robust classifiers remain constant in a neighborhood of a point, making them resilient to test-time attacks with a guarantee. In this work, we present a previously unrecognized threat to robust machine learning…

机器学习 · 计算机科学 2021-03-31 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Data poisoning is a type of adversarial attack on training data where an attacker manipulates a fraction of data to degrade the performance of machine learning model. Therefore, applications that rely on external data-sources for training…

机器学习 · 计算机科学 2021-04-28 Sanjay Seetharaman , Shubham Malaviya , Rosni KV , Manish Shukla , Sachin Lodha

Machine learning models have achieved great success in supervised learning tasks for end-to-end training, which requires a large amount of labeled data that is not always feasible. Recently, many practitioners have shifted to…

机器学习 · 计算机科学 2024-02-21 Yiwei Lu , Matthew Y. R. Yang , Gautam Kamath , Yaoliang Yu

Modern NLP models are often trained on public datasets drawn from diverse sources, rendering them vulnerable to data poisoning attacks. These attacks can manipulate the model's behavior in ways engineered by the attacker. One such tactic…

计算与语言 · 计算机科学 2024-05-21 Xuanli He , Qiongkai Xu , Jun Wang , Benjamin I. P. Rubinstein , Trevor Cohn

The lifecycle of large language models (LLMs) is far more complex than that of traditional machine learning models, involving multiple training stages, diverse data sources, and varied inference methods. While prior research on data…

密码学与安全 · 计算机科学 2025-02-21 Pengfei He , Yue Xing , Han Xu , Zhen Xiang , Jiliang Tang