中文
相关论文

相关论文: When and Where do Data Poisons Attack Textual Inve…

200 篇论文

This paper proposes an online environment poisoning algorithm tailored for reinforcement learning agents operating in a black-box setting, where an adversary deliberately manipulates training data to lead the agent toward a mischievous…

机器学习 · 计算机科学 2024-12-03 Jianhui Li , Bokang Zhang , Junfeng Wu

We introduce camouflaged data poisoning attacks, a new attack vector that arises in the context of machine unlearning and other settings when model retraining may be induced. An adversary first adds a few carefully crafted points to the…

机器学习 · 计算机科学 2024-08-02 Jimmy Z. Di , Jack Douglas , Jayadev Acharya , Gautam Kamath , Ayush Sekhari

Generally, regularization-based continual learning models limit access to the previous task data to imitate the real-world constraints related to memory and privacy. However, this introduces a problem in these models by not being able to…

机器学习 · 计算机科学 2023-07-04 Gyojin Han , Jaehyun Choi , Hyeong Gwon Hong , Junmo Kim

Data poisoning for reinforcement learning has historically focused on general performance degradation, and targeted attacks have been successful via perturbations that involve control of the victim's policy and rewards. We introduce an…

机器学习 · 计算机科学 2022-07-29 Harrison Foley , Liam Fowl , Tom Goldstein , Gavin Taylor

Deep neural networks are vulnerable to adversarial attacks, where a small perturbation to an input alters the model prediction. In many cases, malicious inputs intentionally crafted for one model can fool another model. In this paper, we…

机器学习 · 计算机科学 2021-09-23 Liping Yuan , Xiaoqing Zheng , Yi Zhou , Cho-Jui Hsieh , Kai-wei Chang

Regression models, which are widely used from engineering applications to financial forecasting, are vulnerable to targeted malicious attacks such as training data poisoning, through which adversaries can manipulate their predictions.…

机器学习 · 计算机科学 2020-08-24 Sandamal Weerasinghe , Sarah M. Erfani , Tansu Alpcan , Christopher Leckie , Justin Kopacz

The proliferation of text-to-image diffusion models (T2I DMs) has led to an increased presence of AI-generated images in daily life. However, biased T2I models can generate content with specific tendencies, potentially influencing people's…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Huayang Huang , Xiangye Jin , Jiaxu Miao , Yu Wu

Despite the remarkable generation capabilities of diffusion models, recent studies have shown that they can memorize and create harmful content when given specific text prompts. Although fine-tuning approaches have been developed to…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Siyi Chen , Yimeng Zhang , Sijia Liu , Qing Qu

Despite their recent success, deep neural networks continue to perform poorly when they encounter distribution shifts at test time. Many recently proposed approaches try to counter this by aligning the model to the new distribution prior to…

计算机视觉与模式识别 · 计算机科学 2022-09-26 Samarth Sinha , Peter Gehler , Francesco Locatello , Bernt Schiele

In targeted poisoning attacks, an attacker manipulates an agent-environment interaction to force the agent into adopting a policy of interest, called target policy. Prior work has primarily focused on attacks that modify standard MDP…

机器学习 · 计算机科学 2023-02-28 Mohammad Mohammadi , Jonathan Nöther , Debmalya Mandal , Adish Singla , Goran Radanovic

Speaker embedding based zero-shot Text-to-Speech (TTS) systems enable high-quality speech synthesis for unseen speakers using minimal data. However, these systems are vulnerable to adversarial attacks, where an attacker introduces…

音频与语音处理 · 电气工程与系统科学 2025-10-07 Ze Li , Yao Shi , Yunfei Xu , Ming Li

Backdoor data poisoning, inserted within instruction examples used to fine-tune a foundation Large Language Model (LLM) for downstream tasks (\textit{e.g.,} sentiment prediction), is a serious security concern due to the evasive nature of…

密码学与安全 · 计算机科学 2024-08-23 Jayaram Raghuram , George Kesidis , David J. Miller

Collecting training data from untrusted sources exposes machine learning services to poisoning adversaries, who maliciously manipulate training data to degrade the model accuracy. When trained on offline datasets, poisoning adversaries have…

机器学习 · 计算机科学 2021-10-27 Tianyu Pang , Xiao Yang , Yinpeng Dong , Hang Su , Jun Zhu

Diffusion models (DMs) have achieved state-of-the-art performance on various generative tasks such as image synthesis, text-to-image, and text-guided image-to-image generation. However, the more powerful the DMs, the more harmful they…

密码学与安全 · 计算机科学 2024-08-08 Vu Tuan Truong , Luan Ba Dang , Long Bao Le

Distillation-based federated learning has emerged as a promising collaborative learning approach, where clients share the output logit vectors of a public dataset rather than their private model parameters. This practice reduces the risk of…

密码学与安全 · 计算机科学 2024-02-01 Yonghao Yu , Shunan Zhu , Jinglu Hu

Federated learning combines local updates from clients to produce a global model, which is susceptible to poisoning attacks. Most previous defense strategies relied on vectors derived from projections of local updates on a Euclidean space;…

机器学习 · 计算机科学 2024-04-19 Sungwon Han , Hyeonho Song , Sungwon Park , Meeyoung Cha

As machine learning (ML) classifiers increasingly oversee the automated monitoring of network traffic, studying their resilience against adversarial attacks becomes critical. This paper focuses on poisoning attacks, specifically backdoor…

密码学与安全 · 计算机科学 2023-06-05 Giorgio Severi , Simona Boboila , Alina Oprea , John Holodnak , Kendra Kratkiewicz , Jason Matterer

Adversaries can embed backdoors in deep learning models by introducing backdoor poison samples into training datasets. In this work, we investigate how to detect such poison samples to mitigate the threat of backdoor attacks. First, we…

机器学习 · 计算机科学 2023-06-21 Xiangyu Qi , Tinghao Xie , Jiachen T. Wang , Tong Wu , Saeed Mahloujifar , Prateek Mittal

Model inversion (MI) attacks are aimed at reconstructing training data from model parameters. Such attacks have triggered increasing concerns about privacy, especially given a growing number of online model repositories. However, existing…

机器学习 · 计算机科学 2021-08-20 Si Chen , Mostafa Kahla , Ruoxi Jia , Guo-Jun Qi

In the evolving landscape of Federated Learning (FL), a new type of attacks concerns the research community, namely Data Poisoning Attacks, which threaten the model integrity by maliciously altering training data. This paper introduces a…

密码学与安全 · 计算机科学 2024-04-22 Nick Galanis