中文
相关论文

相关论文: PureGen: Universal Data Purification for Train-Tim…

200 篇论文

Untrusted data used to train a model might have been manipulated to endow the learned model with hidden properties that the data contributor might later exploit. Data purification aims to remove such manipulations prior to training the…

密码学与安全 · 计算机科学 2023-12-05 Zonghao Huang , Neil Gong , Michael K. Reiter

In a poisoning attack, an adversary with control over a small fraction of the training data attempts to select that data in a way that induces a corrupted model that misbehaves in favor of the adversary. We consider poisoning attacks…

机器学习 · 计算机科学 2021-04-22 Fnu Suya , Saeed Mahloujifar , Anshuman Suri , David Evans , Yuan Tian

Genomic foundation models trained on DNA sequences have demonstrated remarkable capabilities across diverse biological tasks, from variant effect prediction to genome design. These models are typically trained on massive, publicly sourced…

基因组学 · 定量生物学 2026-03-31 Charalampos Koilakos , Ioannis Mouratidis , Ilias Georgakopoulos-Soares

Black-box query-based attacks constitute significant threats to Machine Learning as a Service (MLaaS) systems since they can generate adversarial examples without accessing the target model's architecture and parameters. Traditional defense…

密码学与安全 · 计算机科学 2025-06-27 Ping Guo , Xiang Li , Zhiyuan Yang , Xi Lin , Qingchuan Zhao , Qingfu Zhang

We present a data poisoning attack -- Phantom Transfer -- with the property that, even if you know precisely how the poison was placed into an otherwise benign dataset, you cannot filter it out. We achieve this by modifying subliminal…

密码学与安全 · 计算机科学 2026-02-06 Andrew Draganov , Tolga H. Dur , Anandmayi Bhongade , Mary Phuong

Deep learning based models are vulnerable to adversarial attacks. These attacks can be much more harmful in case of targeted attacks, where an attacker tries not only to fool the deep learning model, but also to misguide the model to…

机器学习 · 计算机科学 2021-01-15 Pradeep Rathore , Arghya Basak , Sri Harsha Nistala , Venkataramana Runkana

This work introduces a verification framework that provides both sound and complete guarantees for data poisoning attacks during neural network training. We formulate adversarial data manipulation, model training, and test-time evaluation…

机器学习 · 计算机科学 2026-02-20 Philip Sosnin , Jodie Knapp , Fraser Kennedy , Josh Collyer , Calvin Tsay

Machine learning is becoming ubiquitous. From finance to medicine, machine learning models are boosting decision-making processes and even outperforming humans in some tasks. This huge progress in terms of prediction quality does not…

The generalization bound is a crucial theoretical tool for assessing the generalizability of learning methods and there exist vast literatures on generalizability of normal learning, adversarial learning, and data poisoning. Unlike other…

机器学习 · 计算机科学 2024-06-05 Lijia Yu , Shuang Liu , Yibo Miao , Xiao-Shan Gao , Lijun Zhang

Multimodal Diffusion Language Models (MDLMs) have recently emerged as a competitive alternative to their autoregressive counterparts. Yet their vulnerability to backdoor attacks remains largely unexplored. In this work, we show that…

密码学与安全 · 计算机科学 2026-02-27 Guangnian Wan , Qi Li , Gongfan Fang , Xinyin Ma , Xinchao Wang

We introduce camouflaged data poisoning attacks, a new attack vector that arises in the context of machine unlearning and other settings when model retraining may be induced. An adversary first adds a few carefully crafted points to the…

机器学习 · 计算机科学 2024-08-02 Jimmy Z. Di , Jack Douglas , Jayadev Acharya , Gautam Kamath , Ayush Sekhari

We introduce a new class of attacks on machine learning models. We show that an adversary who can poison a training dataset can cause models trained on this dataset to leak significant private details of training points belonging to other…

密码学与安全 · 计算机科学 2022-10-07 Florian Tramèr , Reza Shokri , Ayrton San Joaquin , Hoang Le , Matthew Jagielski , Sanghyun Hong , Nicholas Carlini

Machine learning models are vulnerable to data-poisoning attacks, in which an attacker maliciously modifies the training set to change the prediction of a learned model. In a trigger-less attack, the attacker can modify the training set but…

机器学习 · 计算机科学 2022-10-18 Yuhao Zhang , Aws Albarghouthi , Loris D'Antoni

Semi-supervised machine learning models learn from a (small) set of labeled training examples, and a (large) set of unlabeled training examples. State-of-the-art models can reach within a few percentage points of fully-supervised training,…

机器学习 · 计算机科学 2021-08-11 Nicholas Carlini

Generally, regularization-based continual learning models limit access to the previous task data to imitate the real-world constraints related to memory and privacy. However, this introduces a problem in these models by not being able to…

机器学习 · 计算机科学 2023-07-04 Gyojin Han , Jaehyun Choi , Hyeong Gwon Hong , Junmo Kim

The right to erasure requires removal of a user's information from data held by organizations, with rigorous interpretations extending to downstream products such as learned models. Retraining from scratch with the particular user's data…

机器学习 · 计算机科学 2022-02-11 Neil G. Marchant , Benjamin I. P. Rubinstein , Scott Alfeld

While state-of-the-art diffusion models (DMs) excel in image generation, concerns regarding their security persist. Earlier research highlighted DMs' vulnerability to data poisoning attacks, but these studies placed stricter requirements…

机器学习 · 计算机科学 2024-06-18 Zhuoshi Pan , Yuguang Yao , Gaowen Liu , Bingquan Shen , H. Vicky Zhao , Ramana Rao Kompella , Sijia Liu

We study backdoor poisoning attacks against image classification networks, whereby an attacker inserts a trigger into a subset of the training data, in such a way that at test time, this trigger causes the classifier to predict some target…

密码学与安全 · 计算机科学 2022-02-03 Muhammad Usman , Youcheng Sun , Divya Gopinath , Corina S. Pasareanu

The increasing access to data poses both opportunities and risks in deep learning, as one can manipulate the behaviors of deep learning models with malicious training samples. Such attacks are known as data poisoning. Recent advances in…

机器学习 · 计算机科学 2023-06-29 Wenxiao Wang , Soheil Feizi

Despite the strong multimodal performance, large vision-language models (LVLMs) are vulnerable during fine-tuning to backdoor attacks, where adversaries insert trigger-embedded samples into the training data to implant behaviors that can be…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Zhifang Zhang , Bojun Yang , Shuo He , Weitong Chen , Wei Emma Zhang , Olaf Maennel , Lei Feng , Miao Xu