中文
相关论文

相关论文: Generalizable Targeted Data Poisoning against Vary…

200 篇论文

Differential Privacy (DP) is a mathematical framework that is increasingly deployed to mitigate privacy risks associated with machine learning and statistical analyses. Despite the growing adoption of DP, its technical privacy parameters do…

密码学与安全 · 计算机科学 2024-05-06 Rachel Cummings , Shlomi Hod , Jayshree Sarathy , Marika Swanberg

Due to respectively limited training data, different entities addressing the same vision task based on certain sensitive images may not train a robust deep network. This paper introduces a new vision task where various entities share…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Hao Guo , Brian Dolhansky , Eric Hsin , Phong Dinh , Cristian Canton Ferrer , Song Wang

Semi-supervised learning methods can train high-accuracy machine learning models with a fraction of the labeled training samples required for traditional supervised learning. Such methods do not typically involve close review of the…

机器学习 · 计算机科学 2022-12-07 Marissa Connor , Vincent Emanuele

Local differential privacy (LDP) involves users perturbing their inputs to provide plausible deniability of their data. However, this also makes LDP vulnerable to poisoning attacks. In this paper, we first introduce novel poisoning attacks…

密码学与安全 · 计算机科学 2025-07-01 Pei Zhan , Peng Tang , Yangzhuo Li , Puwen Wei , Shanqing Guo

Most recent studies have shown several vulnerabilities to attacks with the potential to jeopardize the integrity of the model, opening in a few recent years a new window of opportunity in terms of cyber-security. The main interest of this…

Machine learning models have achieved great success in supervised learning tasks for end-to-end training, which requires a large amount of labeled data that is not always feasible. Recently, many practitioners have shifted to…

机器学习 · 计算机科学 2024-02-21 Yiwei Lu , Matthew Y. R. Yang , Gautam Kamath , Yaoliang Yu

Recently, advanced NLP models have seen a surge in the usage of various applications. This raises the security threats of the released models. In addition to the clean models' unintentional weaknesses, {\em i.e.,} adversarial attacks, the…

计算与语言 · 计算机科学 2021-01-18 Lichao Sun

Deep learning models have recently shown to be vulnerable to backdoor poisoning, an insidious attack where the victim model predicts clean images correctly but classifies the same images as the target class when a trigger poison pattern is…

计算机视觉与模式识别 · 计算机科学 2019-11-20 Alvin Chan , Yew-Soon Ong

Test-time personalization in federated learning enables models at clients to adjust online to local domain shifts, enhancing robustness and personalization in deployment. Yet, existing federated learning work largely overlooks the security…

密码学与安全 · 计算机科学 2025-11-25 Md Akil Raihan Iftee , Syed Md. Ahnaf Hasan , Amin Ahsan Ali , AKM Mahbubur Rahman , Sajib Mistry , Aneesh Krishna

Decentralized Federated Learning (DFL), a paradigm for managing big data in a privacy-preserved manner, is still vulnerable to poisoning attacks where malicious clients tamper with data or models. Current defense methods often assume…

密码学与安全 · 计算机科学 2024-11-13 Chao Feng , Alberto Huertas Celdrán , Zien Zeng , Zi Ye , Jan von der Assen , Gerome Bovet , Burkhard Stiller

Poisoning attacks pose significant challenges to the robustness of diffusion models (DMs). In this paper, we systematically analyze when and where poisoning attacks textual inversion (TI), a widely used personalization technique for DMs. We…

密码学与安全 · 计算机科学 2025-09-04 Jeremy Styborski , Mingzhi Lyu , Jiayou Lu , Nupur Kapur , Adams Kong

Targeted clean-label data poisoning is a type of adversarial attack on machine learning systems in which an adversary injects a few correctly-labeled, minimally-perturbed samples into the training data, causing a model to misclassify a…

机器学习 · 计算机科学 2020-08-14 Neehar Peri , Neal Gupta , W. Ronny Huang , Liam Fowl , Chen Zhu , Soheil Feizi , Tom Goldstein , John P. Dickerson

Backdoor and data-poisoning attacks can flip predictions with tiny training corruptions, yet a sharp theory linking poisoning strength, overparameterization, and regularization is lacking. We analyze ridge least squares with an unpenalized…

机器学习 · 统计学 2026-01-06 Donald Flynn , Diego Granziol

Poisoning-based backdoor attacks expose vulnerabilities in the data preparation stage of deep neural network (DNN) training. The DNNs trained on the poisoned dataset will be embedded with a backdoor, making them behave well on clean data…

计算机视觉与模式识别 · 计算机科学 2024-05-10 Binxiao Huang , Jason Chun Lok , Chang Liu , Ngai Wong

The lifecycle of large language models (LLMs) is far more complex than that of traditional machine learning models, involving multiple training stages, diverse data sources, and varied inference methods. While prior research on data…

密码学与安全 · 计算机科学 2025-02-21 Pengfei He , Yue Xing , Han Xu , Zhen Xiang , Jiliang Tang

We propose a novel clustering mechanism based on an incompatibility property between subsets of data that emerges during model training. This mechanism partitions the dataset into subsets that generalize only to themselves, i.e., training…

机器学习 · 计算机科学 2023-04-28 Charles Jin , Melinda Sun , Martin Rinard

This paper proposes and investigates a new approach for detecting and preventing several different types of poisoning attacks from affecting a centralized Federated Learning model via average accuracy deviation detection (AADD). By…

密码学与安全 · 计算机科学 2022-10-28 Viktor Valadi , Madeleine Englund , Mark Spanier , Austin O'brien

Machine learning systems trained on user-provided data are susceptible to data poisoning attacks, whereby malicious users inject false training data with the aim of corrupting the learned model. While recent work has proposed a number of…

机器学习 · 计算机科学 2017-11-27 Jacob Steinhardt , Pang Wei Koh , Percy Liang

Backdoor data poisoning is an emerging form of adversarial attack usually against deep neural network image classifiers. The attacker poisons the training set with a relatively small set of images from one (or several) source class(es),…

机器学习 · 计算机科学 2020-10-16 Zhen Xiang , David J. Miller , George Kesidis

Many methods have been developed to understand complex predictive models and high expectations are placed on post-hoc model explainability. It turns out that such explanations are not robust nor trustworthy, and they can be fooled. This…

机器学习 · 计算机科学 2023-03-21 Hubert Baniecki , Wojciech Kretowicz , Przemyslaw Biecek