中文
相关论文

相关论文: Provably effective detection of effective data poi…

200 篇论文

We revisit the efficacy of several practical methods for approximate machine unlearning developed for large-scale deep learning. In addition to complying with data deletion requests, one often-cited potential application for unlearning…

机器学习 · 计算机科学 2026-01-16 Martin Pawelczyk , Jimmy Z. Di , Yiwei Lu , Gautam Kamath , Ayush Sekhari , Seth Neel

We present a data poisoning attack -- Phantom Transfer -- with the property that, even if you know precisely how the poison was placed into an otherwise benign dataset, you cannot filter it out. We achieve this by modifying subliminal…

密码学与安全 · 计算机科学 2026-02-06 Andrew Draganov , Tolga H. Dur , Anandmayi Bhongade , Mary Phuong

Machine learning has proved invaluable for a range of different tasks, yet it also proved vulnerable to evasion attacks, i.e., maliciously crafted perturbations of input data designed to force mispredictions. In this paper we propose a…

机器学习 · 计算机科学 2020-07-07 Stefano Calzavara , Pietro Ferrara , Claudio Lucchese

The efficacy of availability poisoning, a method of poisoning data by injecting imperceptible perturbations to prevent its use in model training, has been a hot subject of investigation. Previous research suggested that it was difficult to…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Tianrui Qin , Xitong Gao , Juanjuan Zhao , Kejiang Ye , Cheng-Zhong Xu

Data poisoning -- the process by which an attacker takes control of a model by making imperceptible changes to a subset of the training data -- is an emerging threat in the context of neural networks. Existing attacks for data poisoning…

机器学习 · 计算机科学 2021-02-23 W. Ronny Huang , Jonas Geiping , Liam Fowl , Gavin Taylor , Tom Goldstein

With the rise of artificial intelligence and machine learning in modern computing, one of the major concerns regarding such techniques is to provide privacy and security against adversaries. We present this survey paper to cover the most…

密码学与安全 · 计算机科学 2022-02-09 Wenjun Qiu

Data poisoning is a threat model in which a malicious actor tampers with training data to manipulate outcomes at inference time. A variety of defenses against this threat model have been proposed, but each suffers from at least one of the…

机器学习 · 计算机科学 2022-02-21 Jonas Geiping , Liam Fowl , Gowthami Somepalli , Micah Goldblum , Michael Moeller , Tom Goldstein

Targeted clean-label data poisoning is a type of adversarial attack on machine learning systems in which an adversary injects a few correctly-labeled, minimally-perturbed samples into the training data, causing a model to misclassify a…

机器学习 · 计算机科学 2020-08-14 Neehar Peri , Neal Gupta , W. Ronny Huang , Liam Fowl , Chen Zhu , Soheil Feizi , Tom Goldstein , John P. Dickerson

Graph-based Semi-Supervised Learning (GSSL) is a practical solution to learn from a limited amount of labelled data together with a vast amount of unlabelled data. However, due to their reliance on the known labels to infer the unknown…

机器学习 · 计算机科学 2022-05-12 Adriano Franci , Maxime Cordy , Martin Gubri , Mike Papadakis , Yves Le Traon

Data poisoning is an adversarial scenario where an attacker feeds a specially crafted sequence of samples to an online model in order to subvert learning. We introduce Lethean Attack, a novel data poisoning technique that induces…

密码学与安全 · 计算机科学 2020-11-26 Eyal Perry

Deep learning models have recently shown to be vulnerable to backdoor poisoning, an insidious attack where the victim model predicts clean images correctly but classifies the same images as the target class when a trigger poison pattern is…

计算机视觉与模式识别 · 计算机科学 2019-11-20 Alvin Chan , Yew-Soon Ong

Local Differential Privacy (LDP) protocols enable an untrusted data collector to perform privacy-preserving data analytics. In particular, each user locally perturbs its data to preserve privacy before sending it to the data collector, who…

密码学与安全 · 计算机科学 2020-12-10 Xiaoyu Cao , Jinyuan Jia , Neil Zhenqiang Gong

In the evolving landscape of Federated Learning (FL), a new type of attacks concerns the research community, namely Data Poisoning Attacks, which threaten the model integrity by maliciously altering training data. This paper introduces a…

密码学与安全 · 计算机科学 2024-04-22 Nick Galanis

Neural networks are vulnerable to backdoor poisoning attacks, where the attackers maliciously poison the training set and insert triggers into the test input to change the prediction of the victim model. Existing defenses for backdoor…

密码学与安全 · 计算机科学 2024-05-21 Yuhao Zhang , Aws Albarghouthi , Loris D'Antoni

Machine learning systems are deployed in critical settings, but they might fail in unexpected ways, impacting the accuracy of their predictions. Poisoning attacks against machine learning induce adversarial modification of data used by a…

机器学习 · 计算机科学 2021-05-13 Matthew Jagielski , Giorgio Severi , Niklas Pousette Harger , Alina Oprea

Counterfactual explanations are a widely used approach for examining the predictions of black-box systems. They can offer the opportunity for computational recourse by suggesting actionable changes on how to alter the input to obtain a…

机器学习 · 计算机科学 2025-07-29 André Artelt , Shubham Sharma , Freddy Lecué , Barbara Hammer

As in-the-wild data are increasingly involved in the training stage, machine learning applications become more susceptible to data poisoning attacks. Such attacks typically lead to test-time accuracy degradation or controlled misprediction.…

密码学与安全 · 计算机科学 2022-11-02 Yufei Chen , Chao Shen , Yun Shen , Cong Wang , Yang Zhang

Deep learning models are often trained on distributed, web-scale datasets crawled from the internet. In this paper, we introduce two new dataset poisoning attacks that intentionally introduce malicious examples to a model's performance. Our…

As machine learning systems grow in scale, so do their training data requirements, forcing practitioners to automate and outsource the curation of training data in order to achieve state-of-the-art performance. The absence of trustworthy…

Machine learning models have achieved great success in supervised learning tasks for end-to-end training, which requires a large amount of labeled data that is not always feasible. Recently, many practitioners have shifted to…

机器学习 · 计算机科学 2024-02-21 Yiwei Lu , Matthew Y. R. Yang , Gautam Kamath , Yaoliang Yu