中文
相关论文

相关论文: Strong Data Augmentation Sanitizes Poisoning and B…

200 篇论文

Predictions of certifiably robust classifiers remain constant in a neighborhood of a point, making them resilient to test-time attacks with a guarantee. In this work, we present a previously unrecognized threat to robust machine learning…

机器学习 · 计算机科学 2021-03-31 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Backdoor attacks pose a critical threat to machine learning models, causing them to behave normally on clean data but misclassify poisoned data into a poisoned class. Existing defenses often attempt to identify and remove backdoor neurons…

机器学习 · 计算机科学 2025-11-13 Kazuki Iwahana , Yusuke Yamasaki , Akira Ito , Takayuki Miura , Toshiki Shibahara

Mixed Sample Data Augmentation (MSDA) has received increasing attention in recent years, with many successful variants such as MixUp and CutMix. By studying the mutual information between the function learned by a VAE on the original data…

机器学习 · 计算机科学 2021-03-02 Ethan Harris , Antonia Marcu , Matthew Painter , Mahesan Niranjan , Adam Prügel-Bennett , Jonathon Hare

Data augmentation is widely used to mitigate data bias in the training dataset. However, data augmentation exposes machine learning models to privacy attacks, such as membership inference attacks. In this paper, we propose an effective…

机器学习 · 计算机科学 2024-04-23 Zhixin Pan , Emma Andrews , Laura Chang , Prabhat Mishra

The distributed nature of local differential privacy (LDP) invites data poisoning attacks and poses unforeseen threats to the underlying LDP-supported applications. In this paper, we propose a comprehensive mitigation framework for popular…

密码学与安全 · 计算机科学 2025-06-18 Xiaolin Li , Ninghui Li , Boyang Wang , Wenhai Sun

The recent success of machine learning (ML) has been fueled by the increasing availability of computing power and large amounts of data in many different applications. However, the trustworthiness of the resulting models can be compromised…

密码学与安全 · 计算机科学 2024-03-11 Antonio Emanuele Cinà , Kathrin Grosse , Ambra Demontis , Battista Biggio , Fabio Roli , Marcello Pelillo

In this work, we investigate the concept of biometric backdoors: a template poisoning attack on biometric systems that allows adversaries to stealthily and effortlessly impersonate users in the long-term by exploiting the template update…

密码学与安全 · 计算机科学 2020-11-06 Giulio Lovisotto , Simon Eberz , Ivan Martinovic

Collecting training data from untrusted sources exposes machine learning services to poisoning adversaries, who maliciously manipulate training data to degrade the model accuracy. When trained on offline datasets, poisoning adversaries have…

机器学习 · 计算机科学 2021-10-27 Tianyu Pang , Xiao Yang , Yinpeng Dong , Hang Su , Jun Zhu

As machine learning becomes widely used for automated decisions, attackers have strong incentives to manipulate the results and models generated by machine learning algorithms. In this paper, we perform the first systematic study of…

密码学与安全 · 计算机科学 2021-09-29 Matthew Jagielski , Alina Oprea , Battista Biggio , Chang Liu , Cristina Nita-Rotaru , Bo Li

Backdoor attacks, representing an emerging threat to the integrity of deep neural networks, have garnered significant attention due to their ability to compromise deep learning systems clandestinely. While numerous backdoor attacks occur…

密码学与安全 · 计算机科学 2024-03-18 Sze Jue Yang , Chinh D. La , Quang H. Nguyen , Kok-Seng Wong , Anh Tuan Tran , Chee Seng Chan , Khoa D. Doan

Backdoor and data poisoning attacks can achieve high attack success while evading existing spectral and optimisation based defences. We show that this behaviour is not incidental, but arises from a fundamental geometric mechanism in input…

机器学习 · 统计学 2026-02-03 Diego Granziol

Data augmentation has become a standard component of vision pre-trained models to capture the invariance between augmented views. In practice, augmentation techniques that mask regions of a sample with zero/mean values or patches from other…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Shentong Mo , Zhun Sun , Chao Li

As more and more artificial intelligence (AI) technologies move from the laboratory to real-world applications, the open-set and robustness challenges brought by data from the real world have received increasing attention. Data augmentation…

机器学习 · 计算机科学 2022-12-09 Zhendong Liu , Wenyu Jiang , Min guo , Chongjun Wang

Malicious clients can attack federated learning systems using malicious data, including backdoor samples, during the training phase. The compromised global model will perform well on the validation dataset designed for the task, but a small…

密码学与安全 · 计算机科学 2021-01-18 Chen Wu , Xian Yang , Sencun Zhu , Prasenjit Mitra

Train-time data poisoning attacks threaten machine learning models by introducing adversarial examples during training, leading to misclassification. Current defense methods often reduce generalization performance, are attack-specific, and…

机器学习 · 计算机科学 2024-06-04 Sunay Bhat , Jeffrey Jiang , Omead Pooladzandi , Alexander Branch , Gregory Pottie

Machine learning algorithms are vulnerable to data poisoning attacks. Prior taxonomies that focus on specific scenarios, e.g., indiscriminate or targeted, have enabled defenses for the corresponding subset of known attacks. Yet, this…

密码学与安全 · 计算机科学 2020-03-02 Sanghyun Hong , Varun Chandrasekaran , Yiğitcan Kaya , Tudor Dumitraş , Nicolas Papernot

Backdoor attacks pose a significant threat to the integrity and reliability of Artificial Intelligence (AI) models, enabling adversaries to manipulate model behavior by injecting poisoned data with hidden triggers. These attacks can lead to…

机器学习 · 计算机科学 2026-03-31 Osama Wehbi , Sarhad Arisdakessian , Omar Abdel Wahab , Azzam Mourad , Hadi Otrok , Jamal Bentahar

Recent studies have revealed the vulnerability of deep neural networks (DNNs) to various backdoor attacks, where the behavior of DNNs can be compromised by utilizing certain types of triggers or poisoning mechanisms. State-of-the-art (SOTA)…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Nazmul Karim , Abdullah Al Arafat , Umar Khalid , Zhishan Guo , Nazanin Rahnavard

Backdoor data poisoning is an emerging form of adversarial attack usually against deep neural network image classifiers. The attacker poisons the training set with a relatively small set of images from one (or several) source class(es),…

机器学习 · 计算机科学 2020-10-16 Zhen Xiang , David J. Miller , George Kesidis

The rise of foundation models fine-tuned on human feedback from potentially untrusted users has increased the risk of adversarial data poisoning, necessitating the study of robustness of learning algorithms against such attacks. Existing…

机器学习 · 计算机科学 2025-02-25 Avinandan Bose , Laurent Lessard , Maryam Fazel , Krishnamurthy Dj Dvijotham