English
Related papers

Related papers: Certified Robustness to Clean-Label Poisoning Usin…

200 papers

Diffusion models have been recently employed to improve certified robustness through the process of denoising. However, the theoretical understanding of why diffusion models are able to improve the certified robustness is still lacking,…

Machine Learning · Computer Science 2022-11-02 Chaowei Xiao , Zhongzhu Chen , Kun Jin , Jiongxiao Wang , Weili Nie , Mingyan Liu , Anima Anandkumar , Bo Li , Dawn Song

Few-shot classification with foundation models (e.g., CLIP, DINOv2, PaLM-2) enables users to build an accurate classifier with a few labeled training samples (called support samples) for a classification task. However, an attacker could…

Cryptography and Security · Computer Science 2024-04-15 Yanting Wang , Wei Zou , Jinyuan Jia

Machine learning systems trained on user-provided data are susceptible to data poisoning attacks, whereby malicious users inject false training data with the aim of corrupting the learned model. While recent work has proposed a number of…

Machine Learning · Computer Science 2017-11-27 Jacob Steinhardt , Pang Wei Koh , Percy Liang

Targeted data poisoning attacks manipulate model predictions on specific test samples by injecting malicious data into training. Yet existing evaluations report average attack success rates over randomly selected targets, obscuring true…

Machine Learning · Computer Science 2026-05-25 William Xu , Chenyu Zhang , Yihan Wang , Matthew Y. R. Yang , Zuoqiu Liu , Gautam Kamath , Yaoliang Yu , Yiwei Lu

As in-the-wild data are increasingly involved in the training stage, machine learning applications become more susceptible to data poisoning attacks. Such attacks typically lead to test-time accuracy degradation or controlled misprediction.…

Cryptography and Security · Computer Science 2022-11-02 Yufei Chen , Chao Shen , Yun Shen , Cong Wang , Yang Zhang

The growing importance of massive datasets used for deep learning makes robustness to label noise a critical property for classifiers to have. Sources of label noise include automatic labeling, non-expert labeling, and label corruption by…

Machine Learning · Computer Science 2019-01-30 Dan Hendrycks , Mantas Mazeika , Duncan Wilson , Kevin Gimpel

Due to the increasing computational demand of Deep Neural Networks (DNNs), companies and organizations have begun to outsource the training process. However, the externally trained DNNs can potentially be backdoor attacked. It is crucial to…

Machine Learning · Computer Science 2023-07-04 Lu Pang , Tao Sun , Haibin Ling , Chao Chen

Poisoning attacks can disproportionately influence model behaviour by making small changes to the training corpus. While defences against specific poisoning attacks do exist, they in general do not provide any guarantees, leaving them…

Machine Learning · Computer Science 2024-03-19 Shijie Liu , Andrew C. Cullen , Paul Montague , Sarah M. Erfani , Benjamin I. P. Rubinstein

Backdoor attacks are emerging threats to deep neural networks, which typically embed malicious behaviors into a victim model by injecting poisoned samples. Adversaries can activate the injected backdoor during inference by presenting the…

Cryptography and Security · Computer Science 2025-12-05 Bingyin Zhao , Yingjie Lao

Recently, techniques have been developed to provably guarantee the robustness of a classifier to adversarial perturbations of bounded L_1 and L_2 magnitudes by using randomized smoothing: the robust classification is a consensus of base…

Machine Learning · Computer Science 2019-11-22 Alexander Levine , Soheil Feizi

In the domain of backdoor attacks, accurate labeling of injected data is essential for evading rudimentary detection mechanisms. This imperative has catalyzed the development of clean-label attacks, which are notably more elusive as they…

Cryptography and Security · Computer Science 2024-01-18 Binhao Ma , Jiahui Wang , Dejun Wang , Bo Meng

Semi-supervised Federated Learning (SSFL) has recently drawn much attention due to its practical consideration, i.e., the clients may only have unlabeled data. In practice, these SSFL systems implement semi-supervised training by assigning…

Machine Learning · Computer Science 2022-05-10 Yi Liu , Xingliang Yuan , Ruihui Zhao , Cong Wang , Dusit Niyato , Yefeng Zheng

We study indiscriminate poisoning for linear learners where an adversary injects a few crafted examples into the training data with the goal of forcing the induced model to incur higher test error. Inspired by the observation that linear…

Machine Learning · Computer Science 2023-11-13 Fnu Suya , Xiao Zhang , Yuan Tian , David Evans

Data poisoning attacks -- where an adversary can modify a small fraction of training data, with the goal of forcing the trained classifier to high loss -- are an important threat for machine learning in many applications. While a body of…

Machine Learning · Computer Science 2020-02-21 Yizhen Wang , Somesh Jha , Kamalika Chaudhuri

Deep learning techniques have enabled vast improvements in computer vision technologies. Nevertheless, these models are vulnerable to adversarial patch attacks which catastrophically impair performance. The physically realizable nature of…

Cryptography and Security · Computer Science 2025-06-02 Dennis Jacob , Chong Xiang , Prateek Mittal

Modern machine learning pipelines leverage large amounts of public data, making it infeasible to guarantee data quality and leaving models open to poisoning and backdoor attacks. Provably bounding model behavior under such attacks remains…

Machine Learning · Computer Science 2024-10-31 Philip Sosnin , Mark N. Müller , Maximilian Baader , Calvin Tsay , Matthew Wicker

Adversarial purification is one of the promising approaches to defend neural networks against adversarial attacks. Recently, methods utilizing diffusion probabilistic models have achieved great success for adversarial purification in image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Mingkun Zhang , Jianing Li , Wei Chen , Jiafeng Guo , Xueqi Cheng

While recent works have indicated that federated learning (FL) may be vulnerable to poisoning attacks by compromised clients, their real impact on production FL systems is not fully understood. In this work, we aim to develop a…

Machine Learning · Computer Science 2021-12-14 Virat Shejwalkar , Amir Houmansadr , Peter Kairouz , Daniel Ramage

As machine learning (ML) classifiers increasingly oversee the automated monitoring of network traffic, studying their resilience against adversarial attacks becomes critical. This paper focuses on poisoning attacks, specifically backdoor…

Cryptography and Security · Computer Science 2023-06-05 Giorgio Severi , Simona Boboila , Alina Oprea , John Holodnak , Kendra Kratkiewicz , Jason Matterer

Deep learning-based malware detection systems are vulnerable to adversarial EXEmples - carefully-crafted malicious programs that evade detection with minimal perturbation. As such, the community is dedicating effort to develop mechanisms to…

Cryptography and Security · Computer Science 2024-05-02 Daniel Gibert , Luca Demetrio , Giulio Zizzo , Quan Le , Jordi Planes , Battista Biggio