English
Related papers

Related papers: Poisoned classifiers are not only backdoored, they…

200 papers

Federated learning enables thousands of participants to construct a deep learning model without sharing their private training data with each other. For example, multiple smartphones can jointly train a next-word predictor for keyboards…

Cryptography and Security · Computer Science 2019-08-07 Eugene Bagdasaryan , Andreas Veit , Yiqing Hua , Deborah Estrin , Vitaly Shmatikov

Large amounts of incremental learning algorithms have been proposed to alleviate the catastrophic forgetting issue arises while dealing with sequential data on a time series. However, the adversarial robustness of incremental learners has…

Cryptography and Security · Computer Science 2023-05-31 Yiqi Zhong , Xianming Liu , Deming Zhai , Junjun Jiang , Xiangyang Ji

Recent studies have demonstrated the susceptibility of deep neural networks to backdoor attacks. Given a backdoored model, its prediction of a poisoned sample with trigger will be dominated by the trigger information, though trigger…

Artificial Intelligence · Computer Science 2023-06-30 Mingli Zhu , Shaokui Wei , Hongyuan Zha , Baoyuan Wu

Textual backdoor attacks are a kind of practical threat to NLP systems. By injecting a backdoor in the training phase, the adversary could control model predictions via predefined triggers. As various attack and defense models have been…

Machine Learning · Computer Science 2022-11-02 Ganqu Cui , Lifan Yuan , Bingxiang He , Yangyi Chen , Zhiyuan Liu , Maosong Sun

Machine learning algorithms are vulnerable to poisoning attacks: An adversary can inject malicious points in the training dataset to influence the learning process and degrade the algorithm's performance. Optimal poisoning attacks have…

Machine Learning · Computer Science 2019-09-26 Luis Muñoz-González , Bjarne Pfitzner , Matteo Russo , Javier Carnerero-Cano , Emil C. Lupu

Multimodal contrastive learning methods like CLIP train on noisy and uncurated training datasets. This is cheaper than labeling datasets manually, and even improves out-of-distribution robustness. We show that this practice makes backdoor…

Machine Learning · Computer Science 2022-03-29 Nicholas Carlini , Andreas Terzis

We investigate security concerns of the emergent instruction tuning paradigm, that models are trained on crowdsourced datasets with task instructions to achieve superior performance. Our studies demonstrate that an attacker can inject…

Computation and Language · Computer Science 2024-04-04 Jiashu Xu , Mingyu Derek Ma , Fei Wang , Chaowei Xiao , Muhao Chen

Malware classifiers are subject to training-time exploitation due to the need to regularly retrain using samples collected from the wild. Recent work has demonstrated the feasibility of backdoor attacks against malware classifiers, and yet…

Cryptography and Security · Computer Science 2022-02-14 Limin Yang , Zhi Chen , Jacopo Cortellazzi , Feargus Pendlebury , Kevin Tu , Fabio Pierazzi , Lorenzo Cavallaro , Gang Wang

Backdoor attacks have become an emerging threat to NLP systems. By providing poisoned training data, the adversary can embed a "backdoor" into the victim model, which allows input instances satisfying certain textual patterns (e.g.,…

Computation and Language · Computer Science 2023-05-30 Jun Yan , Vansh Gupta , Xiang Ren

The backdoor attack poses a new security threat to deep neural networks. Existing backdoor often relies on visible universal trigger to make the backdoored model malfunction, which are not only usually visually suspicious to human but also…

Cryptography and Security · Computer Science 2024-12-24 Xiangqi Wang , Mingfu Xue , Kewei Chen , Jing Xu , Wenmao Liu , Leo Yu Zhang , Yushu Zhang

This paper presents Poisoning MorphNet, the first backdoor attack method on point clouds. Conventional adversarial attack takes place in the inference stage, often fooling a model by perturbing samples. In contrast, backdoor attack aims to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Guiyu Tian , Wenhao Jiang , Wei Liu , Yadong Mu

We investigate a new method for injecting backdoors into machine learning models, based on compromising the loss-value computation in the model-training code. We use it to demonstrate new classes of backdoors strictly more powerful than…

Cryptography and Security · Computer Science 2021-02-22 Eugene Bagdasaryan , Vitaly Shmatikov

When machine learning training is outsourced to third parties, $backdoor$ $attacks$ become practical as the third party who trains the model may act maliciously to inject hidden behaviors into the otherwise accurate model. Until now, the…

Cryptography and Security · Computer Science 2022-11-16 Sanghyun Hong , Nicholas Carlini , Alexey Kurakin

Backdoor attack against image classification task has been widely studied and proven to be successful, while there exist little research on the backdoor attack against vision-language models. In this paper, we explore backdoor attack…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Meiling Li , Nan Zhong , Xinpeng Zhang , Zhenxing Qian , Sheng Li

In autonomous driving, behavior prediction is fundamental for safe motion planning, hence the security and robustness of prediction models against adversarial attacks are of paramount importance. We propose a novel adversarial backdoor…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Mozhgan Pourkeshavarz , Mohammad Sabokrou , Amir Rasouli

The performance of a machine learning-based malware classifier depends on the large and updated training set used to induce its model. In order to maintain an up-to-date training set, there is a need to continuously collect benign and…

Cryptography and Security · Computer Science 2020-11-02 Tzvika Shapira , David Berend , Ishai Rosenberg , Yang Liu , Asaf Shabtai , Yuval Elovici

Backdoor attacks insert malicious data into a training set so that, during inference time, it misclassifies inputs that have been patched with a backdoor trigger as the malware specified label. For backdoor attacks to bypass human…

Cryptography and Security · Computer Science 2022-04-18 Yi Zeng , Minzhou Pan , Hoang Anh Just , Lingjuan Lyu , Meikang Qiu , Ruoxi Jia

Machine learning models are vulnerable to data-poisoning attacks, in which an attacker maliciously modifies the training set to change the prediction of a learned model. In a trigger-less attack, the attacker can modify the training set but…

Machine Learning · Computer Science 2022-10-18 Yuhao Zhang , Aws Albarghouthi , Loris D'Antoni

As the capacity of deep neural networks (DNNs) increases, their need for huge amounts of data significantly grows. A common practice is to outsource the training process or collect more data over the Internet, which introduces the risks of…

Machine Learning · Computer Science 2023-11-14 Soroush Hashemifar , Saeed Parsa , Morteza Zakeri-Nasrabadi

The rapid expansion of connected devices has made them prime targets for cyberattacks. To address these threats, deep learning-based, data-driven intrusion detection systems (IDS) have emerged as powerful tools for detecting and mitigating…

Machine Learning · Computer Science 2025-01-29 Ajesh Koyatan Chathoth , Stephen Lee