English
Related papers

Related papers: BadNL: Backdoor Attacks against NLP Models with Se…

200 papers

Poisoning backdoor attacks involve an adversary manipulating the training data to induce certain behaviors in the victim model by inserting a trigger in the signal at inference time. We adapted clean label backdoor (CLBD)-data poisoning…

Cryptography and Security · Computer Science 2024-09-16 Henry Li Xinyuan , Sonal Joshi , Thomas Thebaud , Jesus Villalba , Najim Dehak , Sanjeev Khudanpur

We introduce a new attack against face verification systems based on Deep Neural Networks (DNN). The attack relies on the introduction into the network of a hidden backdoor, whose activation at test time induces a verification error…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Wei Guo , Benedetta Tondi , Mauro Barni

Textual backdoor attack, as a novel attack model, has been shown to be effective in adding a backdoor to the model during training. Defending against such backdoor attacks has become urgent and important. In this paper, we propose AttDef,…

Computation and Language · Computer Science 2023-08-08 Jiazhao Li , Zhuofeng Wu , Wei Ping , Chaowei Xiao , V. G. Vinod Vydiswaran

As deep neural networks (DNNs) are growing larger, their requirements for computational resources become huge, which makes outsourcing training more popular. Training in a third-party platform, however, may introduce potential risks that a…

Machine Learning · Computer Science 2021-10-28 Dongxian Wu , Yisen Wang

Deep Neural Networks (DNNs) are ubiquitous and span a variety of applications ranging from image classification to real-time object detection. As DNN models become more sophisticated, the computational cost of training these models becomes…

Cryptography and Security · Computer Science 2023-01-10 Hasan Abed Al Kader Hammoud , Bernard Ghanem

Outsourced deep neural networks have been demonstrated to suffer from patch-based trojan attacks, in which an adversary poisons the training sets to inject a backdoor in the obtained model so that regular inputs can be still labeled…

Cryptography and Security · Computer Science 2022-05-17 Ying He , Zhili Shen , Chang Xia , Jingyu Hua , Wei Tong , Sheng Zhong

Deep Neural Networks (DNNs) are known to be vulnerable to both backdoor and adversarial attacks. In the literature, these two types of attacks are commonly treated as distinct robustness problems and solved separately, since they belong to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Zhenxing Niu , Yuyao Sun , Qiguang Miao , Rong Jin , Gang Hua

The backdoor or Trojan attack is a severe threat to deep neural networks (DNNs). Researchers find that DNNs trained on benign data and settings can also learn backdoor behaviors, which is known as the natural backdoor. Existing works on…

Machine Learning · Computer Science 2022-10-28 Zhenting Wang , Hailun Ding , Juan Zhai , Shiqing Ma

Recent studies have revealed that \textit{Backdoor Attacks} can threaten the safety of natural language processing (NLP) models. Investigating the strategies of backdoor attacks will help to understand the model's vulnerability. Most…

Machine Learning · Computer Science 2023-10-26 Weimin Lyu , Songzhu Zheng , Lu Pang , Haibin Ling , Chao Chen

One major goal of the AI security community is to securely and reliably produce and deploy deep learning models for real-world applications. To this end, data poisoning based backdoor attacks on deep neural networks (DNNs) in the production…

Cryptography and Security · Computer Science 2022-05-30 Xiangyu Qi , Tinghao Xie , Ruizhe Pan , Jifeng Zhu , Yong Yang , Kai Bu

The backdoor attack poses a new security threat to deep neural networks. Existing backdoor often relies on visible universal trigger to make the backdoored model malfunction, which are not only usually visually suspicious to human but also…

Cryptography and Security · Computer Science 2024-12-24 Xiangqi Wang , Mingfu Xue , Kewei Chen , Jing Xu , Wenmao Liu , Leo Yu Zhang , Yushu Zhang

Large Language Models (LLMs) have achieved significantly advanced capabilities in understanding and generating human language text, which have gained increasing popularity over recent years. Apart from their state-of-the-art natural…

Cryptography and Security · Computer Science 2025-02-11 Yihe Zhou , Tao Ni , Wei-Bin Lee , Qingchuan Zhao

Backdoor attack has emerged as a novel and concerning threat to AI security. These attacks involve the training of Deep Neural Network (DNN) on datasets that contain hidden trigger patterns. Although the poisoned model behaves normally on…

Cryptography and Security · Computer Science 2024-03-06 Huasong Zhou , Xiaowei Xu , Xiaodong Wang , Leon Bevan Bullock

Deep neural networks (DNNs) can be manipulated to exhibit specific behaviors when exposed to specific trigger patterns, without affecting their performance on benign samples, dubbed \textit{backdoor attack}. Currently, implementing backdoor…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Ruotong Wang , Hongrui Chen , Zihao Zhu , Li Liu , Baoyuan Wu

Backdoor attacks significantly compromise the security of large language models by triggering them to output specific and controlled content. Currently, triggers for textual backdoor attacks fall into two categories: fixed-token triggers…

Cryptography and Security · Computer Science 2025-04-01 Jingyi Zheng , Tianyi Hu , Tianshuo Cong , Xinlei He

Backdoor attack is a severe threat to the trustworthiness of DNN-based language models. In this paper, we first extend the definition of memorization of language models from sample-wise to more fine-grained sentence element-wise (e.g.,…

Computation and Language · Computer Science 2024-09-24 Zhenting Wang , Zhizhi Wang , Mingyu Jin , Mengnan Du , Juan Zhai , Shiqing Ma

Natural language processing (NLP) models are known to be vulnerable to backdoor attacks, which poses a newly arisen threat to NLP models. Prior online backdoor defense methods for NLP models only focus on the anomalies at either the input…

Computation and Language · Computer Science 2022-10-17 Sishuo Chen , Wenkai Yang , Zhiyuan Zhang , Xiaohan Bi , Xu Sun

Trojan (backdoor) attack is a form of adversarial attack on deep neural networks where the attacker provides victims with a model trained/retrained on malicious data. The backdoor can be activated when a normal input is stamped with a…

Machine Learning · Computer Science 2021-01-05 Siyuan Cheng , Yingqi Liu , Shiqing Ma , Xiangyu Zhang

Deep neural networks (DNNs) have demonstrated remarkable performance across various tasks, including image and speech recognition. However, maximizing the effectiveness of DNNs requires meticulous optimization of numerous hyperparameters…

Cryptography and Security · Computer Science 2024-06-14 Gorka Abad , Oguzhan Ersoy , Stjepan Picek , Aitor Urbieta

Deep neural networks (DNN), despite their remarkable performance, are highly vulnerable to backdoor attacks. Existing defenses mainly rely on activation anomaly analysis or trigger reverse engineering and often require clean samples or…

Cryptography and Security · Computer Science 2026-05-20 Yinbo Yu , Jing Fang , Xuewen Zhang , Chunwei Tian , Qi Zhu , Daoqiang Zhang , Jiajia Liu