English
Related papers

Related papers: A Survey on Backdoor Attack and Defense in Natural…

200 papers

Deep learning has emerged as a strong and efficient framework that can be applied to a broad spectrum of complex learning problems which were difficult to solve using the traditional machine learning techniques in the past. In the last few…

Machine Learning · Computer Science 2018-10-02 Anirban Chakraborty , Manaar Alam , Vishal Dey , Anupam Chattopadhyay , Debdeep Mukhopadhyay

Deep learning models are vulnerable to various adversarial manipulations of their training data, parameters, and input sample. In particular, an adversary can modify the training data and model parameters to embed backdoors into the model,…

Machine Learning · Computer Science 2020-06-09 Te Juin Lester Tan , Reza Shokri

This article deals with adversarial attacks towards deep learning systems for Natural Language Processing (NLP), in the context of privacy protection. We study a specific type of attack: an attacker eavesdrops on the hidden representations…

Computation and Language · Computer Science 2018-08-29 Maximin Coavoux , Shashi Narayan , Shay B. Cohen

Deep neural networks have been demonstrated to be vulnerable to backdoor attacks. Specifically, by injecting a small number of maliciously constructed inputs into the training set, an adversary is able to plant a backdoor into the trained…

Machine Learning · Statistics 2019-12-10 Alexander Turner , Dimitris Tsipras , Aleksander Madry

The last decade has seen a rise of Deep Learning with its applications ranging across diverse domains. But usually, the datasets used to drive these systems contain data which is highly confidential and sensitive. Though, Deep Learning…

Cryptography and Security · Computer Science 2022-12-09 Vishal Jignesh Gandhi , Sanchit Shokeen , Saloni Koshti

Adversarial attacks and backdoor attacks are two common security threats that hang over deep learning. Both of them harness task-irrelevant features of data in their implementation. Text style is a feature that is naturally irrelevant to…

Computation and Language · Computer Science 2021-10-15 Fanchao Qi , Yangyi Chen , Xurui Zhang , Mukai Li , Zhiyuan Liu , Maosong Sun

In the past few years, it has become increasingly evident that deep neural networks are not resilient enough to withstand adversarial perturbations in input data, leaving them vulnerable to attack. Various authors have proposed strong…

Computation and Language · Computer Science 2023-04-19 Shreya Goyal , Sumanth Doddapaneni , Mitesh M. Khapra , Balaraman Ravindran

We conduct a systematic study of backdoor vulnerabilities in normally trained Deep Learning models. They are as dangerous as backdoors injected by data poisoning because both can be equally exploited. We leverage 20 different types of…

Cryptography and Security · Computer Science 2022-11-30 Guanhong Tao , Zhenting Wang , Siyuan Cheng , Shiqing Ma , Shengwei An , Yingqi Liu , Guangyu Shen , Zhuo Zhang , Yunshu Mao , Xiangyu Zhang

The ever-growing advances of deep learning in many areas including vision, recommendation systems, natural language processing, etc., have led to the adoption of Deep Neural Networks (DNNs) in production systems. The availability of large…

Deep learning has transformed AI applications but faces critical security challenges, including adversarial attacks, data poisoning, model theft, and privacy leakage. This survey examines these vulnerabilities, detailing their mechanisms…

Large Language Models (LLMs) have become a cornerstone in the field of Natural Language Processing (NLP), offering transformative capabilities in understanding and generating human-like text. However, with their rising prominence, the…

Cryptography and Security · Computer Science 2024-03-26 Arijit Ghosh Chowdhury , Md Mofijul Islam , Vaibhav Kumar , Faysal Hossain Shezan , Vaibhav Kumar , Vinija Jain , Aman Chadha

Backdoor attacks embed hidden malicious behaviors into deep learning models, which only activate and cause misclassifications on model inputs containing a specific trigger. Existing works on backdoor attacks and defenses, however, mostly…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Emily Wenger , Josephine Passananti , Arjun Bhagoji , Yuanshun Yao , Haitao Zheng , Ben Y. Zhao

The advancement of Large Language Models (LLMs) has significantly impacted various domains, including Web search, healthcare, and software development. However, as these models scale, they become more vulnerable to cybersecurity risks,…

Cryptography and Security · Computer Science 2024-10-01 Qin Liu , Wenjie Mo , Terry Tong , Jiashu Xu , Fei Wang , Chaowei Xiao , Muhao Chen

Modern NLP models are often trained on public datasets drawn from diverse sources, rendering them vulnerable to data poisoning attacks. These attacks can manipulate the model's behavior in ways engineered by the attacker. One such tactic…

Computation and Language · Computer Science 2024-05-21 Xuanli He , Qiongkai Xu , Jun Wang , Benjamin I. P. Rubinstein , Trevor Cohn

Backdoor attack is a severe threat to the trustworthiness of DNN-based language models. In this paper, we first extend the definition of memorization of language models from sample-wise to more fine-grained sentence element-wise (e.g.,…

Computation and Language · Computer Science 2024-09-24 Zhenting Wang , Zhizhi Wang , Mingyu Jin , Mengnan Du , Juan Zhai , Shiqing Ma

Recent studies have revealed that deep neural networks (DNNs) are vulnerable to backdoor attacks, where attackers embed hidden backdoors in the DNN model by poisoning a few training samples. The attacked model behaves normally on benign…

Cryptography and Security · Computer Science 2022-02-09 Kunzhe Huang , Yiming Li , Baoyuan Wu , Zhan Qin , Kui Ren

In a backdoor attack on a machine learning model, an adversary produces a model that performs well on normal inputs but outputs targeted misclassifications on inputs containing a small trigger pattern. Model compression is a widely-used…

Cryptography and Security · Computer Science 2021-05-03 Yulong Tian , Fnu Suya , Fengyuan Xu , David Evans

Federated learning (FL) is a machine learning (ML) approach that allows the use of distributed data without compromising personal privacy. However, the heterogeneous distribution of data among clients in FL can make it difficult for the…

Machine Learning · Computer Science 2023-03-07 Thuy Dung Nguyen , Tuan Nguyen , Phi Le Nguyen , Hieu H. Pham , Khoa Doan , Kok-Seng Wong

With the rise of advanced reasoning capabilities, large language models (LLMs) are receiving increasing attention. However, although reasoning improves LLMs' performance on downstream tasks, it also introduces new security risks, as…

Cryptography and Security · Computer Science 2025-10-10 Man Hu , Xinyi Wu , Zuofeng Suo , Jinbo Feng , Linghui Meng , Yanhao Jia , Anh Tuan Luu , Shuai Zhao

Backdoor attacks on deep neural networks have emerged as significant security threats, especially as DNNs are increasingly deployed in security-critical applications. However, most existing works assume that the attacker has access to the…

Cryptography and Security · Computer Science 2024-08-22 Jiahao Wang , Xianglong Zhang , Xiuzhen Cheng , Pengfei Hu , Guoming Zhang