English
Related papers

Related papers: Backdoor Learning for NLP: Recent Advances, Challe…

200 papers

Neural networks have achieved state-of-the-art performance in solving many problems, including many applications in safety/security-critical systems. Researchers also discovered multiple security issues associated with neural networks. One…

Cryptography and Security · Computer Science 2022-05-17 Long H. Pham , Jun Sun

As an efficient approach to understand, generate, and process natural language texts, research in natural language processing (NLP) has exhibited a rapid spread and wide adoption in recent years. Given the increasing research work in this…

Computation and Language · Computer Science 2023-09-26 Tim Schopf , Karim Arabi , Florian Matthes

In the past few years, it has become increasingly evident that deep neural networks are not resilient enough to withstand adversarial perturbations in input data, leaving them vulnerable to attack. Various authors have proposed strong…

Computation and Language · Computer Science 2023-04-19 Shreya Goyal , Sumanth Doddapaneni , Mitesh M. Khapra , Balaraman Ravindran

Deep neural networks are vulnerable to adversarial attacks, such as backdoor attacks in which a malicious adversary compromises a model during training such that specific behaviour can be triggered at test time by attaching a specific word…

Cryptography and Security · Computer Science 2022-10-21 You Guo , Jun Wang , Trevor Cohn

By inducing privacy attacks on NLP models, attackers can obtain sensitive information such as training data and model parameters, etc. Although researchers have studied, in-depth, several kinds of attacks in NLP models, they are…

Computation and Language · Computer Science 2024-10-02 Wei Huang , Yinggui Wang , Cen Chen

Deep neural networks face persistent challenges in defending against backdoor attacks, leading to an ongoing battle between attacks and defenses. While existing backdoor defense strategies have shown promising performance on reducing attack…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Mingli Zhu , Siyuan Liang , Baoyuan Wu

Third-party resources ($e.g.$, samples, backbones, and pre-trained models) are usually involved in the training of deep neural networks (DNNs), which brings backdoor attacks as a new training-phase threat. In general, backdoor attackers…

Cryptography and Security · Computer Science 2023-02-06 Yiming Li , Mengxi Ya , Yang Bai , Yong Jiang , Shu-Tao Xia

Deep Neural Networks are well known to be vulnerable to adversarial attacks and backdoor attacks, where minor modifications on the input are able to mislead the models to give wrong results. Although defenses against adversarial attacks…

Machine Learning · Computer Science 2022-08-01 Kaidi Jin , Tianwei Zhang , Chao Shen , Yufei Chen , Ming Fan , Chenhao Lin , Ting Liu

Architectural backdoors pose an under-examined but critical threat to deep neural networks, embedding malicious logic directly into a model's computational graph. Unlike traditional data poisoning or parameter manipulation, architectural…

Cryptography and Security · Computer Science 2025-07-18 Victoria Childress , Josh Collyer , Jodie Knapp

Recent studies have pointed out that natural language processing (NLP) models are vulnerable to backdoor attacks. A backdoored model produces normal outputs on the clean samples while performing improperly on the texts with triggers that…

Computation and Language · Computer Science 2023-12-27 Xuan Sheng , Zhicheng Li , Zhaoyang Han , Xiangmao Chang , Piji Li

Pre-trained language models have achieved remarkable success across a wide range of natural language processing (NLP) tasks, particularly when fine-tuned on large, domain-relevant datasets. However, they remain vulnerable to backdoor…

Computation and Language · Computer Science 2026-02-02 Anindya Sundar Das , Kangjie Chen , Monowar Bhuyan

The prompt-based learning paradigm has gained much research attention recently. It has achieved state-of-the-art performance on several NLP tasks, especially in the few-shot scenarios. While steering the downstream tasks, few works have…

Computation and Language · Computer Science 2022-11-29 Xiangrui Cai , Haidong Xu , Sihan Xu , Ying Zhang , Xiaojie Yuan

The widespread adoption of deep learning across various industries has introduced substantial challenges, particularly in terms of model explainability and security. The inherent complexity of deep learning models, while contributing to…

Cryptography and Security · Computer Science 2025-01-08 Kealan Dunnett , Reza Arablouei , Dimity Miller , Volkan Dedeoglu , Raja Jurdak

Modern NLP models are often trained over large untrusted datasets, raising the potential for a malicious adversary to compromise model behaviour. For instance, backdoors can be implanted through crafting training instances with a specific…

Computation and Language · Computer Science 2023-10-23 Xuanli He , Qiongkai Xu , Jun Wang , Benjamin Rubinstein , Trevor Cohn

Recent studies have shown that contrastive learning, like supervised learning, is highly vulnerable to backdoor attacks wherein malicious functions are injected into target models, only to be activated by specific triggers. However, thus…

Cryptography and Security · Computer Science 2023-12-15 Changjiang Li , Ren Pang , Bochuan Cao , Zhaohan Xi , Jinghui Chen , Shouling Ji , Ting Wang

Backdoor attacks are dangerous and difficult to prevent in federated learning (FL), where training data is sourced from untrusted clients over long periods of time. These difficulties arise because: (a) defenders in FL do not have access to…

Machine Learning · Computer Science 2023-02-01 Shuaiqi Wang , Jonathan Hayase , Giulia Fanti , Sewoong Oh

Backdoor attacks have become a critical threat to deep neural networks (DNNs), drawing many research interests. However, most of the studied attacks employ a single type of trigger. Consequently, proposed backdoor defenders often rely on…

Cryptography and Security · Computer Science 2025-01-14 Duc Anh Vu , Anh Tuan Tran , Cong Tran , Cuong Pham

Deep neural networks (DNNs) and natural language processing (NLP) systems have developed rapidly and have been widely used in various real-world fields. However, they have been shown to be vulnerable to backdoor attacks. Specifically, the…

Computation and Language · Computer Science 2023-01-26 Jiali Wei , Ming Fan , Wenjing Jiao , Wuxia Jin , Ting Liu

Together with impressive advances touching every aspect of our society, AI technology based on Deep Neural Networks (DNN) is bringing increasing security concerns. While attacks operating at test time have monopolised the initial attention…

Cryptography and Security · Computer Science 2021-11-17 Wei Guo , Benedetta Tondi , Mauro Barni

Adversarial attacks in machine learning have been extensively reviewed in areas like computer vision and NLP, but research on tabular data remains scattered. This paper provides the first systematic literature review focused on adversarial…

Machine Learning · Computer Science 2025-06-19 Salijona Dyrmishi , Mohamed Djilani , Thibault Simonetto , Salah Ghamizi , Maxime Cordy