中文
相关论文

相关论文: BadPre: Task-agnostic Backdoor Attacks to Pre-trai…

200 篇论文

Natural language processing (NLP) systems have been proven to be vulnerable to backdoor attacks, whereby hidden features (backdoors) are trained into a language model and may only be activated by specific inputs (called triggers), to trick…

计算与语言 · 计算机科学 2021-09-29 Shaofeng Li , Hui Liu , Tian Dong , Benjamin Zi Hao Zhao , Minhui Xue , Haojin Zhu , Jialiang Lu

Recent studies have pointed out that natural language processing (NLP) models are vulnerable to backdoor attacks. A backdoored model produces normal outputs on the clean samples while performing improperly on the texts with triggers that…

计算与语言 · 计算机科学 2023-12-27 Xuan Sheng , Zhicheng Li , Zhaoyang Han , Xiangmao Chang , Piji Li

Because state-of-the-art language models are expensive to train, most practitioners must make use of one of the few publicly available language models or language model APIs. This consolidation of trust increases the potency of backdoor…

密码学与安全 · 计算机科学 2023-07-28 Nikhil Kandpal , Matthew Jagielski , Florian Tramèr , Nicholas Carlini

Large Language Models (LLMs), which bridge the gap between human language understanding and complex problem-solving, achieve state-of-the-art performance on several NLP tasks, particularly in few-shot and zero-shot settings. Despite the…

密码学与安全 · 计算机科学 2025-01-07 Shuai Zhao , Meihuizi Jia , Zhongliang Guo , Leilei Gan , Xiaoyu Xu , Xiaobao Wu , Jie Fu , Yichao Feng , Fengjun Pan , Luu Anh Tuan

Backdoor attacks pose a significant threat to neural networks, enabling adversaries to manipulate model outputs on specific inputs, often with devastating consequences, especially in critical applications. While backdoor attacks have been…

机器学习 · 计算机科学 2025-07-30 Zhen Guo , Abhinav Kumar , Reza Tourani

The prompt-based learning paradigm, which bridges the gap between pre-training and fine-tuning, achieves state-of-the-art performance on several NLP tasks, particularly in few-shot settings. Despite being widely applied, prompt-based…

计算与语言 · 计算机科学 2024-02-05 Shuai Zhao , Jinming Wen , Luu Anh Tuan , Junbo Zhao , Jie Fu

Chat template is a common technique used in the training and inference stages of Large Language Models (LLMs). It can transform input and output data into role-based and templated expressions to enhance the performance of LLMs. However,…

密码学与安全 · 计算机科学 2026-02-06 Zihan Wang , Hongwei Li , Rui Zhang , Wenbo Jiang , Guowen Xu

In the field of natural language processing, the prevalent approach involves fine-tuning pretrained language models (PLMs) using local samples. Recent research has exposed the susceptibility of PLMs to backdoor attacks, wherein the…

机器学习 · 计算机科学 2023-10-31 Ruixiang Tang , Jiayi Yuan , Yiming Li , Zirui Liu , Rui Chen , Xia Hu

Deep neural networks are vulnerable to adversarial attacks, such as backdoor attacks in which a malicious adversary compromises a model during training such that specific behaviour can be triggered at test time by attaching a specific word…

密码学与安全 · 计算机科学 2022-10-21 You Guo , Jun Wang , Trevor Cohn

Natural language processing (NLP) has received unprecedented attention. While advancements in NLP models have led to extensive research into their backdoor vulnerabilities, the potential for these advancements to introduce new backdoor…

密码学与安全 · 计算机科学 2024-03-18 Ka-Ho Chow , Wenqi Wei , Lei Yu

Deep neural networks (DNNs) and natural language processing (NLP) systems have developed rapidly and have been widely used in various real-world fields. However, they have been shown to be vulnerable to backdoor attacks. Specifically, the…

计算与语言 · 计算机科学 2023-01-26 Jiali Wei , Ming Fan , Wenjing Jiao , Wuxia Jin , Ting Liu

Large language models (LLMs) have seen significant advancements, achieving superior performance in various Natural Language Processing (NLP) tasks, from understanding to reasoning. However, they remain vulnerable to backdoor attacks, where…

计算与语言 · 计算机科学 2024-11-28 Chen Chen , Yuchen Sun , Xueluan Gong , Jiaxin Gao , Kwok-Yan Lam

Diffusion language models (DLMs) have recently emerged as an alternative modeling paradigm to autoregressive (AR) language models, enabling parallel generation and bidirectional context modeling. Yet their security implications,…

密码学与安全 · 计算机科学 2026-05-12 Shengfang Zhai , Xiaoyang Ji , Yuling Shi , Haoran Gao , Fanyu Meng , Yan Zeng , Yuejian Fang , Yinpeng Dong , Jiaheng Zhang

Backdoor attack intends to embed hidden backdoor into deep neural networks (DNNs), so that the attacked models perform well on benign samples, whereas their predictions will be maliciously changed if the hidden backdoor is activated by…

密码学与安全 · 计算机科学 2022-02-17 Yiming Li , Yong Jiang , Zhifeng Li , Shu-Tao Xia

Transfer learning provides an effective solution for feasibly and fast customize accurate \textit{Student} models, by transferring the learned knowledge of pre-trained \textit{Teacher} models over large datasets via fine-tuning. Many…

机器学习 · 计算机科学 2020-08-11 Shuo Wang , Surya Nepal , Carsten Rudolph , Marthie Grobler , Shangyu Chen , Tianle Chen

Medical foundation models are gaining prominence in the medical community for their ability to derive general representations from extensive collections of medical image-text pairs. Recent research indicates that these models are…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Asif Hanif , Fahad Shamshad , Muhammad Awais , Muzammal Naseer , Fahad Shahbaz Khan , Karthik Nandakumar , Salman Khan , Rao Muhammad Anwer

Recent research highlights concerns about the trustworthiness of third-party Pre-Trained Language Models (PTLMs) due to potential backdoor attacks. These backdoored PTLMs, however, are effective only for specific pre-defined downstream…

密码学与安全 · 计算机科学 2025-05-20 Rui Zhang , Yun Shen , Hongwei Li , Wenbo Jiang , Hanxiao Chen , Yuan Zhang , Guowen Xu , Yang Zhang

Pre-trained language models allowed us to process downstream tasks with the help of fine-tuning, which aids the model to achieve fairly high accuracy in various Natural Language Processing (NLP) tasks. Such easily-downloaded language models…

计算与语言 · 计算机科学 2022-11-22 Jaechul Roh , Minhao Cheng , Yajun Fang

Backdoor attacks pose a serious threat to the security of large language models (LLMs), causing them to exhibit anomalous behavior under specific trigger conditions. The design of backdoor triggers has evolved from fixed triggers to dynamic…

密码学与安全 · 计算机科学 2026-04-15 Haotian Jin , Yang Li , Haihui Fan , Lin Shen , Xiangfang Li , Bo Li

It has been shown that natural language processing (NLP) models are vulnerable to a kind of security threat called the Backdoor Attack, which utilizes a `backdoor trigger' paradigm to mislead the models. The most threatening backdoor attack…

计算与语言 · 计算机科学 2022-02-17 Lingfeng Shen , Haiyun Jiang , Lemao Liu , Shuming Shi