中文
相关论文

相关论文: BadPrompt: Backdoor Attacks on Continuous Prompts

200 篇论文

Recent studies revealed that deep neural networks (DNNs) are exposed to backdoor threats when training with third-party resources (such as training samples or backbones). The backdoored model has promising performance in predicting benign…

计算机视觉与模式识别 · 计算机科学 2023-03-07 Chengxiao Luo , Yiming Li , Yong Jiang , Shu-Tao Xia

The growing dependence on machine learning in real-world applications emphasizes the importance of understanding and ensuring its safety. Backdoor attacks pose a significant security risk due to their stealthy nature and potentially serious…

密码学与安全 · 计算机科学 2023-10-19 Ganghua Wang , Xun Xian , Jayanth Srinivasa , Ashish Kundu , Xuan Bi , Mingyi Hong , Jie Ding

Language Models (LMs) are becoming increasingly popular in real-world applications. Outsourcing model training and data hosting to third-party platforms has become a standard method for reducing costs. In such a situation, the attacker can…

密码学与安全 · 计算机科学 2024-12-05 Pengzhou Cheng , Zongru Wu , Wei Du , Haodong Zhao , Wei Lu , Gongshen Liu

With the broad application of deep neural networks (DNNs), backdoor attacks have gradually attracted attention. Backdoor attacks are insidious, and poisoned models perform well on benign samples and are only triggered when given specific…

机器学习 · 计算机科学 2022-07-12 Chang Yue , Peizhuo Lv , Ruigang Liang , Kai Chen

Machine Learning using neural networks has received prominent attention recently because of its success in solving a wide variety of computational tasks, in particular in the field of computer vision. However, several works have drawn…

机器学习 · 计算机科学 2024-08-01 C. A. Martínez-Mejía , J. Solano , J. Breier , D. Bucko , X. Hou

Backdoor attacks have been considered a severe security threat to deep learning. Such attacks can make models perform abnormally on inputs with predefined triggers and still retain state-of-the-art performance on clean data. While backdoor…

机器学习 · 计算机科学 2022-01-27 Yi Zeng , Won Park , Z. Morley Mao , Ruoxi Jia

The increasing demand for customized Large Language Models (LLMs) has led to the development of solutions like GPTs. These solutions facilitate tailored LLM creation via natural language prompts without coding. However, the trustworthiness…

密码学与安全 · 计算机科学 2024-05-29 Rui Zhang , Hongwei Li , Rui Wen , Wenbo Jiang , Yuan Zhang , Michael Backes , Yun Shen , Yang Zhang

Backdoor attacks pose an increasingly severe security threat to Deep Neural Networks (DNNs) during their development stage. In response, backdoor sample purification has emerged as a promising defense mechanism, aiming to eliminate backdoor…

密码学与安全 · 计算机科学 2024-05-21 Biao Yi , Sishuo Chen , Yiming Li , Tong Li , Baolei Zhang , Zheli Liu

The prompt has become an effective linguistic tool for utilizing pre-trained language models. However, in few-shot scenarios, subtle changes in the prompt design always make the result widely different, and the prompt learning methods also…

计算与语言 · 计算机科学 2024-03-13 Jinta Weng , Yifan Deng , d Donghao Li , Hao You , Yue Hu , Heyan Huang

Due to the high cost of training, large model (LM) practitioners commonly use pretrained models downloaded from untrusted sources, which could lead to owning compromised models. In-context learning is the ability of LMs to perform multiple…

密码学与安全 · 计算机科学 2024-09-09 Gorka Abad , Stjepan Picek , Lorenzo Cavallaro , Aitor Urbieta

Backdoor attacks have emerged as a prominent threat to natural language processing (NLP) models, where the presence of specific triggers in the input can lead poisoned models to misclassify these inputs to predetermined target classes.…

密码学与安全 · 计算机科学 2023-10-30 Lu Yan , Zhuo Zhang , Guanhong Tao , Kaiyuan Zhang , Xuan Chen , Guangyu Shen , Xiangyu Zhang

The remarkable advancements in large language models (LLMs) have brought about significant improvements in Natural Language Processing(NLP) tasks. This paper presents a comprehensive review of in-context learning techniques, focusing on…

计算与语言 · 计算机科学 2023-09-26 Yinheng Li

Recent studies have revealed a security threat to natural language processing (NLP) models, called the Backdoor Attack. Victim models can maintain competitive performance on clean samples while behaving abnormally on samples with a specific…

计算与语言 · 计算机科学 2021-03-30 Wenkai Yang , Lei Li , Zhiyuan Zhang , Xuancheng Ren , Xu Sun , Bin He

Backdoor attacks are among the most effective, practical, and stealthy attacks in deep learning. In this paper, we consider a practical scenario where a developer obtains a deep model from a third party and uses it as part of a…

密码学与安全 · 计算机科学 2025-03-28 Dorde Popovic , Amin Sadeghi , Ting Yu , Sanjay Chawla , Issa Khalil

Backdoor attacks threaten the deep learning supply chain by poisoning a small fraction of the training data so that a model behaves normally on clean inputs but misclassifies trigger-carrying inputs to an attacker-chosen target class.…

密码学与安全 · 计算机科学 2026-05-05 Yi Yang , Jinyang Huang , Binbin Liu , Feng-Qi Cui , Xiaokang Zhou , Zhi Liu , Jie Zhang , Meng Li

Deep neural networks (DNNs) and natural language processing (NLP) systems have developed rapidly and have been widely used in various real-world fields. However, they have been shown to be vulnerable to backdoor attacks. Specifically, the…

计算与语言 · 计算机科学 2023-01-26 Jiali Wei , Ming Fan , Wenjing Jiao , Wuxia Jin , Ting Liu

Backdoor attacks are rapidly emerging threats to deep neural networks (DNNs). In the backdoor attack scenario, attackers usually implant the backdoor into the target model by manipulating the training dataset or training process. Then, the…

密码学与安全 · 计算机科学 2022-05-09 Nan Zhong , Zhenxing Qian , Xinpeng Zhang

Code LLMs are increasingly employed in software development. However, studies have shown that they are vulnerable to backdoor attacks: when a trigger (a specific input pattern) appears in the input, the backdoor will be activated and cause…

密码学与安全 · 计算机科学 2025-10-07 Chenyu Wang , Zhou Yang , Yaniv Harel , David Lo

Multimodal contrastive learning has emerged as a powerful paradigm for building high-quality features using the complementary strengths of various data modalities. However, the open nature of such systems inadvertently increases the…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Siyuan Liang , Kuanrong Liu , Jiajun Gong , Jiawei Liang , Yuan Xun , Ee-Chien Chang , Xiaochun Cao

In a backdoor attack, an attacker injects corrupted examples into the training set. The goal of the attacker is to cause the final trained model to predict the attacker's desired target label when a predefined trigger is added to test…

机器学习 · 计算机科学 2022-10-13 Jonathan Hayase , Sewoong Oh