English
Related papers

Related papers: BadPrompt: Backdoor Attacks on Continuous Prompts

200 papers

Backdoor attack against deep neural networks is currently being profoundly investigated due to its severe security consequences. Current state-of-the-art backdoor attacks require the adversary to modify the input, usually by adding a…

Cryptography and Security · Computer Science 2020-10-09 Ahmed Salem , Michael Backes , Yang Zhang

Dynamic link prediction (DLP) makes graph prediction based on historical information. Since most DLP methods are highly dependent on the training data to achieve satisfying prediction performance, the quality of the training data is…

Artificial Intelligence · Computer Science 2021-10-11 Jinyin Chen , Haiyang Xiong , Haibin Zheng , Jian Zhang , Guodong Jiang , Yi Liu

As an emerging and vital topic for studying deep neural networks' vulnerability (DNNs), backdoor learning has attracted increasing interest in recent years, and many seminal backdoor attack and defense algorithms are being developed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Baoyuan Wu , Hongrui Chen , Mingda Zhang , Zihao Zhu , Shaokui Wei , Danni Yuan , Mingli Zhu , Ruotong Wang , Li Liu , Chao Shen

Machine learning systems are vulnerable to backdoor attacks, where attackers manipulate model behavior through data tampering or architectural modifications. Traditional backdoor attacks involve injecting malicious samples with specific…

Cryptography and Security · Computer Science 2025-09-24 Yuan Ma , Jiankang Wei , Yilun Lyu , Kehao Chen , Jingtong Huang

The critical challenge of prompt injection attacks in Large Language Models (LLMs) integrated applications, a growing concern in the Artificial Intelligence (AI) field. Such attacks, which manipulate LLMs through natural language inputs,…

Cryptography and Security · Computer Science 2024-01-17 Xuchen Suo

Backdoor learning is an emerging and vital topic for studying deep neural networks' vulnerability (DNNs). Many pioneering backdoor attack and defense methods are being proposed, successively or concurrently, in the status of a rapid arms…

Machine Learning · Computer Science 2022-10-20 Baoyuan Wu , Hongrui Chen , Mingda Zhang , Zihao Zhu , Shaokui Wei , Danni Yuan , Chao Shen

Recent researches have shown that Large Language Models (LLMs) are susceptible to a security threat known as Backdoor Attack. The backdoored model will behave well in normal cases but exhibit malicious behaviours on inputs inserted with a…

Cryptography and Security · Computer Science 2024-04-04 Yunzhuo Hao , Wenkai Yang , Yankai Lin

LLM-based programming assistants offer the promise of programming faster but with the risk of introducing more security vulnerabilities. Prior work has studied how LLMs could be maliciously fine-tuned to suggest vulnerabilities more often.…

Cryptography and Security · Computer Science 2024-07-17 John Heibel , Daniel Lowd

Graph Foundation Models (GFMs) are pre-trained on diverse source domains and adapted to unseen targets, enabling broad generalization for graph machine learning. Despite that GFMs have attracted considerable attention recently, their…

Cryptography and Security · Computer Science 2025-11-25 Jiayi Luo , Qingyun Sun , Lingjuan Lyu , Ziwei Zhang , Haonan Yuan , Xingcheng Fu , Jianxin Li

Continual learning empowers models to adapt autonomously to the ever-changing environment or data streams without forgetting old knowledge. Prompt-based approaches are built on frozen pre-trained models to learn the task-specific prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Zhanxin Gao , Jun Cen , Xiaobin Chang

Large Language Models (LLMs) have become integral to many applications, with system prompts serving as a key mechanism to regulate model behavior and ensure ethical outputs. In this paper, we introduce a novel backdoor attack that…

Cryptography and Security · Computer Science 2024-10-08 Lu Yan , Siyuan Cheng , Xuan Chen , Kaiyuan Zhang , Guangyu Shen , Zhuo Zhang , Xiangyu Zhang

Backdoors can be injected into NLP models to induce misbehavior when the input text contains a specific feature, known as a trigger, which the attacker secretly selects. Unlike fixed words, phrases, or sentences used in the static text…

Cryptography and Security · Computer Science 2024-09-12 Rui Zeng , Xi Chen , Yuwen Pu , Xuhong Zhang , Tianyu Du , Shouling Ji

Backdoor attacks have been shown to impose severe threats to real security-critical scenarios. Although previous works can achieve high attack success rates, they either require access to victim models which may significantly reduce their…

Cryptography and Security · Computer Science 2024-03-21 Jingke Zhao , Zan Wang , Yongwei Wang , Lanjun Wang

Large amounts of incremental learning algorithms have been proposed to alleviate the catastrophic forgetting issue arises while dealing with sequential data on a time series. However, the adversarial robustness of incremental learners has…

Cryptography and Security · Computer Science 2023-05-31 Yiqi Zhong , Xianming Liu , Deming Zhai , Junjun Jiang , Xiangyang Ji

Graph prompt tuning has emerged as a promising paradigm to effectively transfer general graph knowledge from pre-trained models to various downstream tasks, particularly in few-shot contexts. However, its susceptibility to backdoor attacks,…

Machine Learning · Computer Science 2025-04-01 Ying Song , Rita Singh , Balaji Palanisamy

Self-supervised learning in computer vision aims to pre-train an image encoder using a large amount of unlabeled images or (image, text) pairs. The pre-trained image encoder can then be used as a feature extractor to build downstream…

Cryptography and Security · Computer Science 2021-08-03 Jinyuan Jia , Yupei Liu , Neil Zhenqiang Gong

Backdoor attacks represent a subtle yet effective class of cyberattacks targeting AI models, primarily due to their stealthy nature. The model behaves normally on clean data but exhibits malicious behavior only when the attacker embeds a…

Machine Learning · Computer Science 2025-09-29 Sujeevan Aseervatham , Achraf Kerzazi , Younès Bennani

Natural language processing (NLP) models are known to be vulnerable to backdoor attacks, which poses a newly arisen threat to NLP models. Prior online backdoor defense methods for NLP models only focus on the anomalies at either the input…

Computation and Language · Computer Science 2022-10-17 Sishuo Chen , Wenkai Yang , Zhiyuan Zhang , Xiaohan Bi , Xu Sun

Deep learning models have been deployed in numerous real-world applications such as autonomous driving and surveillance. However, these models are vulnerable in adversarial environments. Backdoor attack is emerging as a severe security…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Shih-Han Chan , Yinpeng Dong , Jun Zhu , Xiaolu Zhang , Jun Zhou

Transferable backdoors pose a severe threat to the Pre-trained Language Models (PLMs) supply chain, yet defensive research remains nascent, primarily relying on detecting anomalies in the output feature space. We identify a critical flaw…

Cryptography and Security · Computer Science 2025-12-09 Tianhang Zhao , Wei Du , Haodong Zhao , Sufeng Duan , Gongshen Liu