English
Related papers

Related papers: Turn-Based Structural Triggers: Prompt-Free Backdo…

200 papers

Natural language processing (NLP) systems have been proven to be vulnerable to backdoor attacks, whereby hidden features (backdoors) are trained into a language model and may only be activated by specific inputs (called triggers), to trick…

Computation and Language · Computer Science 2021-09-29 Shaofeng Li , Hui Liu , Tian Dong , Benjamin Zi Hao Zhao , Minhui Xue , Haojin Zhu , Jialiang Lu

Generative large language models (LLMs) have achieved state-of-the-art results on a wide range of tasks, yet they remain susceptible to backdoor attacks: carefully crafted triggers in the input can manipulate the model to produce…

Artificial Intelligence · Computer Science 2025-05-20 Yige Li , Hanxun Huang , Yunhan Zhao , Xingjun Ma , Jun Sun

Recent studies have shown that Large Language Models (LLMs) are vulnerable to data poisoning attacks, where malicious training examples embed hidden behaviours triggered by specific input patterns. However, most existing works assume a…

Computation and Language · Computer Science 2025-10-10 Sanhanat Sivapiromrat , Caiqi Zhang , Marco Basaldella , Nigel Collier

In this paper, we present a new form of backdoor attack against Large Language Models (LLMs): lingual-backdoor attacks. The key novelty of lingual-backdoor attacks is that the language itself serves as the trigger to hijack the infected…

Cryptography and Security · Computer Science 2025-05-07 Zihan Wang , Hongwei Li , Rui Zhang , Wenbo Jiang , Kangjie Chen , Tianwei Zhang , Qingchuan Zhao , Guowen Xu

The implications of backdoor attacks on English-centric large language models (LLMs) have been widely examined - such attacks can be achieved by embedding malicious behaviors during training and activated under specific conditions that…

Computation and Language · Computer Science 2025-03-18 Xuanli He , Jun Wang , Qiongkai Xu , Pasquale Minervini , Pontus Stenetorp , Benjamin I. P. Rubinstein , Trevor Cohn

Backdoor vulnerabilities widely exist in the fine-tuning of large language models(LLMs). Most backdoor poisoning methods operate mainly at the token level and lack deeper semantic manipulation, which limits stealthiness. In addition, Prior…

Computation and Language · Computer Science 2026-05-13 Ziyu Liu , Tao Li , Tianjie Ni , Xiaolong Lan , Wengang Ma , Tao Yang , Guohua Wang , Junjiang He

Large language models (LLMs) are increasingly integrated into sensitive workflows, raising the stakes for adversarial robustness and safety. This paper introduces Transient Turn Injection(TTI), a new multi-turn attack technique that…

Cryptography and Security · Computer Science 2026-04-24 Naheed Rayhan , Sohely Jahan

Large language models (LLMs) are increasingly deployed in settings where inducing a bias toward a certain topic can have significant consequences, and backdoor attacks can be used to produce such models. Prior work on backdoor attacks has…

Cryptography and Security · Computer Science 2026-02-17 Anudeep Das , Prach Chantasantitam , Gurjot Singh , Lipeng He , Mariia Ponomarenko , Florian Kerschbaum

Backdoor attacks targeting text-to-image diffusion models have advanced rapidly. However, current backdoor samples often exhibit two key abnormalities compared to benign samples: 1) Semantic Consistency, where backdoor prompts tend to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jie Zhang , Zhongqi Wang , Shiguang Shan , Xilin Chen

Large language models (LLMs) have demonstrated remarkable performance in zero-shot dialogue state tracking (DST), reducing the need for task-specific training. However, conventional DST benchmarks primarily focus on structured user-agent…

Computation and Language · Computer Science 2025-06-13 Sangmin Song , Juhwan Choi , JungMin Yun , YoungBin Kim

Large Language Models (LLMs) are widely used in natural language processing but face the risk of jailbreak attacks that maliciously induce them to generate harmful content. Existing jailbreak attacks, including character-level and…

Computation and Language · Computer Science 2025-02-19 Bangxin Li , Hengrui Xing , Cong Tian , Chao Huang , Jin Qian , Huangqing Xiao , Linfeng Feng

Large language models (LLMs) have seen significant advancements, achieving superior performance in various Natural Language Processing (NLP) tasks, from understanding to reasoning. However, they remain vulnerable to backdoor attacks, where…

Computation and Language · Computer Science 2024-11-28 Chen Chen , Yuchen Sun , Xueluan Gong , Jiaxin Gao , Kwok-Yan Lam

The Large Language Models (LLMs) are poised to offer efficient and intelligent services for future mobile communication networks, owing to their exceptional capabilities in language comprehension and generation. However, the extremely high…

Cryptography and Security · Computer Science 2023-09-07 Haomiao Yang , Kunlan Xiang , Mengyu Ge , Hongwei Li , Rongxing Lu , Shui Yu

Backdoor attacks pose an important security threat to textual large language models. Exploring textual backdoor attacks not only helps reveal the potential security risks of models, but also promotes innovation and development of defense…

Cryptography and Security · Computer Science 2025-07-21 Yang Hou , Qiuling Yue , Lujia Chai , Guozhao Liao , Wenbao Han , Wei Ou

Large language models (LLMs) have raised concerns about potential security threats despite performing significantly in Natural Language Processing (NLP). Backdoor attacks initially verified that LLM is doing substantial harm at all stages,…

Cryptography and Security · Computer Science 2024-07-09 Pengzhou Cheng , Yidong Ding , Tianjie Ju , Zongru Wu , Wei Du , Ping Yi , Zhuosheng Zhang , Gongshen Liu

Large language models (LLMs) have gained widespread adoption across diverse applications due to their impressive generative capabilities. Their plug-and-play nature enables both developers and end users to interact with these models through…

Cryptography and Security · Computer Science 2025-10-21 Zongze Li , Jiawei Guo , Haipeng Cai

Backdoors are hidden behaviors that are only triggered once an AI system has been deployed. Bad actors looking to create successful backdoors must design them to avoid activation during training and evaluation. Since data used in these…

Cryptography and Security · Computer Science 2024-12-25 Sara Price , Arjun Panickssery , Sam Bowman , Asa Cooper Stickland

With the burgeoning advancements in the field of natural language processing (NLP), the demand for training data has increased significantly. To save costs, it has become common for users and businesses to outsource the labor-intensive task…

Computation and Language · Computer Science 2024-08-22 Ziqiang Li , Yueqi Zeng , Pengfei Xia , Lei Liu , Zhangjie Fu , Bin Li

Large language models, LLMs, are increasingly deployed in multiturn settings where earlier responses shape later ones, making reliability dependent on whether a conversation remains consistent over time. When this consistency degrades…

Computation and Language · Computer Science 2026-04-20 Wael Hafez , Amir Nazeri

Large-scale language models have achieved tremendous success across various natural language processing (NLP) applications. Nevertheless, language models are vulnerable to backdoor attacks, which inject stealthy triggers into models for…

Cryptography and Security · Computer Science 2023-02-09 Yujin Huang , Terry Yue Zhuo , Qiongkai Xu , Han Hu , Xingliang Yuan , Chunyang Chen