English
Related papers

Related papers: ELBA-Bench: An Efficient Learning Backdoor Attacks…

200 papers

Parameter-efficient fine-tuning (PEFT) enables efficient adaptation of pre-trained language models (PLMs) to specific tasks. By tuning only a minimal set of (extra) parameters, PEFT achieves performance that is comparable to standard…

Computation and Language · Computer Science 2024-04-01 Lauren Hong , Ting Wang

Recent studies have widely investigated backdoor attacks on Large Language Models (LLMs) by inserting harmful question-answer (QA) pairs into their training data. However, we revisit existing attacks and identify two critical limitations:…

Computation and Language · Computer Science 2025-10-07 Jiawei Kong , Hao Fang , Xiaochen Yang , Kuofeng Gao , Bin Chen , Shu-Tao Xia , Ke Xu , Han Qiu

Language Models (LMs) are becoming increasingly popular in real-world applications. Outsourcing model training and data hosting to third-party platforms has become a standard method for reducing costs. In such a situation, the attacker can…

Cryptography and Security · Computer Science 2024-12-05 Pengzhou Cheng , Zongru Wu , Wei Du , Haodong Zhao , Wei Lu , Gongshen Liu

Instruction tuning enhances large vision-language models (LVLMs) but increases their vulnerability to backdoor attacks due to their open design. Unlike prior studies in static settings, this paper explores backdoor attacks in LVLM…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Siyuan Liang , Jiawei Liang , Tianyu Pang , Chao Du , Aishan Liu , Mingli Zhu , Xiaochun Cao , Dacheng Tao

The advent of Large Language Models (LLMs) has marked significant achievements in language processing and reasoning capabilities. Despite their advancements, LLMs face vulnerabilities to data poisoning attacks, where the adversary inserts…

Machine Learning · Computer Science 2025-05-30 Xiangyu Zhou , Yao Qiang , Saleh Zare Zade , Mohammad Amin Roshani , Prashant Khanduri , Douglas Zytko , Dongxiao Zhu

Large language models (LLMs) have seen significant advancements, achieving superior performance in various Natural Language Processing (NLP) tasks. However, they remain vulnerable to backdoor attacks, where models behave normally for…

Computation and Language · Computer Science 2025-08-29 Chen Chen , Yuchen Sun , Jiaxin Gao , Xueluan Gong , Qian Wang , Ziyao Wang , Yongsen Zheng , Kwok-Yan Lam

As an emerging approach to explore the vulnerability of deep neural networks (DNNs), backdoor learning has attracted increasing interest in recent years, and many seminal backdoor attack and defense algorithms are being developed…

Machine Learning · Computer Science 2024-07-30 Baoyuan Wu , Hongrui Chen , Mingda Zhang , Zihao Zhu , Shaokui Wei , Danni Yuan , Mingli Zhu , Ruotong Wang , Li Liu , Chao Shen

Backdoor attacks manipulate model predictions by inserting innocuous triggers into training and test data. We focus on more realistic and more challenging clean-label attacks where the adversarial training examples are correctly labeled.…

Machine Learning · Computer Science 2023-10-31 Wencong You , Zayd Hammoudeh , Daniel Lowd

Parameter-efficient fine-tuning (PEFT) can bridge the gap between large language models (LLMs) and downstream tasks. However, PEFT has been proven vulnerable to malicious attacks. Research indicates that poisoned LLMs, even after PEFT,…

Computation and Language · Computer Science 2025-05-21 Shuai Zhao , Xiaobao Wu , Cong-Duy Nguyen , Yanhao Jia , Meihuizi Jia , Yichao Feng , Luu Anh Tuan

Large-scale language models have achieved tremendous success across various natural language processing (NLP) applications. Nevertheless, language models are vulnerable to backdoor attacks, which inject stealthy triggers into models for…

Cryptography and Security · Computer Science 2023-02-09 Yujin Huang , Terry Yue Zhuo , Qiongkai Xu , Han Hu , Xingliang Yuan , Chunyang Chen

In this paper, we present a new form of backdoor attack against Large Language Models (LLMs): lingual-backdoor attacks. The key novelty of lingual-backdoor attacks is that the language itself serves as the trigger to hijack the infected…

Cryptography and Security · Computer Science 2025-05-07 Zihan Wang , Hongwei Li , Rui Zhang , Wenbo Jiang , Kangjie Chen , Tianwei Zhang , Qingchuan Zhao , Guowen Xu

Backdoor attacks are an insidious security threat against machine learning models. Adversaries can manipulate the predictions of compromised models by inserting triggers into the training phase. Various backdoor attacks have been devised…

Computation and Language · Computer Science 2023-05-29 Xuanli He , Jun Wang , Benjamin Rubinstein , Trevor Cohn

The proliferation of open-weight Large Language Models (LLMs) has democratized agentic AI, yet fine-tuned weights are frequently shared and adopted with limited scrutiny beyond leaderboard performance. This creates a risk where third-party…

Cryptography and Security · Computer Science 2026-03-05 Bhanu Pallakonda , Mikkel Hindsbo , Sina Ehsani , Prag Mishra

Textual backdoor attacks are a kind of practical threat to NLP systems. By injecting a backdoor in the training phase, the adversary could control model predictions via predefined triggers. As various attack and defense models have been…

Machine Learning · Computer Science 2022-11-02 Ganqu Cui , Lifan Yuan , Bingxiang He , Yangyi Chen , Zhiyuan Liu , Maosong Sun

As deep learning advances, Large Language Models (LLMs) and their multimodal counterparts, Multimodal Large Language Models (MLLMs), have shown exceptional performance in many real-world tasks. However, MLLMs face significant security…

Cryptography and Security · Computer Science 2024-10-23 Fenghua Weng , Yue Xu , Chengyan Fu , Wenjie Wang

Large Language Models (LLMs) have emerged as a powerful approach for driving offensive penetration-testing tooling. Due to the opaque nature of LLMs, empirical methods are typically used to analyze their efficacy. The quality of this…

Cryptography and Security · Computer Science 2025-06-17 Andreas Happe , Jürgen Cito

Large language models (LLMs) have exhibited remarkable versatility and adaptability, while their widespread adoption across various applications also raises critical safety concerns. This paper focuses on the impact of backdoored LLMs.…

Computation and Language · Computer Science 2025-09-03 Jiyang Qiu , Xinbei Ma , Zhuosheng Zhang , Hai Zhao , Yun Li , Qianren Wang

Large Language Models (LLMs) have greatly advanced Natural Language Processing (NLP), particularly through instruction tuning, which enables broad task generalization without additional fine-tuning. However, their reliance on large-scale…

Computation and Language · Computer Science 2026-04-21 San Kim , Gary Geunbae Lee

Large pre-trained models have achieved notable success across a range of downstream tasks. However, recent research shows that a type of adversarial attack ($\textit{i.e.,}$ backdoor attack) can manipulate the behavior of machine learning…

Artificial Intelligence · Computer Science 2024-10-29 Dongliang Guo , Mengxuan Hu , Zihan Guan , Junfeng Guo , Thomas Hartvigsen , Sheng Li

Backdoor attacks pose a serious threat to the secure deployment of large language models (LLMs), enabling adversaries to implant hidden behaviors triggered by specific inputs. However, existing methods often rely on manually crafted…

Cryptography and Security · Computer Science 2025-11-24 Yige Li , Zhe Li , Wei Zhao , Nay Myat Min , Hanxun Huang , Xingjun Ma , Jun Sun