English
Related papers

Related papers: CleanGen: Mitigating Backdoor Attacks for Generati…

200 papers

Backdoor attacks pose a serious threat to the security of large language models (LLMs), causing them to exhibit anomalous behavior under specific trigger conditions. The design of backdoor triggers has evolved from fixed triggers to dynamic…

Cryptography and Security · Computer Science 2026-04-15 Haotian Jin , Yang Li , Haihui Fan , Lin Shen , Xiangfang Li , Bo Li

Prompts have significantly improved the performance of pretrained Large Language Models (LLMs) on various downstream tasks recently, making them increasingly indispensable for a diverse range of LLM application scenarios. However, the…

Computation and Language · Computer Science 2023-12-19 Hongwei Yao , Jian Lou , Zhan Qin

In the rapidly evolving field of machine learning, adversarial attacks present a significant challenge to model robustness and security. Decision-based attacks, which only require feedback on the decision of a model rather than detailed…

Cryptography and Security · Computer Science 2024-05-24 Ping Guo , Fei Liu , Xi Lin , Qingchuan Zhao , Qingfu Zhang

Several recent works have argued that Large Language Models (LLMs) can be used to tame the data deluge in the cybersecurity field, by improving the automation of Cyber Threat Intelligence (CTI) tasks. This work presents an evaluation…

Cryptography and Security · Computer Science 2025-11-13 Emanuele Mezzi , Fabio Massacci , Katja Tuma

Responsible AI design is increasingly seen as an imperative by both AI developers and AI compliance experts. One of the key tasks is envisioning AI technology uses and risks. Recent studies on the model and data cards reveal that AI…

Human-Computer Interaction · Computer Science 2024-07-18 Viviane Herdel , Sanja Šćepanović , Edyta Bogucka , Daniele Quercia

Large Language Models (LLMs) have been shown to be susceptible to jailbreak attacks, or adversarial attacks used to illicit high risk behavior from a model. Jailbreaks have been exploited by cybercriminals and blackhat actors to cause…

Computation and Language · Computer Science 2025-01-07 Joao Fonseca , Andrew Bell , Julia Stoyanovich

Large language models (LLMs), known for their capability in understanding and following instructions, are vulnerable to adversarial attacks. Researchers have found that current commercial LLMs either fail to be "harmless" by presenting…

Cryptography and Security · Computer Science 2023-10-05 Bocheng Chen , Advait Paliwal , Qiben Yan

Large Language Models (LLMs) such as GPT-4 and Llama3 have significantly impacted various fields by enabling high-quality synthetic data generation and reducing dependence on expensive human-generated datasets. Despite this, challenges…

Computation and Language · Computer Science 2025-11-18 Yue Huang , Siyuan Wu , Chujie Gao , Dongping Chen , Qihui Zhang , Yao Wan , Tianyi Zhou , Jianfeng Gao , Chaowei Xiao , Lichao Sun , Xiangliang Zhang

Defenses against security threats have been an interest of recent studies. Recent works have shown that it is not difficult to attack a natural language processing (NLP) model while defending against them is still a cat-mouse game. Backdoor…

Cryptography and Security · Computer Science 2022-05-31 Sangeet Sagar , Abhinav Bhatt , Abhijith Srinivas Bidaralli

Code generation large language models (LLMs) are increasingly integrated into modern software development workflows. Recent work has shown that these models are vulnerable to backdoor and poisoning attacks that induce the generation of…

Cryptography and Security · Computer Science 2026-03-19 Shenao Yan , Shimaa Ahmed , Shan Jin , Sunpreet S. Arora , Yiwei Cai , Yizhen Wang , Yuan Hong

Despite significant advancements, large language models (LLMs) still struggle with providing accurate answers when lacking domain-specific or up-to-date knowledge. Retrieval-Augmented Generation (RAG) addresses this limitation by…

Cryptography and Security · Computer Science 2025-04-01 Yuefeng Peng , Junda Wang , Hong Yu , Amir Houmansadr

Recent developments in Large Language Models (LLMs) have manifested significant advancements. To facilitate safeguards against malicious exploitation, a body of research has concentrated on aligning LLMs with human preferences and…

Cryptography and Security · Computer Science 2024-06-11 Yuanpu Cao , Bochuan Cao , Jinghui Chen

Safety backdoor attacks in large language models (LLMs) enable the stealthy triggering of unsafe behaviors while evading detection during normal interactions. The high dimensionality of potential triggers in the token space and the diverse…

Cryptography and Security · Computer Science 2024-06-26 Yi Zeng , Weiyu Sun , Tran Ngoc Huynh , Dawn Song , Bo Li , Ruoxi Jia

Large Language Models (LLMs) have risen significantly in popularity and are increasingly being adopted across multiple applications. These LLMs are heavily aligned to resist engaging in illegal or unethical topics as a means to avoid…

Cryptography and Security · Computer Science 2025-02-27 Mark Russinovich , Ahmed Salem , Ronen Eldan

This paper presents an innovative exploration of the application potential of large language models (LLM) in addressing the challenging task of automatically generating behavior trees (BTs) for complex tasks. The conventional manual BT…

Computation and Language · Computer Science 2024-01-17 Fu Li , Xueying Wang , Bin Li , Yunlong Wu , Yanzhen Wang , Xiaodong Yi

Backdoor attacks remain significant security threats to generative large language models (LLMs). Since generative LLMs output sequences of high-dimensional token logits instead of low-dimensional classification logits, most existing…

Computation and Language · Computer Science 2024-12-04 Zongru Wu , Pengzhou Cheng , Lingyong Fang , Zhuosheng Zhang , Gongshen Liu

Large language models (LLMs) have demonstrated immense utility across various industries. However, as LLMs advance, the risk of harmful outputs increases due to incorrect or malicious instruction prompts. While current methods effectively…

Computation and Language · Computer Science 2025-06-19 Xinyi Zeng , Yuying Shang , Jiawei Chen , Jingyuan Zhang , Yu Tian

Large language models (large LMs) are increasingly trained on massive codebases and used to generate code. However, LMs lack awareness of security and are found to frequently produce unsafe code. This work studies the security of LMs along…

Cryptography and Security · Computer Science 2024-08-19 Jingxuan He , Martin Vechev

Recent advancements in large language models (LLMs) have significantly enhanced capabilities in natural language processing and artificial intelligence. These models, including GPT-3.5 and LLaMA-2, have revolutionized text generation,…

Computation and Language · Computer Science 2024-02-06 Yunhong He , Jianling Qiu , Wei Zhang , Zhengqing Yuan

Recent SOTA approaches for embodied learning via interaction directly employ large language models (LLMs) as agents to determine the next steps in an environment. Due to their world knowledge and reasoning capabilities, LLM agents achieve…

Computation and Language · Computer Science 2024-07-15 Abhay Zala , Jaemin Cho , Han Lin , Jaehong Yoon , Mohit Bansal