English
Related papers

Related papers: Certifying LLM Safety against Adversarial Promptin…

200 papers

Safety evaluations of large language models (LLMs) typically report binary outcomes, i.e. attack success rate (ASR), refusal rate, or harmful versus safe classification, which hide how risk changes between prompt and response. We present a…

Computation and Language · Computer Science 2026-05-21 Mengya Hu , Qiong Wei , Sandeep Atluri

Large language models (LLMs) undergo safety alignment to ensure safe conversations with humans. However, this paper introduces a training-free attack method capable of reversing safety alignment, converting the outcomes of stronger…

Computation and Language · Computer Science 2024-06-07 Zhanhui Zhou , Jie Liu , Zhichen Dong , Jiaheng Liu , Chao Yang , Wanli Ouyang , Yu Qiao

Ensuring the safety of large language model (LLM) applications is essential for developing trustworthy artificial intelligence. Current LLM safety benchmarks have two limitations. First, they focus solely on either discriminative or…

Computation and Language · Computer Science 2024-10-30 Yutao Mou , Shikun Zhang , Wei Ye

Large Vision-Language Models (LVLMs) unlock powerful multimodal reasoning but also expand the attack surface, particularly through adversarial inputs that conceal harmful goals in benign prompts. We propose SHIELD, a lightweight,…

Computation and Language · Computer Science 2025-10-16 Juan Ren , Mark Dras , Usman Naseem

Large language models (LLMs) are becoming increasingly prevalent in modern software systems, interfacing between the user and the Internet to assist with tasks that require advanced language understanding. To accomplish these tasks, the LLM…

Cryptography and Security · Computer Science 2025-07-04 Sizhe Chen , Arman Zharmagambetov , Saeed Mahloujifar , Kamalika Chaudhuri , David Wagner , Chuan Guo

In this paper, we tackle the emerging challenge of unintended harmful content generation in Large Language Models (LLMs) with a novel dual-stage optimisation technique using adversarial fine-tuning. Our two-pronged approach employs an…

Computation and Language · Computer Science 2023-08-29 Charles O'Neill , Jack Miller , Ioana Ciuca , Yuan-Sen Ting , Thang Bui

Tool-augmented Large Language Model (LLM) agents have demonstrated impressive capabilities in automating complex, multi-step real-world tasks, yet remain vulnerable to indirect prompt injection. Adversaries exploit this weakness by…

Cryptography and Security · Computer Science 2026-05-12 Wei Zhao , Zhe Li , Peixin Zhang , Jun Sun

Safety-aligned large language models (LLMs) sometimes falsely refuse pseudo-harmful prompts, like "how to kill a mosquito," which are actually harmless. Frequent false refusals not only frustrate users but also provoke a public backlash…

Computation and Language · Computer Science 2025-06-12 Bang An , Sicheng Zhu , Ruiyi Zhang , Michael-Andrei Panaitescu-Liess , Yuancheng Xu , Furong Huang

Large Language Models (LLMs) are widely deployed in real-world systems. Given their broader applicability, prompt engineering has become an efficient tool for resource-scarce organizations to adopt LLMs for their own purposes. At the same…

Cryptography and Security · Computer Science 2026-02-27 Piyush Jaiswal , Aaditya Pratap , Shreyansh Saraswati , Harsh Kasyap , Somanath Tripathy

The widespread adoption of web applications has made their security a critical concern and has increased the need for systematic ways to assess whether they can be considered trustworthy. However, "trust" assessment remains an open problem…

Cryptography and Security · Computer Science 2026-03-26 Oleksandr Yarotskyi , José D'Abruzzo Pereira , João R. Campos

Code-generating Large Language Models (LLMs) significantly accelerate software development. However, their frequent generation of insecure code presents serious risks. We present a comprehensive evaluation of seven parameter-efficient…

Cryptography and Security · Computer Science 2025-09-17 Kiho Lee , Jungkon Kim , Doowon Kim , Hyoungshick Kim

The system prompt in Large Language Models (LLMs) plays a pivotal role in guiding model behavior and response generation. Often containing private configuration details, user roles, and operational instructions, the system prompt has become…

Cryptography and Security · Computer Science 2025-06-02 Badhan Chandra Das , M. Hadi Amini , Yanzhao Wu

Recent advances in large language models (LLMs) have led to increasingly sophisticated safety protocols and features designed to prevent harmful, unethical, or unauthorized outputs. However, these guardrails remain susceptible to novel and…

Computation and Language · Computer Science 2025-07-08 Annika M Schoene , Cansu Canca

LLM-integrated applications are vulnerable to prompt injection attacks, where an attacker contaminates the input to inject malicious instructions, causing the LLM to follow the attacker's intent instead of the original user's. Existing…

Cryptography and Security · Computer Science 2026-01-27 Wei Zou , Yupei Liu , Yanting Wang , Ying Chen , Neil Gong , Jinyuan Jia

Large Language Models (LLMs) are powerful tools for answering user queries, yet they remain highly vulnerable to jailbreak attacks. Existing guardrail methods typically rely on internal features or textual responses to detect malicious…

Cryptography and Security · Computer Science 2026-05-29 Zikai Zhang , Rui Hu , Olivera Kotevska , Jiahao Xu

Large language models (LLMs), such as ChatGPT, have emerged with astonishing capabilities approaching artificial general intelligence. While providing convenience for various societal needs, LLMs have also lowered the cost of generating…

Computation and Language · Computer Science 2023-08-28 Zhenhua Wang , Wei Xie , Kai Chen , Baosheng Wang , Zhiwen Gui , Enze Wang

Although many large language models (LLMs) have been trained to refuse harmful requests, they are still vulnerable to jailbreaking attacks which rewrite the original prompt to conceal its harmful intent. In this paper, we propose a new…

Computation and Language · Computer Science 2024-06-10 Yihan Wang , Zhouxing Shi , Andrew Bai , Cho-Jui Hsieh

The proliferation of Large Language Models (LLMs) has revolutionized natural language processing and significantly impacted code generation tasks, enhancing software development efficiency and productivity. Notably, LLMs like GPT-4 have…

Software Engineering · Computer Science 2025-03-25 Sheng Ouyang , Yihao Qin , Bo Lin , Liqian Chen , Xiaoguang Mao , Shangwen Wang

A novel hack involving Large Language Models (LLMs) has emerged, exploiting adversarial suffixes to deceive models into generating perilous responses. Such jailbreaks can trick LLMs into providing intricate instructions to a malicious user…

Computation and Language · Computer Science 2023-11-08 Gabriel Alon , Michael Kamfonas

As large language models (LLMs) continue to advance in capabilities, ensuring their safety against jailbreak attacks remains a critical challenge. In this paper, we introduce a novel safety alignment approach called Answer-Then-Check, which…

Machine Learning · Computer Science 2026-03-09 Chentao Cao , Xiaojun Xu , Bo Han , Hang Li