English
Related papers

Related papers: Gradient-Controlled Decoding: A Safety Guardrail f…

200 papers

Optimization-based adversarial suffixes can jailbreak aligned large language models (LLMs) while remaining fluent, weakening static and windowed perplexity-based detectors. We cast adversarial suffix detection as an online change-point…

Machine Learning · Computer Science 2026-05-20 Mohammed Alshaalan , Miguel R. D. Rodrigues

Multimodal Large Language Models (MLLMs) are increasingly deployed in real-world applications, yet their ability to make context-aware safety decisions remains limited. Existing methods often fail to balance oversensitivity (unjustified…

Computation and Language · Computer Science 2025-09-24 Zheyuan Liu , Zhangchen Xu , Guangyao Dou , Xiangchi Yuan , Zhaoxuan Tan , Radha Poovendran , Meng Jiang

Large Language Models (LLMs) presents significant priority in text understanding and generation. However, LLMs suffer from the risk of generating harmful contents especially while being employed to applications. There are several black-box…

Computation and Language · Computer Science 2023-12-11 Chengyuan Liu , Fubang Zhao , Lizhi Qing , Yangyang Kang , Changlong Sun , Kun Kuang , Fei Wu

The deployment of large language models (LLMs) has raised security concerns due to their susceptibility to producing harmful or policy-violating outputs when exposed to adversarial prompts. While alignment and guardrails mitigate common…

Computation and Language · Computer Science 2026-01-23 Rishit Chugh

Large Language Models (LLMs) have gained significant traction in various applications, yet their capabilities present risks for both constructive and malicious exploitation. Despite extensive training and fine-tuning efforts aimed at…

Machine Learning · Computer Science 2025-10-15 Zixuan Huang , Kecheng Huang , Lihao Yin , Bowei He , Huiling Zhen , Mingxuan Yuan , Zili Shao

Educational LLM tutors face a core AI alignment challenge: they must follow user intent while preserving pedagogical constraints and safety policies. We present an evaluation methodology for prompt-injection defenses in this setting,…

Cryptography and Security · Computer Science 2026-05-22 Alexandre Cristovão Maiorano

Large language models (LLMs) employ safety mechanisms to prevent harmful outputs, yet these defenses primarily rely on semantic pattern matching. We show that encoding harmful prompts as coherent mathematical problems -- using formalisms…

Cryptography and Security · Computer Science 2026-05-06 Haoyu Zhang , Mohammad Zandsalimy , Shanu Sushmita

Supporting ultra-reliable and low-latency communication (URLLC) is a challenge in current wireless systems. Channel codes that generate large codewords improve reliability but necessitate the use of interleavers, which introduce undesirable…

Information Theory · Computer Science 2023-07-12 Sahar Allahkaram , Francisco A. Monteiro , Ioannis Chatzigeorgiou

Despite extensive efforts to align Large Language Models (LLMs) with human values and safety rules, jailbreak attacks that exploit certain vulnerabilities continuously emerge, highlighting the need to strengthen existing LLMs with…

Machine Learning · Computer Science 2025-09-30 Xuekang Wang , Shengyu Zhu , Xueqi Cheng

Guessing Codeword Decoding (GCD) is a recently proposed soft-input forward error correction decoder for arbitrary binary linear codes. Inspired by recent proposals that leverage binary linear codebook structure to reduce the number of…

Information Theory · Computer Science 2024-12-23 Joseph Griffin , Peihong Yuan , Ken R. Duffy , Muriel Medard

Speculative decoding accelerates autoregressive generation by letting draft tokens bypass full verification, but conventional frameworks suffer from frequent false rejections, particularly when draft models produce semantically correct but…

Computation and Language · Computer Science 2026-04-16 Xuwen Zhou , Fangxin Liu , Chao Wang , Xiao Zheng , Hao Zheng , Min He , Li Jiang , Haibing Guan

Large Language Models (LLMs) remain vulnerable to jailbreak attacks, where adversarially crafted prompts induce policy-violating responses despite safety alignment. Existing defenses typically improve safety through external filtering,…

Cryptography and Security · Computer Science 2026-05-12 Yulong Chen , Qi Zhang , Jiawen Zhang , Yadong Liu , Mu Li , Jie Wen , Yong Xu

As large language models (LLMs) become more capable and widely used, ensuring the safety of their outputs is increasingly critical. Existing guardrail models, though useful in static evaluation settings, face two major limitations in…

Safety is a paramount concern for large language models (LLMs) in open deployment, motivating the development of safeguard methods that enforce ethical and responsible use through safety alignment or guardrail mechanisms. Jailbreak attacks…

Cryptography and Security · Computer Science 2025-04-10 Qingzhao Zhang , Ziyang Xiong , Z. Morley Mao

With the extensive deployment of Large Language Models (LLMs), ensuring their safety has become increasingly critical. However, existing defense methods often struggle with two key issues: (i) inadequate defense capabilities, particularly…

Artificial Intelligence · Computer Science 2025-02-11 Weidi Luo , He Cao , Zijing Liu , Yu Wang , Aidan Wong , Bing Feng , Yuan Yao , Yu Li

We introduce WildGuard -- an open, light-weight moderation tool for LLM safety that achieves three goals: (1) identifying malicious intent in user prompts, (2) detecting safety risks of model responses, and (3) determining model refusal…

Computation and Language · Computer Science 2024-12-11 Seungju Han , Kavel Rao , Allyson Ettinger , Liwei Jiang , Bill Yuchen Lin , Nathan Lambert , Yejin Choi , Nouha Dziri

Large Language Models (LLMs) have gained widespread adoption across various domains, including chatbots and auto-task completion agents. However, these models are susceptible to safety vulnerabilities such as jailbreaking, prompt injection,…

Cryptography and Security · Computer Science 2024-09-10 Divyanshu Kumar , Anurakt Kumar , Sahil Agarwal , Prashanth Harshangi

This paper addresses the critical challenge of deriving interpretable confidence scores from generative language models (LLMs) when applied to multi-label content safety classification. While models like LLaMA Guard are effective for…

Computation and Language · Computer Science 2025-12-01 Anjaneya Praharaj , Jaykumar Kasundra

Recent studies show that the deep neural networks (DNNs) have achieved great success in various tasks. However, even the \emph{state-of-the-art} deep learning based classifiers are extremely vulnerable to adversarial examples, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Sen Pei , Jiaxi Sun , Xiaopeng Zhang , Gaofeng Meng

Recent studies have widely investigated backdoor attacks on Large Language Models (LLMs) by inserting harmful question-answer (QA) pairs into their training data. However, we revisit existing attacks and identify two critical limitations:…

Computation and Language · Computer Science 2025-10-07 Jiawei Kong , Hao Fang , Xiaochen Yang , Kuofeng Gao , Bin Chen , Shu-Tao Xia , Ke Xu , Han Qiu