English
Related papers

Related papers: Attributional Safety Failures in Large Language Mo…

200 papers

Alignment tuning has enabled large language models to excel in reasoning, instruction-following, and minimizing harmful generations. However, despite their widespread deployment, these models exhibit a monolingual bias, raising concerns…

Computation and Language · Computer Science 2025-04-04 Nikhil Verma , Manasa Bharadwaj

Safety alignment in large language models (LLMs), particularly for cybersecurity tasks, primarily focuses on preventing misuse. While this approach reduces direct harm, it obscures a complementary failure mode: denial of assistance to…

Cryptography and Security · Computer Science 2026-03-12 David Campbell , Neil Kale , Udari Madhushani Sehwag , Bert Herring , Nick Price , Dan Borges , Alex Levinson , Christina Q Knight

Large language models (LLMs) undergo safety alignment to ensure safe conversations with humans. However, this paper introduces a training-free attack method capable of reversing safety alignment, converting the outcomes of stronger…

Computation and Language · Computer Science 2024-06-07 Zhanhui Zhou , Jie Liu , Zhichen Dong , Jiaheng Liu , Chao Yang , Wanli Ouyang , Yu Qiao

Most safety evaluations of large language models (LLMs) remain anchored in English. Translation is often used as a shortcut to probe multilingual behavior, but it rarely captures the full picture, especially when harmful intent or structure…

Computation and Language · Computer Science 2026-02-10 Vaibhav Shukla , Hardik Sharma , Adith N Reganti , Soham Wasmatkar , Bagesh Kumar , Vrijendra Singh

Guardrails are critical for the safe deployment of Large Language Models (LLMs)-powered software. Unlike traditional rule-based systems with limited, predefined input-output spaces that inherently constrain unsafe behavior, LLMs enable…

Cryptography and Security · Computer Science 2025-09-23 Rui Yang , Michael Fu , Chakkrit Tantithamthavorn , Chetan Arora , Gunel Gulmammadova , Joey Chua

Code-switching (CSW) is the act of alternating between two or more languages within a single discourse. This phenomenon is widespread in multilingual communities, and increasingly prevalent in online content, where users naturally mix…

Computation and Language · Computer Science 2025-06-18 Amr Mohamed , Yang Zhang , Michalis Vazirgiannis , Guokan Shang

As large language models (LLMs) constantly evolve, ensuring their safety remains a critical research problem. Previous red-teaming approaches for LLM safety have primarily focused on single prompt attacks or goal hijacking. To the best of…

Computation and Language · Computer Science 2024-06-26 Erxin Yu , Jing Li , Ming Liao , Siqi Wang , Zuchen Gao , Fei Mi , Lanqing Hong

Large Language Models (LLMs) have emerged as powerful tools, but their inherent safety risks - ranging from harmful content generation to broader societal harms - pose significant challenges. These risks can be amplified by the recent…

Refusal mechanisms in large language models (LLMs) are essential for ensuring safety. Recent research has revealed that refusal behavior can be mediated by a single direction in activation space, enabling targeted interventions to bypass…

Computation and Language · Computer Science 2026-02-26 Xinpeng Wang , Mingyang Wang , Yihong Liu , Hinrich Schütze , Barbara Plank

Large Language Models (LLMs) demonstrate impressive capabilities across a wide range of tasks, yet their safety mechanisms remain susceptible to adversarial attacks that exploit cognitive biases -- systematic deviations from rational…

Computation and Language · Computer Science 2025-11-18 Xikang Yang , Biyu Zhou , Xuehai Tang , Jizhong Han , Songlin Hu

Multilingual Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to perform knowledge-intensive tasks in multilingual settings by leveraging retrieved documents as external evidence. However, when the retrieved…

Computation and Language · Computer Science 2025-11-14 Bo Li , Zhenghua Xu , Rui Xie

Fine-tuning a general-purpose large language model (LLM) for a specific domain or task has become a routine procedure for ordinary users. However, fine-tuning is known to remove the safety alignment features of the model, even when the…

Computation and Language · Computer Science 2025-06-23 Kathleen C. Fraser , Hillary Dawkins , Isar Nejadgholi , Svetlana Kiritchenko

Large language models (LLMs) have acquired the ability to handle longer context lengths and understand nuances in text, expanding their dialogue capabilities beyond a single utterance. A popular user-facing application of LLMs is the…

Computation and Language · Computer Science 2024-10-29 Terry Tong , Jiashu Xu , Qin Liu , Muhao Chen

To address the trade-off between robustness and performance for robust VLM, we observe that function words could incur vulnerability of VLMs against cross-modal adversarial attacks, and propose Function-word De-Attention (FDA) accordingly…

Machine Learning · Computer Science 2026-04-17 Qiwei Tian , Chenhao Lin , Zhengyu Zhao , Chao Shen

The rapid adoption of Large Language Models(LLMs) for code generation has transformed software development, yet little attention has been given to how security vulnerabilities evolve through iterative LLM feedback. This paper analyzes…

Software Engineering · Computer Science 2025-09-29 Shivani Shukla , Himanshu Joshi , Romilla Syed

We have uncovered a powerful jailbreak technique that leverages large language models' ability to diverge from prior context, enabling them to bypass safety constraints and generate harmful outputs. By simply instructing the LLM to deviate…

Computation and Language · Computer Science 2025-05-13 Weiliang Zhao , Daniel Ben-Levi , Wei Hao , Junfeng Yang , Chengzhi Mao

Large Language Models (LLMs) exhibit strong but shallow alignment: they directly refuse harmful queries when a refusal is expected at the very start of an assistant turn, yet this protection collapses once a harmful continuation is underway…

Machine Learning · Computer Science 2025-10-22 Jiawei Zhang , Andrew Estornell , David D. Baek , Bo Li , Xiaojun Xu

Large Language Models (LLMs) transform artificial intelligence, driving advancements in natural language understanding, text generation, and autonomous systems. The increasing complexity of their development and deployment introduces…

Cryptography and Security · Computer Science 2025-02-19 Shenao Wang , Yanjie Zhao , Zhao Liu , Quanchen Zou , Haoyu Wang

With the increasing adoption of large language models (LLMs), ensuring the safety of LLM systems has become a pressing concern. External LLM-based guardrail models have emerged as a popular solution to screen unsafe inputs and outputs, but…

Computation and Language · Computer Science 2025-10-08 Yining She , Daniel W. Peterson , Marianne Menglin Liu , Vikas Upadhyay , Mohammad Hossein Chaghazardi , Eunsuk Kang , Dan Roth

Large language models exhibit systematic vulnerabilities to adversarial attacks despite extensive safety alignment. We provide a mechanistic analysis revealing that position-dependent gradient weakening during autoregressive training…

Machine Learning · Computer Science 2025-11-18 Thong Bach , Dung Nguyen , Thao Minh Le , Truyen Tran