English
Related papers

Related papers: Refusal in Language Models Is Mediated by a Single…

200 papers

Safety alignment in large language models (LLMs), particularly for cybersecurity tasks, primarily focuses on preventing misuse. While this approach reduces direct harm, it obscures a complementary failure mode: denial of assistance to…

Cryptography and Security · Computer Science 2026-03-12 David Campbell , Neil Kale , Udari Madhushani Sehwag , Bert Herring , Nick Price , Dan Borges , Alex Levinson , Christina Q Knight

Safety-trained language models routinely refuse requests for help circumventing rules. But not all rules deserve compliance. When users ask for help evading rules imposed by an illegitimate authority, rules that are deeply unjust or absurd…

Artificial Intelligence · Computer Science 2026-04-09 Cameron Pattison , Lorenzo Manuali , Seth Lazar

LLMs are trained to refuse harmful instructions, but do they truly understand harmfulness beyond just refusing? Prior work has shown that LLMs' refusal behaviors can be mediated by a one-dimensional subspace, i.e., a refusal direction. In…

Computation and Language · Computer Science 2025-12-16 Jiachen Zhao , Jing Huang , Zhengxuan Wu , David Bau , Weiyan Shi

Safety alignment in large language models (LLMs) is primarily evaluated under open-ended generation, where models can mitigate risk by refusing to respond. In contrast, many real-world applications place LLMs in structured decision-making…

Computation and Language · Computer Science 2026-04-21 Yuheng Chen , Zhiyu Wu , Bowen Cheng , Tetsuro Takahashi

Multimodal large language models (MLLMs) have become the cornerstone of today's generative AI ecosystem, sparking intense competition among tech giants and startups. In particular, an MLLM generates a text response given a prompt consisting…

Cryptography and Security · Computer Science 2024-09-09 Zedian Shao , Hongbin Liu , Yuepeng Hu , Neil Zhenqiang Gong

Large language models and LLM-based agents are increasingly used for cybersecurity tasks that are inherently dual-use. Existing approaches to refusal, spanning academic policy frameworks and commercially deployed systems, often rely on…

Computation and Language · Computer Science 2026-02-19 Noa Linder , Meirav Segal , Omer Antverg , Gil Gekker , Tomer Fichman , Omri Bodenheimer , Edan Maor , Omer Nevo

We introduce Refusal Steering, an inference-time method to exercise fine-grained control over Large Language Models refusal behaviour on politically sensitive topics without retraining. We replace fragile pattern-based refusal detection…

Computation and Language · Computer Science 2026-02-25 Iker García-Ferrero , David Montero , Roman Orus

While large language models (LLMs) have increasingly been applied to hate speech detoxification, the prompts often trigger safety alerts, causing LLMs to refuse the task. In this study, we systematically investigate false refusal behavior…

Computation and Language · Computer Science 2026-01-14 Kyuri Im , Shuzhou Yuan , Michael Färber

The rapid growth of large language models has spurred significant interest in model compression as a means to enhance their accessibility and practicality. While extensive research has explored model compression through the lens of safety,…

Computation and Language · Computer Science 2025-04-08 Vishnu Kabir Chhabra , Mohammad Mahdi Khalili

Since the release of OpenAI's ChatGPT, generative language models have attracted extensive public attention. The increased usage has highlighted generative models' broad utility, but also revealed several forms of embedded bias. Some is…

Artificial Intelligence · Computer Science 2023-06-16 Max Reuter , William Schulze

Frontier large language models are increasingly deployed as orchestration backbones for biological research workflows, yet no shared evidence base exists for comparing their refusal behaviour on legitimate research prompts. RefusalBench,…

Software Engineering · Computer Science 2026-05-22 Lukas Weidener , Marko Brkić , Mihailo Jovanović , Emre Ulgac , Aakaash Meduri

Large Language Models (LLMs) are widely used across sectors, yet their alignment with International Humanitarian Law (IHL) is not well understood. This study evaluates eight leading LLMs on their ability to refuse prompts that explicitly…

Computers and Society · Computer Science 2025-06-10 John Mavi , Diana Teodora Găitan , Sergio Coronado

Recent advancements in large language models (LLMs) have demonstrated that fine-tuning and human alignment can render LLMs harmless. In practice, such "harmlessness" behavior is mainly achieved by training models to reject harmful requests,…

Computation and Language · Computer Science 2025-03-25 Shengyun Si , Xinpeng Wang , Guangyao Zhai , Nassir Navab , Barbara Plank

Safety-aligned language models refuse harmful requests through learned refusal behaviors encoded in their internal representations. Recent activation-based jailbreaking methods circumvent these safety mechanisms by applying orthogonal…

Machine Learning · Computer Science 2026-03-05 Geraldin Nanfack , Eugene Belilovsky , Elvis Dohmatob

Large Language Models used in ChatGPT have traditionally been trained to learn a refusal boundary: depending on the user's intent, the model is taught to either fully comply or outright refuse. While this is a strong mitigation for…

Computers and Society · Computer Science 2025-08-14 Yuan Yuan , Tina Sriskandarajah , Anna-Luisa Brakman , Alec Helyar , Alex Beutel , Andrea Vallone , Saachi Jain

Safety alignment instills in Large Language Models (LLMs) a critical capacity to refuse malicious requests. Prior works have modeled this refusal mechanism as a single linear direction in the activation space. We posit that this is an…

Cryptography and Security · Computer Science 2025-11-25 Peng Zhang , Peijie Sun

Language models are commonly fine-tuned for safety alignment to refuse harmful prompts. One approach fine-tunes them to generate categorical refusal tokens that distinguish different refusal types before responding. In this work, we…

Artificial Intelligence · Computer Science 2026-03-17 Rishab Alagharu , Ishneet Sukhvinder Singh , Shaibi Shamsudeen , Zhen Wu , Ashwinee Panda

Current alignment evaluation mostly measures whether models encode dangerous concepts and whether they refuse harmful requests. Both miss the layer where alignment often operates: routing from concept detection to behavioral policy. We…

Machine Learning · Computer Science 2026-05-04 Gregory N. Frank

LLM safety and ethical alignment are widely discussed, but the impact of content moderation on user satisfaction remains underexplored. In particular, little is known about how users respond when models refuse to answer a prompt-one of the…

Computation and Language · Computer Science 2025-05-19 Stefan Pasch

For safety reasons, large language models (LLMs) are trained to refuse harmful user instructions, such as assisting dangerous activities. We study an open question in this work: does the desired safety refusal, typically enforced in chat…