English
Related papers

Related papers: Just Enough Shifts: Mitigating Over-Refusal in Ali…

200 papers

Safety alignment in language models operates through two mechanistically distinct systems: refusal neurons that gate whether harmful knowledge is expressed, and concept neurons that encode the harmful knowledge itself. By targeting a single…

Computation and Language · Computer Science 2026-05-12 Hamid Kazemi , Atoosa Chegini , Maria Safi

Large language models (LLMs) enforce safety alignment to reliably refuse malicious requests, yet the same blanket safeguards also block legitimate uses in policing, defense, and other high-stakes settings. Earlier "refusal-direction" edits…

Machine Learning · Computer Science 2025-09-17 Xin Tong , Zhi Lin , Jingya Wang , Meng Han , Bo Jin

This work introduces a novel framework for evaluating LLMs' capacity to balance instruction-following with critical reasoning when presented with multiple-choice questions containing no valid answers. Through systematic evaluation across…

Computation and Language · Computer Science 2025-06-03 Gracjan Góral , Emilia Wiśnios , Piotr Sankowski , Paweł Budzianowski

We localize the policy routing mechanism in alignment-trained language models. An intermediate-layer attention gate reads detected content and triggers deeper amplifier heads that boost the signal toward refusal. In smaller models the gate…

Computation and Language · Computer Science 2026-05-04 Gregory N. Frank

Large language models (LLMs) often require fine-tuning (FT) to perform well on downstream tasks, but FT can induce safety-alignment drift even when the training dataset contains only benign data. Prior work shows that introducing a small…

Computation and Language · Computer Science 2026-03-10 Guoli Wang , Haonan Shi , Tu Ouyang , An Wang

Safety alignment in Large Language Models (LLMs) remains highly fragile during fine-tuning, where even benign adaptation can degrade pre-trained refusal behaviors and enable harmful responses. Existing defenses typically constrain either…

Artificial Intelligence · Computer Science 2026-04-15 Songping Peng , Zhiheng Zhang , Daojian Zeng , Lincheng Jiang , Xieping Gao

Large Language Models (LLMs) have shown remarkable performance in multi-turn dialogue. However, in multi-turn dialogue, models still struggle to stay aligned with what has been established earlier, follow dependencies across many turns, and…

Computation and Language · Computer Science 2026-01-12 Jiawei Shen , Jia Zhu , Hanghui Guo , Weijie Shi , Yue Cui , Qingyu Niu , Guoqing Ma , Yidan Liang , Jingjiang Liu , Yiling Wang , Shimin Di , Jiajie Xu

The aim of multi-agent reinforcement learning systems is to provide interacting agents with the ability to collaboratively learn and adapt to the behavior of other agents. In many real-world applications, the agents can only acquire a…

Artificial Intelligence · Computer Science 2019-10-10 Mingyang Geng , Kele Xu , Yiying Li , Shuqi Liu , Bo Ding , Huaimin Wang

Large Language Models (LLMs) offer a promising basis for creating agents that can tackle complex tasks through iterative environmental interaction. Existing methods either require these agents to mimic expert-provided trajectories or rely…

Computation and Language · Computer Science 2024-12-02 Dihong Gong , Pu Lu , Zelong Wang , Meng Zhou , Xiuqiang He

Recently, language models like Llama 3.1 Instruct have become increasingly capable of agentic behavior, enabling them to perform tasks requiring short-term planning and tool use. In this study, we apply refusal-vector ablation to Llama 3.1…

Computation and Language · Computer Science 2024-10-16 Simon Lermen , Mateusz Dziemian , Govind Pimpale

Safety alignment is indispensable for Large Language Models (LLMs) to defend threats from malicious instructions. However, recent researches reveal safety-aligned LLMs prone to reject benign queries due to the exaggerated safety issue,…

Artificial Intelligence · Computer Science 2024-12-18 Zouying Cao , Yifei Yang , Hai Zhao

A long-standing challenge in developing accurate recommendation models is simulating user behavior, mainly due to the complex and stochastic nature of user interactions. Towards this, one promising line of work has been the use of Large…

Information Retrieval · Computer Science 2025-09-15 Himanshu Thakur , Eshani Agrawal , Smruthi Mukund

Assistive agents should not only take actions on behalf of a human, but also step out of the way and cede control when there are important decisions to be made. However, current methods for building assistive agents, whether via mimicking…

Artificial Intelligence · Computer Science 2025-10-17 Evan Ellis , Vivek Myers , Jens Tuyls , Sergey Levine , Anca Dragan , Benjamin Eysenbach

Large Language Models (LLMs), despite advances in instruction tuning, often fail to follow complex user instructions. Activation steering techniques aim to mitigate this by manipulating model internals, but have a potential risk of…

Machine Learning · Computer Science 2026-03-10 Minjae Kang , Jaehyung Kim

The instruction-following ability of large language models enables humans to interact with AI agents in a natural way. However, when required to generate responses of a specific length, large language models often struggle to meet users'…

Computation and Language · Computer Science 2024-10-02 Jiaming Li , Lei Zhang , Yunshui Li , Ziqiang Liu , yuelin bai , Run Luo , Longze Chen , Min Yang

Agentic reinforcement learning (RL) trains large language models to autonomously call tools during reasoning, with search as the most common application. These models excel at multi-step reasoning tasks, but their safety properties are not…

Computation and Language · Computer Science 2025-10-21 Yushi Yang , Shreyansh Padarha , Andrew Lee , Adam Mahdi

Large language models (LLMs) provide excellent text-generation capabilities, but standard prompting and generation methods generally do not lead to intentional or goal-directed agents and might necessitate considerable prompt tuning. This…

Computation and Language · Computer Science 2023-12-01 Marwa Abdulhai , Isadora White , Charlie Snell , Charles Sun , Joey Hong , Yuexiang Zhai , Kelvin Xu , Sergey Levine

Safety alignment in large language models (LLMs) is primarily evaluated under open-ended generation, where models can mitigate risk by refusing to respond. In contrast, many real-world applications place LLMs in structured decision-making…

Computation and Language · Computer Science 2026-04-21 Yuheng Chen , Zhiyu Wu , Bowen Cheng , Tetsuro Takahashi

Language models are commonly fine-tuned for safety alignment to refuse harmful prompts. One approach fine-tunes them to generate categorical refusal tokens that distinguish different refusal types before responding. In this work, we…

Artificial Intelligence · Computer Science 2026-03-17 Rishab Alagharu , Ishneet Sukhvinder Singh , Shaibi Shamsudeen , Zhen Wu , Ashwinee Panda

Large language models (LLMs), initially developed for generative AI, are now evolving into agentic AI systems, which make decisions in complex, real-world contexts. Unfortunately, while their generative capabilities are well-documented,…

Artificial Intelligence · Computer Science 2026-04-02 Matthew DosSantos DiSorbo , Harang Ju , Sinan Aral