English
Related papers

Related papers: AlphaSteer: Learning Refusal Steering with Princip…

200 papers

Current safety evaluations of language models rely on benchmark-based assessments that may miss localized vulnerabilities. We present RepIt, a simple and data-efficient framework for isolating concept-specific representations in LM…

Artificial Intelligence · Computer Science 2026-04-22 Vincent Siu , Nathan W. Henry , Nicholas Crispino , Yang Liu , Dawn Song , Chenguang Wang

Recently, language models like Llama 3.1 Instruct have become increasingly capable of agentic behavior, enabling them to perform tasks requiring short-term planning and tool use. In this study, we apply refusal-vector ablation to Llama 3.1…

Computation and Language · Computer Science 2024-10-16 Simon Lermen , Mateusz Dziemian , Govind Pimpale

Refusal refers to the functional behavior enabling safety-aligned language models to reject harmful or unethical prompts. Following the growing scientific interest in mechanistic interpretability, recent work encoded refusal behavior as a…

Artificial Intelligence · Computer Science 2026-03-25 Giorgio Piras , Raffaele Mura , Fabio Brau , Luca Oneto , Fabio Roli , Battista Biggio

Diffusion-based vision-language-action (VLA) models have emerged as strong priors for robotic manipulation, yet adapting them to real-world distributions remains challenging. In particular, on-robot reinforcement learning (RL) is expensive…

Robotics · Computer Science 2026-05-12 Junjie Lu , Xinyao Qin , Yuhua Jiang , Kaixin Wang , Chuheng Zhang , Bin Liang , Jun Yang , Min Xu , Li Zhao

While Large Language Models (LLMs) demonstrate remarkable capabilities, they remain susceptible to sophisticated, multi-step jailbreak attacks that circumvent conventional surface-level safety alignment by exploiting the internal generation…

Machine Learning · Computer Science 2026-05-21 Jiachen Ma , Jiawen Zhang , Xiangtian Li , Bo Zou , Chaochao Lu , Chao Yang

In many RL applications, ensuring an agent's actions adhere to constraints is crucial for safety. Most previous methods in Action-Constrained Reinforcement Learning (ACRL) employ a projection layer after the policy network to correct the…

Machine Learning · Computer Science 2025-02-18 Janaka Chathuranga Brahmanage , Jiajing Ling , Akshat Kumar

Multimodal Large Language Models (MLLMs) are increasingly vulnerable to multimodal Indirect Prompt Injection (IPI) attacks, which embed malicious instructions in images, videos, or audio to hijack model behavior. Existing defenses, designed…

Cryptography and Security · Computer Science 2025-12-08 Weikai Lu , Ziqian Zeng , Kehua Zhang , Haoran Li , Huiping Zhuang , Ruidong Wang , Cen Chen , Hao Peng

Safety-aligned language models are trained to refuse harmful requests, yet refusal behavior can be suppressed by steering their internal representations. Existing methods do so by ablating a refusal direction from model activations, aiming…

Artificial Intelligence · Computer Science 2026-05-22 Giorgio Piras , Raffaele Mura , Fabio Brau , Maura Pintor , Luca Oneto , Fabio Roli , Battista Biggio

Extensive work has been devoted to improving the safety mechanism of Large Language Models (LLMs). However, LLMs still tend to generate harmful responses when faced with malicious instructions, a phenomenon referred to as "Jailbreak…

Computation and Language · Computer Science 2024-02-26 Yanrui Du , Sendong Zhao , Ming Ma , Yuhan Chen , Bing Qin

Safety comes first in many real-world applications involving autonomous agents. Despite a large number of reinforcement learning (RL) methods focusing on safety-critical tasks, there is still a lack of high-quality evaluation of those…

Machine Learning · Computer Science 2022-12-13 Linrui Zhang , Qin Zhang , Li Shen , Bo Yuan , Xueqian Wang , Dacheng Tao

Sparse Autoencoders (SAEs) can extract interpretable features from large language models (LLMs) without supervision. However, their effectiveness in downstream steering tasks is limited by the requirement for contrastive datasets or large…

Computation and Language · Computer Science 2026-05-05 Seonglae Cho , Zekun Wu , Adriano Koshiyama

LLMs are commonly used in retrieval-augmented applications to execute user instructions based on data from external sources. For example, modern search engines use LLMs to answer queries based on relevant search results; email plugins…

Cryptography and Security · Computer Science 2025-03-07 Sahar Abdelnabi , Aideen Fay , Giovanni Cherubin , Ahmed Salem , Mario Fritz , Andrew Paverd

Protein Language Models (PLMs), pre-trained on extensive evolutionary data from natural proteins, have emerged as indispensable tools for protein design. While powerful, PLMs often struggle to produce proteins with precisely specified…

Biomolecules · Quantitative Biology 2025-09-15 Long-Kai Huang , Rongyi Zhu , Bing He , Jianhua Yao

Prompt engineering and finetuning aim to maximize language model performance on a given metric (like toxicity reduction). However, these methods do not fully elicit a model's capabilities. To reduce this gap, we introduce activation…

Computation and Language · Computer Science 2024-10-11 Alexander Matt Turner , Lisa Thiergart , Gavin Leech , David Udell , Juan J. Vazquez , Ulisse Mini , Monte MacDiarmid

Current safety alignment of foundation models largely follows a \emph{one-size-fits-all} paradigm, applying the same refusal policy across users and contexts. As a result, models may refuse requests that are unsafe for general users but…

Artificial Intelligence · Computer Science 2026-05-26 Qitao Tan , Xiaoying Song , Arman Akbari , Arash Akbari , Yanzhi Wang , Xiaoming Zhai , Lingzi Hong , Zhen Xiang , Jin Lu , Geng Yuan

Vision-Language-Action (VLA) models leverage powerful perceptual priors from web-scale Vision-Language Model (VLM) pre-training, yet they remain surprisingly brittle in practice, frequently failing at simple robotic tasks. To mitigate this,…

Robotics · Computer Science 2026-05-19 Miranda Muqing Miao , Subin Kim , Brandon Yang , Lyle Ungar

The field of large language models (LLMs) has grown rapidly in recent years, driven by the desire for better efficiency, interpretability, and safe use. Building on the novel approach of "activation engineering," this study explores…

Computation and Language · Computer Science 2025-08-26 Rumi Allbert , James K. Wiles , Vlad Grankovsky

Large Language Models (LLMs) are vulnerable to jailbreak attacks that exploit weaknesses in traditional safety alignment, which often relies on rigid refusal heuristics or representation engineering to block harmful outputs. While they are…

Computation and Language · Computer Science 2025-10-01 Yuyou Zhang , Miao Li , William Han , Yihang Yao , Zhepeng Cen , Ding Zhao

Large language models remain vulnerable to jailbreak attacks -- inputs designed to bypass safety mechanisms and elicit harmful responses -- despite advances in alignment and instruction tuning. We propose Head-Masked Nullspace Steering…

Cryptography and Security · Computer Science 2026-04-14 Vishal Pramanik , Maisha Maliha , Susmit Jha , Sumit Kumar Jha

Inference-time steering is widely regarded as a lightweight and parameter-free mechanism for controlling large language model (LLM) behavior, and prior work has often suggested that simple activation-level interventions can reliably induce…

Artificial Intelligence · Computer Science 2026-03-20 Zikang Ding , Qiying Hu , Yi Zhang , Hongji Li , Junchi Yao , Hongbo Liu , Lijie Hu