English
Related papers

Related papers: CRaFT: Circuit-Guided Refusal Feature Selection vi…

200 papers

Grounded multi-video question answering over real-world news events requires systems to surface query-relevant evidence across heterogeneous video archives while attributing every claim to its supporting source. We introduce CRAFT…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Mahesh Bhosale , Abdul Wasi , Vishvesh Trivedi , Pengyu Yan , Akhil Gorugantu , David Doermann

Representation Engineering analyses often characterize refusal using static directions extracted from terminal or pooled representations. We ask whether this view misses how refusal is constructed across layer-token positions. Using causal…

Cryptography and Security · Computer Science 2026-05-27 Xulin Hu , Che Wang , Wei Yang Bryan Lim , Jianbo Gao , Zhong Chen

Responsible deployment of language models requires mechanisms for refusing unsafe prompts while preserving model performance. While most approaches modify model weights through additional training, we explore an alternative: steering model…

LLMs are trained to refuse harmful instructions, but do they truly understand harmfulness beyond just refusing? Prior work has shown that LLMs' refusal behaviors can be mediated by a one-dimensional subspace, i.e., a refusal direction. In…

Computation and Language · Computer Science 2025-12-16 Jiachen Zhao , Jing Huang , Zhengxuan Wu , David Bau , Weiyan Shi

Automated Code Review (ACR) systems integrating Large Language Models (LLMs) are increasingly adopted in software development workflows, ranging from interactive assistants to autonomous agents in CI/CD pipelines. In this paper, we study…

Software Engineering · Computer Science 2026-04-24 Dimitris Mitropoulos , Nikolaos Alexopoulos , Georgios Alexopoulos , Diomidis Spinellis

As the deep learning techniques have expanded to real-world recommendation tasks, many deep neural network based Collaborative Filtering (CF) models have been developed to project user-item interactions into latent feature space, based on…

Information Retrieval · Computer Science 2022-03-29 Lianghao Xia , Chao Huang , Yong Xu , Huance Xu , Xiang Li , Weiguo Zhang

Despite the remarkable performance of Large Language Models (LLMs), they remain vulnerable to jailbreak attacks, which can compromise their safety mechanisms. Existing studies often rely on brute-force optimization or manual design, failing…

Computation and Language · Computer Science 2025-06-30 Haoming Yang , Ke Ma , Xiaojun Jia , Yingfei Sun , Qianqian Xu , Qingming Huang

Activation steering has emerged as a powerful tool to shape LLM behavior without the need for weight updates. While its inherent brittleness and unreliability are well-documented, its safety implications remain underexplored. In this work,…

Cryptography and Security · Computer Science 2026-03-26 Yuxiao Li , Alina Fastowski , Efstratios Zaradoukas , Bardh Prenkaj , Gjergji Kasneci

The massive scale of modern AI accelerators presents critical challenges to traditional fault assessment methodologies, which face prohibitive computational costs and provide poor coverage of critical failure modes. This paper introduces…

Artificial Intelligence · Computer Science 2025-12-11 Khurram Khalil , Muhammad Mahad Khaliq , Khaza Anuarul Hoque

Jailbreaks have been a central focus of research regarding the safety and reliability of large language models (LLMs), yet the mechanisms underlying these attacks remain poorly understood. While previous studies have predominantly relied on…

Cryptography and Security · Computer Science 2025-11-04 Nathalie Kirch , Constantin Weisser , Severin Field , Helen Yannakoudakis , Stephen Casper

Refusal refers to the functional behavior enabling safety-aligned language models to reject harmful or unethical prompts. Following the growing scientific interest in mechanistic interpretability, recent work encoded refusal behavior as a…

Artificial Intelligence · Computer Science 2026-03-25 Giorgio Piras , Raffaele Mura , Fabio Brau , Luca Oneto , Fabio Roli , Battista Biggio

Instruction Fine-Tuning (IFT) has been widely adopted as an effective post-training strategy to enhance various abilities of Large Language Models (LLMs). However, prior studies have shown that IFT can significantly compromise LLMs' safety,…

Computation and Language · Computer Science 2025-09-09 Yanrui Du , Fenglei Fan , Sendong Zhao , Jiawei Cao , Qika Lin , Kai He , Ting Liu , Bing Qin , Mengling Feng

Recent work has shown that language models' refusal behavior is primarily encoded in a single direction in their latent space, making it vulnerable to targeted attacks. Although Latent Adversarial Training (LAT) attempts to improve…

Computation and Language · Computer Science 2025-04-29 Alexandra Abbas , Nora Petrova , Helios Ael Lyons , Natalia Perez-Campanero

Graph prompt tuning has emerged as a promising paradigm to effectively transfer general graph knowledge from pre-trained models to various downstream tasks, particularly in few-shot contexts. However, its susceptibility to backdoor attacks,…

Machine Learning · Computer Science 2025-04-01 Ying Song , Rita Singh , Balaji Palanisamy

Current alignment evaluation mostly measures whether models encode dangerous concepts and whether they refuse harmful requests. Both miss the layer where alignment often operates: routing from concept detection to behavioral policy. We…

Machine Learning · Computer Science 2026-05-04 Gregory N. Frank

We localize the policy routing mechanism in alignment-trained language models. An intermediate-layer attention gate reads detected content and triggers deeper amplifier heads that boost the signal toward refusal. In smaller models the gate…

Computation and Language · Computer Science 2026-05-04 Gregory N. Frank

Task-oriented LLM-based agents are increasingly used in domains with strict policies, such as refund eligibility or cancellation rules. The challenge lies in ensuring that the agent consistently adheres to these rules and policies,…

Multiagent Systems · Computer Science 2025-08-26 Itay Nakash , George Kour , Koren Lazar , Matan Vetzler , Guy Uziel , Ateret Anaby-Tavor

The first layer of a deep CNN backbone applies filters to an image to extract the basic features available to later layers. During training, some filters may go inactive, mean ing all weights in the filter approach zero. An inactive fil ter…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Aman Bhatta , Domingo Mery , Haiyu Wu , Kevin W. Bowyer

Large Language Models (LLMs) suffer from a range of vulnerabilities that allow malicious users to solicit undesirable responses through manipulation of the input text. These so-called jailbreak prompts are designed to trick the LLM into…

Computation and Language · Computer Science 2025-10-13 John Hawkins , Aditya Pramar , Rodney Beard , Rohitash Chandra

Uncovering the mechanisms behind "jailbreaks" in large language models (LLMs) is crucial for enhancing their safety and reliability, yet these mechanisms remain poorly understood. Existing studies predominantly analyze jailbreak prompts by…

Machine Learning · Computer Science 2026-02-06 Licheng Pan , Yunsheng Lu , Jiexi Liu , Jialing Tao , Haozhe Feng , Hui Xue , Zhixuan Chu , Kui Ren