English
Related papers

Related papers: Fine-Grained Activation Steering: Steering Less, A…

200 papers

Steering large language models (LLMs) is usually done by either instruction prompting or activation steering. Prompting often gives strong control, but caches guidance tokens at every layer and can clutter long interactions; activation…

Machine Learning · Computer Science 2026-05-12 Andy Zeyi Liu , Michael Zhang , Ilana Greenberg , Adam Alnasser , Lucas Baker , John Sous

We propose affine concept editing (ACE) as an approach for steering language models' behavior by intervening directly in activations. We begin with an affine decomposition of model activation vectors and show that prior methods for steering…

Machine Learning · Computer Science 2025-01-29 Thomas Marshall , Adam Scherlis , Nora Belrose

Although large vision-language models (LVLMs) leverage rich visual token representations to achieve strong performance on multimodal tasks, these tokens also introduce significant computational overhead during inference. Existing…

Machine Learning · Computer Science 2025-05-20 Yichen Guo , Hanze Li , Zonghao Zhang , Jinhao You , Kai Tang , Xiande Huang

The mechanisms by which reasoning training reshapes LLMs' internal computations remain unclear. We study lightweight steering vectors inserted into the base model's residual stream and trained with a reinforcement-learning objective. These…

Recent advances in Large Language Models (LLMs) have demonstrated remarkable progress in their reasoning capabilities, such as Chain-of-Thought (CoT). Most approaches rely on CoT rationales. Previous studies have shown that LLMs often…

Computation and Language · Computer Science 2026-01-21 Kentaro Kazama , Daiki Shirafuji , Tatsuhiko Saito

This paper proposes $\mathrm{dynActivation}$, a per-layer trainable activation defined as $f_i(x) = \mathrm{BaseAct}(x)(\alpha_i - \beta_i) + \beta_i x$, where $\alpha_i$ and $\beta_i$ are lightweight learned scalars that interpolate…

Machine Learning · Computer Science 2026-03-24 Alois Bachmann

Recent work has demonstrated the potential of contrastive steering for jailbreaking Large Language Models (LLMs). However, existing methods rely on limited and inherently biased contrastive prompts and require laborious manual tuning of…

Cryptography and Security · Computer Science 2026-05-21 Junxi Chen , Junhao Dong , Xiaohua Xie

With the rapid expansion of large language models (LLMs), the demand for memory and computational resources has grown significantly. Recent advances in LLM pruning aim to reduce the size and computational cost of these models. However,…

Machine Learning · Computer Science 2025-05-29 Zhendong Mi , Zhenglun Kong , Geng Yuan , Shaoyi Huang

Limited data for low-resource languages typically yield weaker language models (LMs). Since pre-training is compute-intensive, it is more pragmatic to target improvements during fine-tuning. In this work, we examine the use of Active…

Computation and Language · Computer Science 2025-12-02 Jozef Kubík , Marek Šuppa , Martin Takáč

Language models often default to a narrow set of high-probability outputs, leaving their generation paths homogeneous and prone to mode collapse. Sampling-based strategies inject randomness but still struggle to guarantee diversity across…

Machine Learning · Computer Science 2026-01-30 Dongxuan Zhu , Ly Tran Ho Khanh , Andy Yat-Ming Cheung , Man-Chung Yue , Viet Anh Nguyen

Alignment of Large Language Models (LLMs) is the ability to satisfy desired objectives during generation, which is critical for trustworthy deployment. In practice, alignment is often operationalized through multiple objectives such as…

Computation and Language · Computer Science 2026-05-19 Gautam Siddharth Kashyap , Mark Dras , Usman Naseem

Vision-Language-Action (VLA) models leverage powerful perceptual priors from web-scale Vision-Language Model (VLM) pre-training, yet they remain surprisingly brittle in practice, frequently failing at simple robotic tasks. To mitigate this,…

Robotics · Computer Science 2026-05-19 Miranda Muqing Miao , Subin Kim , Brandon Yang , Lyle Ungar

Vision-Language-Action (VLA) models pre-trained on large, diverse datasets show remarkable potential for general-purpose robotic manipulation. However, a primary bottleneck remains in adapting these models to downstream tasks, especially…

Robotics · Computer Science 2025-09-08 Yang Zhang , Chenwei Wang , Ouyang Lu , Yuan Zhao , Yunfei Ge , Zhenglong Sun , Xiu Li , Chi Zhang , Chenjia Bai , Xuelong Li

Activation steering methods were shown to be effective in conditioning language model generation by additively intervening over models' intermediate representations. However, the evaluation of these techniques has so far been limited to…

Computation and Language · Computer Science 2024-12-02 Daniel Scalena , Gabriele Sarti , Malvina Nissim

Controlling the behavior of large language models (LLMs) at inference time is essential for aligning outputs with human abilities and safety requirements. \emph{Activation steering} provides a lightweight alternative to prompt engineering…

Artificial Intelligence · Computer Science 2026-01-30 Diaoulé Diallo , Katharina Dworatzyk , Sophie Jentzsch , Peer Schütt , Sabine Theis , Tobias Hecking

Recent studies have indicated that Large Language Models (LLMs) harbor an inherent understanding of truthfulness, yet often fail to consistently express it and generate false statements. This gap between "knowing" and "telling" poses a…

Computation and Language · Computer Science 2025-02-27 Tianlong Wang , Xianfeng Jiao , Yinghao Zhu , Zhongzhi Chen , Yifan He , Xu Chu , Junyi Gao , Yasha Wang , Liantao Ma

As large language models (LLMs) evolve in complexity and capability, the efficacy of less widely deployed alignment techniques are uncertain. Building on previous work on activation steering and contrastive activation addition (CAA), this…

Machine Learning · Computer Science 2025-07-17 Sheikh Abdur Raheem Ali , Justin Xu , Ivory Yang , Jasmine Xinze Li , Ayse Arslan , Clark Benham

Transformers and large language models (LLMs) have revolutionized machine learning, with attention mechanisms at the core of their success. As the landscape of attention variants expands, so too do the challenges of optimizing their…

Computation and Language · Computer Science 2025-02-24 Feiyang Chen , Yu Cheng , Lei Wang , Yuqing Xia , Ziming Miao , Lingxiao Ma , Fan Yang , Jilong Xue , Zhi Yang , Mao Yang , Haibo Chen

Generative verifiers have emerged as a promising paradigm for step-wise verification, but their verification behavior is often poorly calibrated: they may be under-critical and miss erroneous steps, or over-critical and reject correct…

Machine Learning · Computer Science 2026-05-21 Yefan Zhou , Yilun Zhou , Austin Xu , Soroush Vosoughi , Shafiq Joty , Jiang Gui

The scaling of Large Multimodal Models (LMMs) is constrained by the quality-quantity trade-off inherent in synthetic data. Previous approaches, such as LLM-as-a-Judge, have proven their effectiveness in addressing this but suffer from…

Artificial Intelligence · Computer Science 2026-05-11 Jinhao Jing , Qiannian Zhao , Chao Huang , Zhan Su