English
Related papers

Related papers: ODESteer: A Unified ODE-Based Steering Framework f…

200 papers

Steering has emerged as a practical approach to enable post-hoc guidance of LLMs towards enforcing a specific behavior. However, it remains largely underexplored for multimodal LLMs (MLLMs); furthermore, existing steering techniques, such…

Machine Learning · Computer Science 2025-11-04 Jayneel Parekh , Pegah Khayatan , Mustafa Shukor , Arnaud Dapogny , Alasdair Newson , Matthieu Cord

An unintended consequence of the vast pretraining of Large Language Models (LLMs) is the verbatim memorization of fragments of their training data, which may contain sensitive or copyrighted information. In recent years, unlearning has…

Computation and Language · Computer Science 2024-11-06 Atakan Seyitoğlu , Aleksei Kuvshinov , Leo Schwinn , Stephan Günnemann

Activation steering has emerged as a promising approach for efficiently adapting large language models (LLMs) to downstream behaviors. However, most existing steering methods rely on a single static direction per task or concept, making…

This paper investigates how Large Language Models (LLMs) represent non-English tokens -- a question that remains underexplored despite recent progress. We propose a lightweight intervention method using representation steering, where a…

Computation and Language · Computer Science 2025-08-27 Omar Mahmoud , Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana

Large language models (LLMs) have shown remarkable success in recent years, enabling a wide range of applications, including intelligent assistants that support users' daily life and work. A critical factor in building such assistants is…

Computation and Language · Computer Science 2025-10-28 Xiaoyan Zhao , Ming Yan , Yilun Qiu , Haoting Ni , Yang Zhang , Fuli Feng , Hong Cheng , Tat-Seng Chua

As LLMs are increasingly deployed in real-world applications, ensuring their ability to refuse malicious prompts, especially jailbreak attacks, is essential for safe and reliable use. Recently, activation steering has emerged as an…

Machine Learning · Computer Science 2026-02-10 Leheng Sheng , Changshuo Shen , Weixiang Zhao , Junfeng Fang , Xiaohao Liu , Zhenkai Liang , Xiang Wang , An Zhang , Tat-Seng Chua

Large Language Models (LLMs) achieve remarkable performance through pretraining on extensive data. This enables efficient adaptation to diverse downstream tasks. However, the lack of interpretability in their underlying mechanisms limits…

Computation and Language · Computer Science 2025-06-03 Xintong Wang , Jingheng Pan , Liang Ding , Longyue Wang , Longqin Jiang , Xingshan Li , Chris Biemann

The remarkable success of pretrain-then-finetune paradigm has led to a proliferation of available pre-trained models for vision tasks. This surge presents a significant challenge in efficiently choosing the most suitable pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zixuan Hu , Xiaotong Li , Shixiang Tang , Jun Liu , Yichun Hu , Ling-Yu Duan

Protein Language Models (PLMs), pre-trained on extensive evolutionary data from natural proteins, have emerged as indispensable tools for protein design. While powerful, PLMs often struggle to produce proteins with precisely specified…

Biomolecules · Quantitative Biology 2025-09-15 Long-Kai Huang , Rongyi Zhu , Bing He , Jianhua Yao

A key challenge in AI alignment is guiding large language models (LLMs) to follow desired behaviors at test time. Activation steering, which modifies internal model activations during inference, offers a potential solution. However, prior…

Machine Learning · Computer Science 2025-03-04 Reza Bayat , Ali Rahimi-Kalahroudi , Mohammad Pezeshki , Sarath Chandar , Pascal Vincent

Aligning pretrained audio encoders and Large Language Models (LLMs) offers a promising, parameter-efficient path to building powerful multimodal agents. However, existing methods often require costly full-model finetuning or rely on static…

Sound · Computer Science 2025-10-16 Ruitao Feng , Bixi Zhang , Sheng Liang , Zheng Yuan

Existing methods fail to effectively steer Large Language Models (LLMs) between textual reasoning and code generation, leaving symbolic computing capabilities underutilized. We introduce CodeSteer, an effective method for guiding LLM…

Computation and Language · Computer Science 2025-05-30 Yongchao Chen , Yilun Hao , Yueying Liu , Yang Zhang , Chuchu Fan

Activation steering is a promising technique for controlling LLM behavior by adding semantically meaningful vectors directly into a model's hidden states during inference. It is often framed as a precise, interpretable, and potentially…

Machine Learning · Computer Science 2026-02-17 Anton Korznikov , Andrey Galichin , Alexey Dontsov , Oleg Y. Rogov , Ivan Oseledets , Elena Tutubalina

Steering methods influence Large Language Model behavior by identifying semantic directions in hidden representations, but are typically realized through inference-time activation interventions that apply a fixed, global modification to the…

Computation and Language · Computer Science 2026-03-04 Chung-En Sun , Ge Yan , Zimo Wang , Tsui-Wei Weng

Inference-time steering offers a promising way to control language models (LMs) without retraining. However, standard approaches typically rely on activation addition, which inevitably alters the hidden-state magnitudes raising concerns…

Machine Learning · Computer Science 2026-05-19 Zejia You , Chunyuan Deng , Hanjie Chen

Activation steering is a popular white-box control technique that modifies model activations to elicit an abstract change in its behavior. It has also become a standard tool in interpretability (e.g., probing truthfulness, or translating…

Artificial Intelligence · Computer Science 2026-05-11 Aayush Mishra , Daniel Khashabi , Anqi Liu

Activation engineering enables precise control over Large Language Models (LLMs) without the computational cost of fine-tuning. However, existing methods deriving vectors from static activation differences are susceptible to…

Machine Learning · Computer Science 2026-03-16 Xinyan Jiang , Wenjing Yu , Di Wang , Lijie Hu

Masked diffusion language models (MDLMs) generate text via iterative masked-token denoising, enabling mask-parallel decoding and distinct controllability and efficiency tradeoffs from autoregressive LLMs. Yet, efficient representation-level…

Computation and Language · Computer Science 2026-03-31 Adi Shnaidman , Erin Feiglin , Osher Yaari , Efrat Mentel , Amit Levi , Raz Lapid

Activation-based steering enables Large Language Models (LLMs) to exhibit targeted behaviors by intervening on intermediate activations without retraining. Despite its widespread use, the mechanistic factors that govern when steering…

Computation and Language · Computer Science 2026-03-13 Mehdi Jafari , Hao Xue , Flora Salim

Controlling the behavior of Large Language Models (LLMs) remains a significant challenge due to their inherent complexity and opacity. While techniques like fine-tuning can modify model behavior, they typically require extensive…

Artificial Intelligence · Computer Science 2025-05-07 Yixiong Hao , Ayush Panda , Stepan Shabalin , Sheikh Abdur Raheem Ali