English
Related papers

Related papers: STEER: Inference-Time Risk Control via Constrained…

200 papers

Changing the behavior of large language models (LLMs) can be as straightforward as editing the Transformer's residual streams using appropriately constructed "steering vectors." These modifications to internal neural activations, a form of…

Computation and Language · Computer Science 2025-05-20 Jian-Qiao Zhu , Haijiang Yan , Thomas L. Griffiths

Instruction-following is a fundamental capability of language models, requiring the model to recognize even the most subtle requirements in the instructions and accurately reflect them in its output. Such an ability is well-suited for and…

Computation and Language · Computer Science 2025-03-18 Jiale Cheng , Xiao Liu , Cunxiang Wang , Xiaotao Gu , Yida Lu , Dan Zhang , Yuxiao Dong , Jie Tang , Hongning Wang , Minlie Huang

Large Language Models (LLMs) are powerful models for generation tasks, but they may not generate good quality outputs in their first attempt. Apart from model fine-tuning, existing approaches to improve prediction accuracy and quality…

Computation and Language · Computer Science 2024-11-05 Jason Cai , Hang Su , Monica Sunkara , Igor Shalyminov , Saab Mansour

Although large vision-language models (LVLMs) leverage rich visual token representations to achieve strong performance on multimodal tasks, these tokens also introduce significant computational overhead during inference. Existing…

Machine Learning · Computer Science 2025-05-20 Yichen Guo , Hanze Li , Zonghao Zhang , Jinhao You , Kai Tang , Xiande Huang

Large Language Models (LLMs), despite advances in instruction tuning, often fail to follow complex user instructions. Activation steering techniques aim to mitigate this by manipulating model internals, but have a potential risk of…

Machine Learning · Computer Science 2026-03-10 Minjae Kang , Jaehyung Kim

Conventional mechanical design follows an iterative process in which initial concepts are refined through cycles of expert assessment and resource-intensive Finite Element Method (FEM) analysis to meet performance goals. While machine…

Machine Learning · Computer Science 2025-05-02 Yayati Jadhav , Amir Barati Farimani

MLLMs are increasingly deployed in multi-turn settings, where attackers can escalate unsafe intent through the evolving visual-text history and exploit long-context safety decay. Yet safety alignment is still dominated by single-turn data…

Machine Learning · Computer Science 2026-05-28 Haolong Hu , Hanyu Li , Tiancheng He , Huahui Yi , An Zhang , Qiankun Li , Kun Wang , Yang Liu , Zhigang Zeng

Inference-time intervention (ITI) has emerged as a promising method for steering large language model (LLM) behavior in a particular direction (e.g., improving helpfulness) by intervening on token representations without costly updates to…

Computation and Language · Computer Science 2025-07-10 Duy Nguyen , Archiki Prasad , Elias Stengel-Eskin , Mohit Bansal

Self-Taught Reasoners (STaR), synonymously known as Rejection sampling Fine-Tuning (RFT), is an integral part of the training pipeline of self-improving reasoning Language Models (LMs). The self-improving mechanism often employs random…

Machine Learning · Computer Science 2025-10-07 Woosung Koh , Wonbeen Oh , Jaein Jang , MinHyung Lee , Hyeongjin Kim , Ah Yeon Kim , Joonkee Kim , Junghyun Lee , Taehyeon Kim , Se-Young Yun

Safety alignment is essential for the responsible deployment of large language models (LLMs). Yet, existing approaches often rely on heavyweight fine-tuning that is costly to update, audit, and maintain across model families. Full…

Cryptography and Security · Computer Science 2026-02-20 Sasha Behrouzi , Lichao Wu , Mohamadreza Rostami , Ahmad-Reza Sadeghi

As large language models (LLMs) are deployed globally, creating pluralistic systems that can accommodate the diverse preferences and values of users worldwide becomes essential. We introduce EVALUESTEER, a benchmark to measure LLMs' and…

Computation and Language · Computer Science 2025-10-13 Kshitish Ghate , Andy Liu , Devansh Jain , Taylor Sorensen , Atoosa Kasirzadeh , Aylin Caliskan , Mona T. Diab , Maarten Sap

Model steering represents a powerful technique that dynamically aligns large language models (LLMs) with human preferences during inference. However, conventional model-steering methods rely heavily on externally annotated data, not only…

Computation and Language · Computer Science 2025-07-15 Rongyi Zhu , Yuhui Wang , Tanqiu Jiang , Jiacheng Liang , Ting Wang

Controlling multiple behavioral attributes in large language models (LLMs) at inference time is a challenging problem due to interference between attributes and the limitations of linear steering methods, which assume additive behavior in…

Machine Learning · Computer Science 2026-04-07 Narmeen Oozeer , Luke Marks , Shreyans Jain , Fazl Barez , Amirali Abdullah

Activation-based control steers large language models (LLMs) by intervening on their internal representations during inference, and has emerged as an effective paradigm for controlling behaviors such as persona and style. However, existing…

Computation and Language · Computer Science 2026-05-29 Yingdong Shi , Ruiming Zhang , Changming Li , Zhiyu Yang , Kaixing Zhang , Jingyi Yu , Kan Ren

Large language models (LLMs) exhibit reasoning biases, often conflating content plausibility with formal logical validity. This can lead to wrong inferences in critical domains, where plausible arguments are incorrectly deemed logically…

Artificial Intelligence · Computer Science 2026-04-02 Marco Valentino , Geonhee Kim , Dhairya Dalal , Zhixue Zhao , André Freitas

Large Reasoning Models (LRMs) exhibit human-like cognitive reasoning strategies (e.g. backtracking, cross-verification) during reasoning process, which improves their performance on complex tasks. Currently, reasoning strategies are…

Artificial Intelligence · Computer Science 2026-01-08 Yi Fang , Wenjie Wang , Mingfeng Xue , Boyi Deng , Fengli Xu , Dayiheng Liu , Fuli Feng

Large Language Model (LLM) training is frequently interrupted by a heterogeneous spectrum of failures, from common GPU crashes to catastrophic cluster-wide outages. Existing checkpointing systems rely on monolithic, single-tier storage…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Shujie Han , Feng Jiang , Patrick P. C. Lee , Xiao Zhang , Zhijie Huang , Nannan Zhao , Xiaonan Zhao , Lichen Pan

Stochasticity in language model fine-tuning, often caused by the small batch sizes typically used in this regime, can destabilize training by introducing large oscillations in generation quality. A popular approach to mitigating this…

Machine Learning · Computer Science 2025-08-04 Adam Block , Cyril Zhang

Recent progress in large language models (LLMs) offers promising new approaches for recommendation system tasks. While the current state-of-the-art methods rely on fine-tuning LLMs to achieve optimal results, this process is costly and…

Information Retrieval · Computer Science 2025-02-21 Dong-Ho Lee , Adam Kraft , Long Jin , Nikhil Mehta , Taibai Xu , Lichan Hong , Ed H. Chi , Xinyang Yi

Frontier Large Language Models (LLMs) can be socially discriminatory or sensitive to spurious features of their inputs. Because only well-resourced corporations can train frontier LLMs, we need robust test-time strategies to control such…

Computation and Language · Computer Science 2024-10-08 Leonardo Cotta , Chris J. Maddison