English
Related papers

Related papers: Steering Risk Preferences in Large Language Models…

200 papers

When large language models (LLMs) are asked to perform certain tasks, how can we be sure that their learned representations align with reality? We propose a domain-agnostic framework for systematically evaluating distribution shifts in LLMs…

Computation and Language · Computer Science 2024-10-01 Tanush Chopra , Michael Li , Jacob Haimes

Strategic planning is critical for multi-step reasoning, yet compact Large Language Models (LLMs) often lack the capacity to formulate global strategies, leading to error propagation in long-horizon tasks. Our analysis reveals that LLMs…

Computation and Language · Computer Science 2026-04-15 Haoyu Zheng , Yun Zhu , Yuqian Yuan , Bo Yuan , Wenqiao Zhang , Siliang Tang , Jun Xiao

Recent work has demonstrated the potential of contrastive steering for jailbreaking Large Language Models (LLMs). However, existing methods rely on limited and inherently biased contrastive prompts and require laborious manual tuning of…

Cryptography and Security · Computer Science 2026-05-21 Junxi Chen , Junhao Dong , Xiaohua Xie

Driven by the demand for personalized AI systems, there is growing interest in aligning the behavior of large language models (LLMs) with human traits such as personality. Previous attempts to induce personality in LLMs have shown promising…

Computation and Language · Computer Science 2025-09-25 Seungjong Sun , Seo Yeon Baek , Jang Hyun Kim

Large language models (LLMs) are increasingly used in statistical research and applications. However,they are also notorious for unreliable or biased information. Here, we explore whether LLMs can be used to improve the precision of…

Applications · Statistics 2026-05-29 Jaylin Lowe , Adam Sales , Johann A. Gagnon-Bartsch

Inference-time intervention (ITI) has emerged as a promising method for steering large language model (LLM) behavior in a particular direction (e.g., improving helpfulness) by intervening on token representations without costly updates to…

Computation and Language · Computer Science 2025-07-10 Duy Nguyen , Archiki Prasad , Elias Stengel-Eskin , Mohit Bansal

Pretrained large language models (LLMs) can work as high-level robotic planners by reasoning over abstract task descriptions and natural language instructions, etc. However, they have shown a lack of knowledge and effectiveness in planning…

Robotics · Computer Science 2025-09-30 Wanming Yu , Adrian Röfer , Abhinav Valada , Sethu Vijayakumar

In modern financial markets, investors increasingly seek personalized and adaptive portfolio strategies that reflect their individual risk preferences and respond to dynamic market conditions. Traditional rule-based or static optimization…

Machine Learning · Computer Science 2025-12-16 Bangyu Li , Boping Gu , Ziyang Ding

The rapid development of large language models (LLMs) has not only provided numerous opportunities but also presented significant challenges. This becomes particularly evident when LLMs inadvertently generate harmful or toxic content,…

Computation and Language · Computer Science 2024-02-20 Kai Chen , Chunwei Wang , Kuo Yang , Jianhua Han , Lanqing Hong , Fei Mi , Hang Xu , Zhengying Liu , Wenyong Huang , Zhenguo Li , Dit-Yan Yeung , Lifeng Shang , Xin Jiang , Qun Liu

A key challenge in transportation planning is that the collective preferences of heterogeneous travelers often diverge from the policies produced by model-driven decision tools. This misalignment frequently results in implementation delays…

Computers and Society · Computer Science 2025-10-29 Xiaoyu Yan , Tianxing Dai , Yu Marco Nie

Model editing aims at selectively updating a small subset of a neural model's parameters with an interpretable strategy to achieve desired modifications. It can significantly reduce computational costs to adapt to large language models…

Computation and Language · Computer Science 2025-03-20 Shichen Li , Zhongqing Wang , Zheyu Zhao , Yue Zhang , Peifeng Li

This paper investigates how large language models (LLMs) behave when faced with discrepancies between their parametric knowledge and conflicting information contained in a prompt. Building on prior question-answering (QA) research, we…

Computation and Language · Computer Science 2025-10-23 Jaesung Bae , Cameron Churchwell , Mitchell Hermon , Tsun-An Hsieh , Jocelyn Xu , Yekaterina Yegorova , Mark Hasegawa-Johnson , Heng Ji

Large Language Models (LLMs) are increasingly deployed in high-stakes decision-making contexts. While prior work has shown that LLMs exhibit cognitive biases behaviorally, whether these biases correspond to identifiable internal…

Artificial Intelligence · Computer Science 2026-04-03 Fan Huang , Songheng Zhang , Haewoon Kwak , Jisun An

A central goal of cognitive modeling is to develop models that not only predict human behavior but also provide insight into the underlying cognitive mechanisms. While neural network models trained on large-scale behavioral data often…

Artificial Intelligence · Computer Science 2026-02-03 Jian-Qiao Zhu , Hanbo Xie , Dilip Arumugam , Robert C. Wilson , Thomas L. Griffiths

Model steering represents a powerful technique that dynamically aligns large language models (LLMs) with human preferences during inference. However, conventional model-steering methods rely heavily on externally annotated data, not only…

Computation and Language · Computer Science 2025-07-15 Rongyi Zhu , Yuhui Wang , Tanqiu Jiang , Jiacheng Liang , Ting Wang

Aligning Large Language Models (LLMs) with specific personas typically relies on expensive and monolithic Supervised Fine-Tuning (SFT) or RLHF. While effective, these methods require training distinct models for every target personality…

Computation and Language · Computer Science 2026-03-05 Florian Hoppe , David Khachaturov , Robert Mullins , Mark Huasong Meng

The field of large language models (LLMs) has grown rapidly in recent years, driven by the desire for better efficiency, interpretability, and safe use. Building on the novel approach of "activation engineering," this study explores…

Computation and Language · Computer Science 2025-08-26 Rumi Allbert , James K. Wiles , Vlad Grankovsky

Language models often exhibit undesirable behavior, e.g., generating toxic or gender-biased text. In the case of neural language models, an encoding of the undesirable behavior is often present in the model's representations. Thus, one…

Machine Learning · Computer Science 2025-06-05 Shashwat Singh , Shauli Ravfogel , Jonathan Herzig , Roee Aharoni , Ryan Cotterell , Ponnurangam Kumaraguru

Travel choice analysis is crucial for understanding individual travel behavior to develop appropriate transport policies and recommendation systems in Intelligent Transportation Systems (ITS). Despite extensive research, this domain faces…

Artificial Intelligence · Computer Science 2024-06-25 Xuehao Zhai , Hanlin Tian , Lintong Li , Tianyu Zhao

Large Language Models (LLMs) exhibit impressive performance across diverse domains but often suffer from overconfidence, limiting their reliability in critical applications. We propose SteerConf, a novel framework that systematically steers…

Computation and Language · Computer Science 2025-05-27 Ziang Zhou , Tianyuan Jin , Jieming Shi , Qing Li