中文
相关论文

相关论文: What Can We Actually Steer? A Multi-Behavior Study…

200 篇论文

As Vision Language Models (VLMs) are deployed across safety-critical applications, understanding and controlling their behavioral patterns has become increasingly important. Existing behavioral control methods face significant limitations:…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Ravikumar Balakrishnan , Mansi Phute

Large language models (LLMs) exhibit reasoning biases, often conflating content plausibility with formal logical validity. This can lead to wrong inferences in critical domains, where plausible arguments are incorrectly deemed logically…

人工智能 · 计算机科学 2026-04-02 Marco Valentino , Geonhee Kim , Dhairya Dalal , Zhixue Zhao , André Freitas

Large language models (LLMs) have shown impressive abilities in leveraging pretrained knowledge through prompting, but they often struggle with unseen tasks, particularly in data-scarce scenarios. While cross-task in-context learning offers…

计算与语言 · 计算机科学 2025-07-18 Xinyu Tang , Zhihao Lv , Xiaoxue Cheng , Junyi Li , Wayne Xin Zhao , Zujie Wen , Zhiqiang Zhang , Jun Zhou

Latent space steering methods provide a practical approach to controlling large language models by applying steering vectors to intermediate activations, guiding outputs toward desired behaviors while avoiding retraining. Despite their…

机器学习 · 计算机科学 2026-01-13 Shawn Im , Sharon Li

Large language models (LLMs) are now used in multi-turn workflows, but we still lack a clear way to measure when iteration helps and when it hurts. We present an evaluation framework for iterative refinement that spans ideation, code, and…

人工智能 · 计算机科学 2025-09-16 Shashidhar Reddy Javaji , Bhavul Gauri , Zining Zhu

Inference-time intervention (ITI) has emerged as a promising method for steering large language model (LLM) behavior in a particular direction (e.g., improving helpfulness) by intervening on token representations without costly updates to…

计算与语言 · 计算机科学 2025-07-10 Duy Nguyen , Archiki Prasad , Elias Stengel-Eskin , Mohit Bansal

While large language models (LLMs) have seen unprecedented advancements in capabilities and applications across a variety of use-cases, safety alignment of these models is still an area of active research. The fragile nature of LLMs, even…

计算与语言 · 计算机科学 2024-10-03 Amrita Bhattacharjee , Shaona Ghosh , Traian Rebedea , Christopher Parisien

Activation steering methods in large language models (LLMs) have emerged as an effective way to perform targeted updates to enhance generated language without requiring large amounts of adaptation data. We ask whether the features…

The increasing capabilities of large generative models and their ever more widespread deployment have raised concerns about their reliability, safety, and potential misuse. To address these issues, recent works have proposed to control…

机器学习 · 计算机科学 2024-11-25 Pau Rodriguez , Arno Blaas , Michal Klein , Luca Zappella , Nicholas Apostoloff , Marco Cuturi , Xavier Suau

Personality traits have long been studied as predictors of human behavior. Recent advances in Large Language Models (LLMs) suggest similar patterns may emerge in artificial systems, with advanced LLMs displaying consistent behavioral…

Adapting models to a language that was only partially present in the pre-training data requires fine-tuning, which is expensive in terms of both data and computational resources. As an alternative to fine-tuning, we explore the potential of…

计算与语言 · 计算机科学 2024-11-28 Daniel Scalena , Elisabetta Fersini , Malvina Nissim

Emotion plays an important role in human cognition and performance. Motivated by this, we investigate whether analogous emotional signals can shape the behavior of large language models (LLMs) and agents. Existing emotion-aware studies…

人工智能 · 计算机科学 2026-04-02 Moran Sun , Tianlin Li , Yuwei Zheng , Zhenhong Zhou , Aishan Liu , Xianglong Liu , Yang Liu

Large Language Models (LLMs) are increasingly deployed in high-stakes decision-making contexts. While prior work has shown that LLMs exhibit cognitive biases behaviorally, whether these biases correspond to identifiable internal…

人工智能 · 计算机科学 2026-04-03 Fan Huang , Songheng Zhang , Haewoon Kwak , Jisun An

To ensure AI safety, instruction-tuned Large Language Models (LLMs) are specifically trained to ensure alignment, which refers to making models behave in accordance with human intentions. While these models have demonstrated commendable…

密码学与安全 · 计算机科学 2024-08-19 Haoran Wang , Kai Shu

Feature steering has emerged as a promising approach for controlling LLM behavior through direct manipulation of internal representations, offering advantages over prompt engineering. However, its practical effectiveness in real-world…

In recent years, large language models (LLMs) have been extensively utilized for behavioral modeling, for example, to automatically generate sequence diagrams. However, no overview of this work has been published yet. Such an overview will…

软件工程 · 计算机科学 2025-09-30 Muhammad Laiq

Large Language Models (LLMs) have demonstrated great potential in Conversational Recommender Systems (CRS). However, the application of LLMs to CRS has exposed a notable discrepancy in behavior between LLM-based CRS and human recommenders:…

信息检索 · 计算机科学 2024-10-21 Dayu Yang , Fumian Chen , Hui Fang

Precise control over language model generation is vital for ensuring both safety and reliability. Although prompt engineering and steering are commonly used to intervene in model behaviors, the vast number of parameters in models often…

计算与语言 · 计算机科学 2025-06-04 Mengru Wang , Ziwen Xu , Shengyu Mao , Shumin Deng , Zhaopeng Tu , Huajun Chen , Ningyu Zhang

Activation steering offers a computationally efficient mechanism for controlling Large Language Models (LLMs) without fine-tuning. While effectively controlling target traits (e.g., persona), coherency degradation remains a major obstacle…

计算与语言 · 计算机科学 2026-05-29 Yoshihiro Izawa , Gouki Minegishi , Koshi Eguchi , Sosuke Hosokawa , Kenjiro Taura

Large language models exhibit strong multilingual capabilities, yet significant performance gaps persist between dominant and non-dominant languages. Prior work attributes this gap to imbalances between shared and language-specific neurons…

计算与语言 · 计算机科学 2026-01-26 Rhitabrat Pokharel , Ameeta Agrawal , Tanay Nagar