中文
相关论文

相关论文: Faithful Bi-Directional Model Steering via Distrib…

200 篇论文

Activation steering has emerged as a powerful method for guiding the behavior of generative models towards desired outcomes such as toxicity mitigation. However, most existing methods apply interventions uniformly across all inputs,…

机器学习 · 计算机科学 2025-12-04 Alex Ferrando , Xavier Suau , Jordi Gonzàlez , Pau Rodriguez

Activation steering methods control large language model (LLM) behavior by modifying internal activations at inference time. However, most existing activation steering methods rely on a fixed steering strength, leading to either…

计算与语言 · 计算机科学 2025-10-16 Arthur Vogels , Benjamin Wong , Yann Choho , Annabelle Blangero , Milan Bhan

With the rapid advancement of large language models (LLMs), their deployment in real-world applications has become increasingly widespread. LLMs are expected to deliver robust performance across diverse tasks, user preferences, and…

计算与语言 · 计算机科学 2025-11-21 Wei Xia , Zhi-Hong Deng

Model steering, which involves intervening on hidden representations at inference time, has emerged as a lightweight alternative to finetuning for precisely controlling large language models. While steering efficacy has been widely studied,…

机器学习 · 计算机科学 2026-02-09 Navita Goyal , Hal Daumé

Haptic guidance in a shared steering assistance system has drawn significant attention in intelligent vehicle fields, owing to its mutual communication ability for vehicle control. By exerting continuous torque on the steering wheel, both…

机器人学 · 计算机科学 2020-11-17 Zhanhong Yan , Kaiming Yang , Zheng Wang , Bo Yang , Tsutomu Kaizuka , Kimihiko Nakano

Driver observation models are rarely deployed under perfect conditions. In practice, illumination, camera placement and type differ from the ones present during training and unforeseen behaviours may occur at any time. While observing the…

计算机视觉与模式识别 · 计算机科学 2022-04-12 Alina Roitberg , Kunyu Peng , David Schneider , Kailun Yang , Marios Koulakis , Manuel Martinez , Rainer Stiefelhagen

Having an LLM that aligns with human preferences is essential for accommodating individual needs, such as maintaining writing style or generating specific topics of interest. The majority of current alignment methods rely on fine-tuning or…

计算与语言 · 计算机科学 2025-03-06 Bingqing Song , Boran Han , Shuai Zhang , Hao Wang , Haoyang Fang , Bonan Min , Yuyang Wang , Mingyi Hong

Activation steering -- adding a vector to a model's residual stream to modify its behavior -- is widely used in safety evaluations as if the model cannot detect the intervention. We test this assumption, introducing steering awareness: a…

计算与语言 · 计算机科学 2026-03-20 Joshua Fonseca Rivera , David Demitri Africa

Model steering represents a powerful technique that dynamically aligns large language models (LLMs) with human preferences during inference. However, conventional model-steering methods rely heavily on externally annotated data, not only…

计算与语言 · 计算机科学 2025-07-15 Rongyi Zhu , Yuhui Wang , Tanqiu Jiang , Jiacheng Liang , Ting Wang

Many causal estimands are only partially identifiable since they depend on the unobservable joint distribution between potential outcomes. Stratification on pretreatment covariates can yield sharper bounds; however, unless the covariates…

计量经济学 · 经济学 2024-11-19 Wenlong Ji , Lihua Lei , Asher Spector

Steering intermediate representations has emerged as a powerful strategy for controlling generative models, particularly in post-deployment alignment and safety settings. However, despite its empirical success, it currently lacks a…

Steering vectors have emerged as a lightweight and effective approach for aligning large language models (LLMs) at inference time, enabling modulation over model behaviors by shifting LLM representations towards a target behavior. However,…

机器学习 · 计算机科学 2026-04-07 Soham Gadgil , Chris Lin , Su-In Lee

Autonomous driving in complex traffic requires reasoning under uncertainty. Common approaches rely on prediction-based planning or risk-aware control, but these are typically treated in isolation, limiting their ability to capture the…

机器人学 · 计算机科学 2026-03-17 Devodita Chakravarty , John Dolan , Yiwei Lyu

Explainable AI (XAI) methods reveal which features influence model predictions, yet provide limited means for practitioners to act on these explanations. Activation steering of components identified via XAI offers a path toward actionable…

人工智能 · 计算机科学 2026-05-27 Tobias Labarta , Maximilian Dreyer , Katharina Weitz , Wojciech Samek , Sebastian Lapuschkin

As the advanced driver assistance system (ADAS) functions become more sophisticated, the strategies that properly coordinate interaction and communication among the ADAS functions are required for autonomous driving. This paper proposes a…

机器人学 · 计算机科学 2021-09-14 Myungjae Shin , Joongheon Kim

Inference-time steering is widely regarded as a lightweight and parameter-free mechanism for controlling large language model (LLM) behavior, and prior work has often suggested that simple activation-level interventions can reliably induce…

人工智能 · 计算机科学 2026-03-20 Zikang Ding , Qiying Hu , Yi Zhang , Hongji Li , Junchi Yao , Hongbo Liu , Lijie Hu

We consider the problem of data-driven stochastic optimal control of an unknown LTI dynamical system. Assuming the process noise is normally distributed, we pose the problem of steering the state's mean and covariance to a target normal…

系统与控制 · 电气工程与系统科学 2026-02-09 Joshua Pilipovsky , Panagiotis Tsiotras

The question-answering (QA) capabilities of foundation models are highly sensitive to prompt variations, rendering their performance susceptible to superficial, non-meaning-altering changes. This vulnerability often stems from the model's…

机器学习 · 计算机科学 2024-06-07 Dyah Adila , Shuai Zhang , Boran Han , Yuyang Wang

Causal abstraction is a promising theoretical framework for explainable artificial intelligence that defines when an interpretable high-level causal model is a faithful simplification of a low-level deep learning system. However, existing…

人工智能 · 计算机科学 2024-02-23 Atticus Geiger , Zhengxuan Wu , Christopher Potts , Thomas Icard , Noah D. Goodman

Safe reinforcement learning has traditionally relied on predefined constraint functions to ensure safety in complex real-world tasks, such as autonomous driving. However, defining these functions accurately for varied tasks is a persistent…

机器学习 · 计算机科学 2025-01-31 Se-Wook Yoo , Seung-Woo Seo
‹ 上一页 1 2 3 10 下一页 ›