中文
相关论文

相关论文: SteeringSafety: A Systematic Safety Evaluation Fra…

200 篇论文

Large Language Models (LLMs) exhibit impressive performance across diverse domains but often suffer from overconfidence, limiting their reliability in critical applications. We propose SteerConf, a novel framework that systematically steers…

计算与语言 · 计算机科学 2025-05-27 Ziang Zhou , Tianyuan Jin , Jieming Shi , Qing Li

The ability to control LLMs' emulated emotional states and personality traits is essential for enabling rich, human-centered interactions in socially interactive settings. We introduce PsySET, a Psychologically-informed benchmark to…

We present a novel approach to bias mitigation in large language models (LLMs) by applying steering vectors to modify model activations in forward passes. We compute 8 steering vectors, each corresponding to a different social bias axis,…

机器学习 · 计算机科学 2026-03-31 Zara Siddique , Irtaza Khalid , Liam D. Turner , Luis Espinosa-Anke

While large language models (LLMs) have seen unprecedented advancements in capabilities and applications across a variety of use-cases, safety alignment of these models is still an area of active research. The fragile nature of LLMs, even…

计算与语言 · 计算机科学 2024-10-03 Amrita Bhattacharjee , Shaona Ghosh , Traian Rebedea , Christopher Parisien

Latent space steering methods provide a practical approach to controlling large language models by applying steering vectors to intermediate activations, guiding outputs toward desired behaviors while avoiding retraining. Despite their…

机器学习 · 计算机科学 2026-01-13 Shawn Im , Sharon Li

Steering has emerged as a practical approach to enable post-hoc guidance of LLMs towards enforcing a specific behavior. However, it remains largely underexplored for multimodal LLMs (MLLMs); furthermore, existing steering techniques, such…

机器学习 · 计算机科学 2025-11-04 Jayneel Parekh , Pegah Khayatan , Mustafa Shukor , Arnaud Dapogny , Alasdair Newson , Matthieu Cord

The rapid development of Multimodal Large Reasoning Models (MLRMs) has demonstrated broad application potential, yet their safety and reliability remain critical concerns that require systematic exploration. To address this gap, we conduct…

计算与语言 · 计算机科学 2025-10-14 Xinyue Lou , You Li , Jinan Xu , Xiangyu Shi , Chi Chen , Kaiyu Huang

Inference-time steering is widely regarded as a lightweight and parameter-free mechanism for controlling large language model (LLM) behavior, and prior work has often suggested that simple activation-level interventions can reliably induce…

人工智能 · 计算机科学 2026-03-20 Zikang Ding , Qiying Hu , Yi Zhang , Hongji Li , Junchi Yao , Hongbo Liu , Lijie Hu

Steering methods for language models (LMs) have gained traction as lightweight alternatives to fine-tuning, enabling targeted modifications to model activations. However, prior studies primarily report results on a few models, leaving…

计算与语言 · 计算机科学 2025-04-08 Patrick Queiroz Da Silva , Hari Sethuraman , Dheeraj Rajagopal , Hannaneh Hajishirzi , Sachin Kumar

As large language models (LLMs) become more integrated into societal systems, the risk of them perpetuating and amplifying harmful biases becomes a critical safety concern. Traditional methods for mitigating bias often rely on data…

人工智能 · 计算机科学 2025-08-13 Shivam Dubey

Large Vision-Language Models (LVLMs) exhibit outstanding performance on vision-language tasks but struggle with hallucination problems. Through in-depth analysis of LVLM activation patterns, we reveal two key findings: 1) truthfulness and…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Jianghao Yin , Qin Chen , Kedi Chen , Jie Zhou , Xingjiao Wu , Liang He

Safeguarding vision-language models (VLMs) is a critical challenge, as existing methods often suffer from over-defense, which harms utility, or rely on shallow alignment, failing to detect complex threats that require deep reasoning. To…

密码学与安全 · 计算机科学 2026-04-03 Nanxi Li , Zhengyue Zhao , G. Edward Suh , Marco Pavone , Chaowei Xiao

Representation engineering methods have recently shown promise for enabling efficient steering of model behavior. However, evaluation pipelines for these methods have primarily relied on subjective demonstrations, instead of quantitative,…

人工智能 · 计算机科学 2024-10-23 Itamar Pres , Laura Ruis , Ekdeep Singh Lubana , David Krueger

Activation steering has emerged as a powerful tool to shape LLM behavior without the need for weight updates. While its inherent brittleness and unreliability are well-documented, its safety implications remain underexplored. In this work,…

密码学与安全 · 计算机科学 2026-03-26 Yuxiao Li , Alina Fastowski , Efstratios Zaradoukas , Bardh Prenkaj , Gjergji Kasneci

Large language models (LLMs) are shown to be vulnerable to jailbreaking attacks where adversarial prompts are designed to elicit harmful responses. While existing defenses effectively mitigate single-turn attacks by detecting and filtering…

计算与语言 · 计算机科学 2026-02-17 Hanjiang Hu , Alexander Robey , Changliu Liu

Vision-language models (VLMs) are increasingly deployed in real-world and embodied settings where safety decisions depend on visual context. However, it remains unclear which visual evidence drives these judgments. We study whether…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Carlos Hinojosa , Clemens Grange , Bernard Ghanem

This paper presents a comprehensive empirical study on the safety alignment capabilities. We evaluate what matters for safety alignment in LLMs and LRMs to provide essential insights for developing more secure and reliable AI systems. We…

计算与语言 · 计算机科学 2026-02-25 Xing Li , Hui-Ling Zhen , Lihao Yin , Xianzhi Yu , Zhenhua Dong , Mingxuan Yuan

Large language models (LLMs) offer transformative potential for clinical decision support in spine surgery but pose significant risks through hallucinations, which are factually inconsistent or contextually misaligned outputs that may…

机器学习 · 计算机科学 2025-11-21 Dong Chen , Yanzhe Wei , Zonglin He , Guan-Ming Kuang , Canhua Ye , Meiru An , Huili Peng , Yong Hu , Huiren Tao , Kenneth MC Cheung

Having an LLM that aligns with human preferences is essential for accommodating individual needs, such as maintaining writing style or generating specific topics of interest. The majority of current alignment methods rely on fine-tuning or…

计算与语言 · 计算机科学 2025-03-06 Bingqing Song , Boran Han , Shuai Zhang , Hao Wang , Haoyang Fang , Bonan Min , Yuyang Wang , Mingyi Hong

Activation steering is a promising technique for controlling LLM behavior by adding semantically meaningful vectors directly into a model's hidden states during inference. It is often framed as a precise, interpretable, and potentially…

机器学习 · 计算机科学 2026-02-17 Anton Korznikov , Andrey Galichin , Alexey Dontsov , Oleg Y. Rogov , Ivan Oseledets , Elena Tutubalina
‹ 上一页 1 2 3 10 下一页 ›