中文
相关论文

相关论文: FaithSteer-BENCH: A Deployment-Aligned Stress-Test…

200 篇论文

Large Language Models (LLMs) trained for average correctness often exhibit mode collapse, producing narrow decision behaviors on tasks where multiple responses may be reasonable. This limitation is particularly problematic in ordinal…

人工智能 · 计算机科学 2026-02-04 Eric Yang , Jong Ha Lee , Jonathan Amar , Elissa Ye , Yugang Jia

Large Language Models (LLMs) often rely on long chain-of-thought (CoT) reasoning to solve complex tasks. While effective, these trajectories are frequently inefficient, leading to high latency from excessive token generation, or unstable…

We introduce Refusal Steering, an inference-time method to exercise fine-grained control over Large Language Models refusal behaviour on politically sensitive topics without retraining. We replace fragile pattern-based refusal detection…

计算与语言 · 计算机科学 2026-02-25 Iker García-Ferrero , David Montero , Roman Orus

Disasters cause severe societal impacts, demanding rapid coordination of heterogeneous AI tools, from satellite analysis to flood prediction and damage assessment, into coherent multi-step workflows. As LLMs increasingly serve as…

Existing studies on bias mitigation methods for large language models (LLMs) use diverse baselines and metrics to evaluate debiasing performance, leading to inconsistent comparisons among them. Moreover, their evaluations are mostly based…

计算与语言 · 计算机科学 2026-02-17 Xin Xu , Xunzhi He , Churan Zhi , Ruizhe Chen , Julian McAuley , Zexue He

Despite impressive advances in large language models (LLMs), existing benchmarks often focus on single-turn or single-step tasks, failing to capture the kind of iterative reasoning required in real-world settings. To address this…

计算与语言 · 计算机科学 2025-11-26 Yiran Zhang , Mo Wang , Xiaoyang Li , Kaixuan Ren , Chencheng Zhu , Usman Naseem

Steering methods influence Large Language Model behavior by identifying semantic directions in hidden representations, but are typically realized through inference-time activation interventions that apply a fixed, global modification to the…

计算与语言 · 计算机科学 2026-03-04 Chung-En Sun , Ge Yan , Zimo Wang , Tsui-Wei Weng

How should one judge whether a given large language model (LLM) can reliably perform economic reasoning? Most existing LLM benchmarks focus on specific applications and fail to present the model with a rich variety of economic tasks. A…

计算与语言 · 计算机科学 2025-02-20 Narun Raman , Taylor Lundy , Thiago Amin , Jesse Perla , Kevin Leyton-Brown

Large language models (LLMs) are now ubiquitous in everyday tools, raising urgent safety concerns about their tendency to generate harmful content. The dominant safety approach -- reinforcement learning from human feedback (RLHF) --…

机器学习 · 计算机科学 2025-09-29 Sathwik Karnik , Somil Bansal

Hybrid-reasoning large language models (LLMs) expose explicit controls over reasoning effort, allowing users or systems to trade off answer quality against inference cost. However, existing methods for adaptive thinking-mode selection are…

人工智能 · 计算机科学 2026-05-28 Yansong Ning , Mianpeng Liu , Jingwen Ye , Weidong Zhang , Hao Liu

Large language models (LLMs) can sometimes detect when they are being evaluated and adjust their behavior to appear more aligned, compromising the reliability of safety evaluations. In this paper, we show that adding a steering vector to an…

计算与语言 · 计算机科学 2026-03-03 Tim Tian Hua , Andrew Qin , Samuel Marks , Neel Nanda

Controlling the behavior of large language models (LLMs) at inference time is essential for aligning outputs with human abilities and safety requirements. \emph{Activation steering} provides a lightweight alternative to prompt engineering…

人工智能 · 计算机科学 2026-01-30 Diaoulé Diallo , Katharina Dworatzyk , Sophie Jentzsch , Peer Schütt , Sabine Theis , Tobias Hecking

Static benchmarks for LLMs are increasingly compromised by contamination and overfitting especially on knowledge intensive reasoning tasks While recent dynamic benchmarks can alleviate staleness they often increase difficulty at the expense…

计算与语言 · 计算机科学 2026-05-05 Yongrui Chen , Yangyang Ma , Xiaoying Huang , Shenyu Zhang , Huajun Chen , Haofen Wang , Guilin Qi

Large language model (LLM)-based agents increasingly rely on tool use to complete real-world tasks. While existing works evaluate the LLMs' tool use capability, they largely focus on the final answers yet overlook the detailed tool usage…

Large language models (LLMs) have achieved remarkable performance across many generation tasks. Nevertheless, effectively aligning them with desired behaviors remains a significant challenge. Activation steering is an effective and…

计算与语言 · 计算机科学 2025-10-02 Zifeng Cheng , Jinwei Gan , Zhiwei Jiang , Cong Wang , Yafeng Yin , Xiang Luo , Yuchen Fu , Qing Gu

Large Language Models (LLMs) are increasingly excelling and outpacing human performance on many tasks. However, to improve LLM reasoning, researchers either rely on ad-hoc generated datasets or formal mathematical proof systems such as the…

人工智能 · 计算机科学 2025-11-03 Nikolaus Holzer , William Fishell , Baishakhi Ray , Mark Santolucito

Large language models (LLMs) are increasingly applied in diverse real-world scenarios, each governed by bespoke behavioral and safety specifications (spec) custom-tailored by users or organizations. These spec, categorized into safety-spec…

计算与语言 · 计算机科学 2025-10-07 Haoran Zhang , Yafu Li , Xuyang Hu , Dongrui Liu , Zhilin Wang , Bo Li , Yu Cheng

Large Language Models (LLMs) encode vast amounts of parametric knowledge during pre-training. As world knowledge evolves, effective deployment increasingly depends on their ability to faithfully follow externally retrieved context. When…

计算与语言 · 计算机科学 2026-01-13 Nikhil Anand , Shwetha Somasundaram , Anirudh Phukan , Apoorv Saxena , Koyel Mukherjee

Reasoning is central to a wide range of intellectual activities, and while the capabilities of large language models (LLMs) continue to advance, their performance in reasoning tasks remains limited. The processes and mechanisms underlying…

人工智能 · 计算机科学 2024-10-07 Ippei Fujisawa , Sensho Nobe , Hiroki Seto , Rina Onda , Yoshiaki Uchida , Hiroki Ikoma , Pei-Chun Chien , Ryota Kanai

Steering, or direct manipulation of internal activations to guide LLM responses toward specific semantic concepts, is emerging as a promising avenue for both understanding how semantic concepts are stored within LLMs and advancing LLM…

机器学习 · 计算机科学 2026-02-03 Parmida Davarmanesh , Ashia Wilson , Adityanarayanan Radhakrishnan