中文
相关论文

相关论文: Path Drift in Large Reasoning Models:How First-Per…

200 篇论文

Multimodal Large Reasoning Models (MLRMs) demonstrate impressive cross-modal reasoning but often amplify safety risks under adversarial or unsafe prompts, a phenomenon we call the \textit{Reasoning Tax}. Existing defenses mainly act at the…

机器学习 · 计算机科学 2025-10-10 Huahui Yi , Kun Wang , Qiankun Li , Miao Yu , Liang Lin , Gongli Xi , Hao Wu , Xuming Hu , Kang Li , Yang Liu

Recent advances in large reasoning models (LRMs) have enabled remarkable performance on complex tasks such as mathematics and coding by generating long Chain-of-Thought (CoT) traces. In this paper, we identify and systematically analyze a…

人工智能 · 计算机科学 2025-10-21 Zhehao Zhang , Weijie Xu , Shixian Cui , Chandan K. Reddy

Recent Vision-Language-Action (VLA) models for autonomous driving explore inference-time reasoning as a way to improve driving performance and safety in challenging scenarios. Most prior work uses natural language to express…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Shuhan Tan , Kashyap Chitta , Yuxiao Chen , Ran Tian , Yurong You , Yan Wang , Wenjie Luo , Yulong Cao , Philipp Krahenbuhl , Marco Pavone , Boris Ivanovic

Large language models (LLMs) increasingly rely on Chain-of-Thought (CoT) prompting to improve problem-solving and provide seemingly transparent explanations. However, growing evidence shows that CoT often fail to faithfully represent the…

人工智能 · 计算机科学 2026-03-03 Xu Shen , Song Wang , Zhen Tan , Laura Yao , Xinyu Zhao , Kaidi Xu , Xin Wang , Tianlong Chen

Long chain-of-thought (CoT) supervision has become a common strategy to enhance reasoning in language models. While effective for large models, we identify a phenomenon we call Long CoT Degradation, in which small language models (SLMs;…

计算与语言 · 计算机科学 2025-10-02 Renjie Luo , Jiaxi Li , Chen Huang , Wei Lu

Large language models (LLMs) are being rapidly integrated into decision-support tools, automation workflows, and AI-enabled software systems. However, their behavior in production environments remains poorly understood, and their failure…

人工智能 · 计算机科学 2025-11-27 Vaishali Vinay

Large language models increasingly rely on explicit chain-of-thought reasoning to solve complex tasks, yet the safety of the reasoning process itself remains largely unaddressed. Existing work focuses predominantly on content safety (i.e.,…

人工智能 · 计算机科学 2026-05-07 Xunguang Wang , Yuguang Zhou , Qingyue Wang , Zongjie Li , Ruixuan Huang , Zhenlan Ji , Pingchuan Ma , Shuai Wang

Chain-of-Thought reasoning has emerged as a pivotal methodology for enhancing model inference capabilities. Despite growing interest in Chain-of-Thought reasoning, its underlying mechanisms remain unclear. This paper explores the working…

计算与语言 · 计算机科学 2025-09-03 Hao Yang , Zhiyu Yang , Yunjie Zhang , Shanyi Zhu , Lin Yang

Current LLM post-training methods optimize complete reasoning trajectories through Supervised Fine-Tuning (SFT) followed by outcome-based Reinforcement Learning (RL). While effective, a closer examination reveals a fundamental gap: this…

人工智能 · 计算机科学 2026-05-29 Shaojie Wang , Liang Zhang

Extended interaction with large language models (LLMs) has been linked to the reinforcement of delusional beliefs, a phenomenon attracting growing clinical and public concern. Yet most empirical work evaluates model safety in brief…

人机交互 · 计算机科学 2026-04-24 Luke Nicholls , Robert Hutto , Zephrah Soto , Hamilton Morrin , Thomas Pollak , Raj Korpan , Cheryl Carmichael

Chain-of-thought (CoT) reasoning enhances performance of large language models, but questions remain about whether these reasoning traces faithfully reflect the internal processes of the model. We present the first comprehensive study of…

计算与语言 · 计算机科学 2025-11-04 Sriram Balasubramanian , Samyadeep Basu , Soheil Feizi

Long-term interaction with LLM-based systems may produce alignment drift: a gradual process in which system outputs become less constrained by the user's current message and more shaped by prior interaction history, while still appearing…

人机交互 · 计算机科学 2026-05-19 Xintong Yao

We present a novel framework addressing a critical vulnerability in Large Language Models (LLMs): the prevalence of factual inaccuracies within intermediate reasoning steps despite correct final answers. This phenomenon poses substantial…

计算与语言 · 计算机科学 2025-08-05 Rui Jiao , Yue Zhang , Jinku Li

Large Language Models (LLMs) have demonstrated remarkable capabilities in performing tasks across various domains without needing explicit retraining. This capability, known as In-Context Learning (ICL), while impressive, exposes LLMs to a…

计算与语言 · 计算机科学 2024-10-16 Bibek Upadhayay , Vahid Behzadan , Amin Karbasi

Latent or continuous chain-of-thought methods replace explicit textual rationales with a number of internal latent steps, but these intermediate computations are difficult to evaluate beyond correlation-based probes. In this paper, we view…

人工智能 · 计算机科学 2026-05-29 Zirui Li , Xuefeng Bai , Kehai Chen , Yizhi Li , Jian Yang , Chenghua Lin , Min Zhang

Chain-of-Thought (CoT) reasoning has significantly advanced Large Language Models (LLMs) in solving complex tasks. However, its autoregressive paradigm leads to significant computational overhead, hindering its deployment in…

计算与语言 · 计算机科学 2025-08-29 Nan Jiang , Ziming Wu , De-Chuan Zhan , Fuming Lai , Shaobing Lian

Recent advances in reasoning with large language models (LLMs) have popularized Long Chain-of-Thought (LCoT), a strategy that encourages deliberate and step-by-step reasoning before producing a final answer. While LCoTs have enabled…

人工智能 · 计算机科学 2025-05-29 Gangwei Jiang , Yahui Liu , Zhaoyi Li , Qi Wang , Fuzheng Zhang , Linqi Song , Ying Wei , Defu Lian

Central to many self-improvement pipelines for large language models (LLMs) is the assumption that models can improve by reflecting on past mistakes. We study a phenomenon termed contextual drag: the presence of failed attempts in the…

计算与语言 · 计算机科学 2026-03-04 Yun Cheng , Xingyu Zhu , Haoyu Zhao , Sanjeev Arora

Personalized alignment is crucial for enabling Large Language Models (LLMs) to engage effectively in user-centric interactions. However, current methods face a dual challenge: they fail to infer users' deep implicit preferences (including…

人工智能 · 计算机科学 2026-04-29 Peiming Li , Zhiyuan Hu , Yang Tang , Shiyu Li , Xi Chen

Large reasoning models (LRMs) achieve strong performance on complex reasoning tasks but often generate harmful responses to malicious user queries. This paper investigates the underlying cause of these safety risks and shows that the issue…

人工智能 · 计算机科学 2026-04-22 Yeonjun In , Wonjoong Kim , Sangwu Park , Chanyoung Park