中文
相关论文

相关论文: CyclicReflex: Improving Reasoning Models via Cycli…

200 篇论文

Reinforcement learning-based retrieval-augmented generation (RAG) methods enhance the reasoning abilities of large language models (LLMs). However, most rely only on final-answer rewards, overlooking intermediate reasoning quality. This…

计算与语言 · 计算机科学 2025-08-07 Jie He , Victor Gutiérrez-Basulto , Jeff Z. Pan

Large reasoning models (LRMs) excel on complex problems but face a critical barrier to efficiency: reinforcement learning (RL) training requires long rollouts for outcome-based rewards, where autoregressive decoding dominates time and…

机器学习 · 计算机科学 2026-02-20 Zeliang Zhang , Xiaodong Liu , Hao Cheng , Hao Sun , Chenliang Xu , Jianfeng Gao

Large language models (LLMs) can achieve strong reasoning performance with sufficient computation, but they do not inherently know how much computation a task requires. We study budgeted inference-time reasoning for multiple tasks under a…

人工智能 · 计算机科学 2026-01-08 Muyang Zhao , Qi Qi , Hao Sun

Large Reasoning Models (LRMs) demonstrate remarkable capabilities on complex tasks, exhibiting emergent, human-like thinking patterns. Despite their advances, we identify a fundamental limitation: current LRMs lack a dedicated meta-level…

人工智能 · 计算机科学 2025-08-26 Haonan Dong , Haoran Ye , Wenhao Zhu , Kehan Jiang , Guojie Song

Large Reasoning Models (LRMs) have demonstrated impressive capabilities but suffer from cognitive inefficiencies like "overthinking" simple problems and "underthinking" complex ones. While existing methods that use supervised fine-tuning…

人工智能 · 计算机科学 2026-03-24 Tian Liang , Wenxiang Jiao , Zhiwei He , Jiahao Xu , Haitao Mi , Dong Yu

Large reasoning models (LRMs) have recently demonstrated impressive capabilities in complex reasoning tasks by leveraging increased test-time computation and exhibiting behaviors reminiscent of human-like self-reflection. While LRMs show a…

计算与语言 · 计算机科学 2025-10-21 Qingcheng Zeng , Weihao Xuan , Leyang Cui , Rob Voigt

Human cognition operates through two complementary modes: fast intuitive thinking and slow deliberate thinking. Vanilla large language models (LLMs) predominantly follow the fast-thinking paradigm, producing immediate responses; while…

人工智能 · 计算机科学 2026-01-07 Shengjia Zhang , Junjie Wu , Jiawei Chen , Changwang Zhang , Zhe Li , Xingyu Lou , Wangchunshu Zhou , Sheng Zhou , Can Wang , Jun Wang

Recent advances leverage post-training to enhance model reasoning performance, which typically requires costly training pipelines and still suffers from inefficient, overly lengthy outputs. We introduce Speculative Thinking, a training-free…

计算与语言 · 计算机科学 2025-04-18 Wang Yang , Xiang Yue , Vipin Chaudhary , Xiaotian Han

Humans do not just find mistakes after the fact -- we often catch them mid-stream because 'reflection' is tied to the goal and its constraints. Today's large language models produce reasoning tokens and 'reflective' text, but is it…

人工智能 · 计算机科学 2025-10-24 Sion Weatherhead , Flora Salim , Aaron Belbasis

Reasoning Large Language Models (LLMs) enable test-time scaling, with dataset-level accuracy improving as the token budget increases, motivating adaptive reasoning -- spending tokens when they improve reliability and stopping early when…

Large reasoning models (LRMs) like OpenAI o1 and DeepSeek R1 have demonstrated impressive performance on complex reasoning tasks like mathematics and programming with long Chain-of-Thought (CoT) reasoning sequences (slow-thinking), compared…

人工智能 · 计算机科学 2025-07-15 Jason Zhu , Hongyu Li

Large Reasoning Models (LRMs) demonstrate strong performance on complex tasks but often suffer from excessive verbosity, known as "overthinking." Existing solutions via reinforcement learning (RL) typically penalize generated tokens to…

计算与语言 · 计算机科学 2025-12-02 Canhui Wu , Qiong Cao , Chang Li , Zhenfang Wang , Chao Xue , Yuwei Fan , Wei Xi , Xiaodong He

Eliciting explicit, step-by-step reasoning traces from large language models (LLMs) has emerged as a dominant paradigm for enhancing model capabilities. Although such reasoning strategies were originally designed for problems requiring…

计算与语言 · 计算机科学 2026-03-23 Xinyu Guo , Yazhou Zhang , Jing Qin

Human reasoning is shaped by resource rationality -- optimizing performance under constraints. Recently, inference-time scaling has emerged as a powerful paradigm to improve the reasoning performance of Large Language Models by expanding…

计算与语言 · 计算机科学 2026-02-12 Zhimin Hu , Riya Roshan , Sashank Varma

Large reasoning models (LRMs) have demonstrated impressive capabilities in complex problem-solving, yet their internal reasoning mechanisms remain poorly understood. In this paper, we investigate the reasoning trajectories of LRMs from an…

人工智能 · 计算机科学 2025-06-05 Chen Qian , Dongrui Liu , Haochen Wen , Zhen Bai , Yong Liu , Jing Shao

Large reasoning models (LRMs) often consume excessive tokens, inflating computational cost and latency. More broadly, in goal reaching sequential decision problems we often want to reach the goal quickly, and LRM reasoning can be viewed…

机器学习 · 计算机科学 2026-05-27 Alex Ayoub , Kavosh Asadi , Dale Schuurmans , Csaba Szepesvári , Karim Bouyarmane

Recently, Large Reasoning Models (LRMs) have gradually become a research hotspot due to their outstanding performance in handling complex tasks. Among them, DeepSeek R1 has garnered significant attention for its exceptional performance and…

人工智能 · 计算机科学 2025-08-05 Linan Yue , Yichao Du , Yizhi Wang , Weibo Gao , Fangzhou Yao , Li Wang , Ye Liu , Ziyu Xu , Qi Liu , Shimin Di , Min-Ling Zhang

This paper explores the system 1 thinking capability of Large Reasoning Models (LRMs), the intuitive ability to respond efficiently with minimal token usage. While existing LRMs rely on long-chain reasoning and excel at complex tasks, their…

计算与语言 · 计算机科学 2026-05-04 Wenyuan Zhang , Shuaiyi Nie , Xinghua Zhang , Zefeng Zhang , Tingwen Liu

Large Reasoning Models (LRMs) have recently shown impressive performance on complex reasoning tasks, often by engaging in self-reflective behaviors such as self-critique and backtracking. However, not all reflections are beneficial-many are…

人工智能 · 计算机科学 2026-01-21 Hanbin Wang , Jingwei Song , Jinpeng Li , Qi Zhu , Fei Mi , Ganqu Cui , Yasheng Wang , Lifeng Shang

Recent advancements in Large Language Models (LLMs) have leveraged increased test-time computation to enhance reasoning capabilities, a strategy that, while effective, incurs significant latency and resource costs, limiting their…

机器学习 · 计算机科学 2025-09-01 Hao Wen , Xinrui Wu , Yi Sun , Feifei Zhang , Liye Chen , Jie Wang , Yunxin Liu , Yunhao Liu , Ya-Qin Zhang , Yuanchun Li