English
Related papers

Related papers: VeriThinker: Learning to Verify Makes Reasoning Mo…

200 papers

Recent studies have shown that long chain-of-thought (CoT) reasoning can significantly enhance the performance of large language models (LLMs) on complex tasks. However, this benefit is yet to be demonstrated in the domain of video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yuanxin Liu , Kun Ouyang , Haoning Wu , Yi Liu , Lin Sui , Xinhao Li , Yan Zhong , Y. Charles , Xinyu Zhou , Xu Sun

Recent advancements in reasoning with large language models (RLLMs), such as OpenAI-O1 and DeepSeek-R1, have demonstrated their impressive capabilities in complex domains like mathematics and coding. A central factor in their success lies…

Artificial Intelligence · Computer Science 2025-07-21 Qiguang Chen , Libo Qin , Jinhao Liu , Dengyun Peng , Jiannan Guan , Peng Wang , Mengkang Hu , Yuhang Zhou , Te Gao , Wanxiang Che

Large reasoning models (LRMs) increasingly rely on step-by-step Chain-of-Thought (CoT) reasoning to improve task performance, particularly in high-resource languages such as English. While recent work has examined final-answer accuracy in…

Computation and Language · Computer Science 2025-10-13 Raoyuan Zhao , Yihong Liu , Hinrich Schütze , Michael A. Hedderich

Large Reasoning Models (LRMs) have achieved remarkable success on reasoning-intensive tasks such as mathematics and programming. However, their enhanced reasoning capabilities do not necessarily translate to improved safety performance-and…

Computation and Language · Computer Science 2026-04-21 Zhexin Zhang , Xian Qi Loye , Victor Shea-Jay Huang , Junxiao Yang , Qi Zhu , Shiyao Cui , Fei Mi , Lifeng Shang , Yingkang Wang , Hongning Wang , Minlie Huang

Reasoning models have demonstrated impressive performance on difficult tasks that traditional language models struggle at. However, many are plagued with the problem of overthinking--generating large amounts of unnecessary tokens which…

Computation and Language · Computer Science 2025-04-21 Xiao Pu , Michael Saxon , Wenyue Hua , William Yang Wang

O1/R1 style large reasoning models (LRMs) signal a substantial leap forward over conventional instruction-following LLMs. By applying test-time scaling to generate extended reasoning paths, they establish many SOTAs across a wide range of…

Artificial Intelligence · Computer Science 2025-09-09 Wei Han , Geng Zhan , Sicheng Yu , Chenyu Wang , Bryan Hooi

Large reasoning models (LRMs), such as OpenAI o1 and DeepSeek-R1, have significantly enhanced their reasoning capabilities by generating longer chains of thought, demonstrating outstanding performance across a variety of tasks. However,…

Computation and Language · Computer Science 2025-10-31 Haoran Zhao , Yuchen Yan , Yongliang Shen , Haolei Xu , Wenqi Zhang , Kaitao Song , Jian Shao , Weiming Lu , Jun Xiao , Yueting Zhuang

Chain-of-Thought (CoT) has become a vital technique for enhancing the performance of Large Language Models (LLMs), attracting increasing attention from researchers. One stream of approaches focuses on the iterative enhancement of LLMs by…

Computation and Language · Computer Science 2024-10-08 Yongheng Zhang , Qiguang Chen , Jingxuan Zhou , Peng Wang , Jiasheng Si , Jin Wang , Wenpeng Lu , Libo Qin

Large Language Models exhibit impressive reasoning capabilities across diverse tasks, motivating efforts to distill these capabilities into smaller models through generated reasoning data. However, direct training on such synthesized…

Computation and Language · Computer Science 2025-02-05 Shengmin Piao , Sanghyun Park

Recent advancements in large language models (LLMs) have been driven by their emergent reasoning capabilities, particularly through long chain-of-thought (CoT) prompting, which enables thorough exploration and deliberation. Despite these…

Computation and Language · Computer Science 2026-04-09 Junnan Liu , Hongwei Liu , Songyang Zhang , Kai Chen

Large Reasoning Models (LRMs) have demonstrated remarkable performance on complex tasks by engaging in extended reasoning before producing final answers. Beyond improving abilities, these detailed reasoning traces also create a new…

Computation and Language · Computer Science 2026-01-08 Shu Yang , Junchao Wu , Xilin Gong , Xuansheng Wu , Derek Wong , Ninghao Liu , Di Wang

While Chain-of-Thought (CoT) significantly enhances the performance of Large Language Models (LLMs), explicit reasoning chains introduce substantial computational redundancy. Recent latent reasoning methods attempt to mitigate this by…

Computation and Language · Computer Science 2026-02-02 Fanmeng Wang , Haotian Liu , Guojiang Zhao , Hongteng Xu , Zhifeng Gao

Recent studies have shown that making a model spend more time thinking through longer Chain of Thoughts (CoTs) enables it to gain significant improvements in complex reasoning tasks. While current researches continue to explore the benefits…

Computation and Language · Computer Science 2025-10-14 Wenkai Yang , Shuming Ma , Yankai Lin , Furu Wei

Large Language Models (LLMs) often rely on long chain-of-thought (CoT) reasoning to solve complex tasks. While effective, these trajectories are frequently inefficient, leading to high latency from excessive token generation, or unstable…

Reasoning-capable language models achieve state-of-the-art performance in diverse complex tasks by generating long, explicit Chain-of-Thought (CoT) traces. While recent works show that base models can acquire such reasoning traces via…

Reasoning models have demonstrated remarkable progress in solving complex and logic-intensive tasks by generating extended Chain-of-Thoughts (CoTs) prior to arriving at a final answer. Yet, the emergence of this "slow-thinking" paradigm,…

Computation and Language · Computer Science 2025-09-30 Sicheng Feng , Gongfan Fang , Xinyin Ma , Xinchao Wang

This paper target in addressing the challenges of underthinking and overthinking in long chain-of-thought (CoT) reasoning for Large Reasoning Models (LRMs) by introducing Reasoning Control Fields (RCF)--a novel test-time approach that…

Artificial Intelligence · Computer Science 2025-06-03 Di Zhang , Weida Wang , Junxian Li , Xunzhi Wang , Jiatong Li , Jianbo Wu , Jingdi Lei , Haonan He , Peng Ye , Shufei Zhang , Wanli Ouyang , Yuqiang Li , Dongzhan Zhou

Large reasoning models (LRMs) often consume excessive tokens, inflating computational cost and latency. More broadly, in goal reaching sequential decision problems we often want to reach the goal quickly, and LRM reasoning can be viewed…

Machine Learning · Computer Science 2026-05-27 Alex Ayoub , Kavosh Asadi , Dale Schuurmans , Csaba Szepesvári , Karim Bouyarmane

Large language models (LLMs) have demonstrated remarkable capabilities in chain of thought (CoT) reasoning. However, the current LLM reasoning paradigm initiates thinking only after the entire input is available, which introduces…

Computation and Language · Computer Science 2026-03-20 Junlong Tong , Yingqi Fan , Anhao Zhao , Yunpu Ma , Xiaoyu Shen

Chain-of-thought (CoT) reasoning in vision language models (VLMs) is crucial for improving interpretability and trustworthiness. However, current training recipes lack robust CoT reasoning data, relying on datasets dominated by short…

Artificial Intelligence · Computer Science 2024-10-22 Ruohong Zhang , Bowen Zhang , Yanghao Li , Haotian Zhang , Zhiqing Sun , Zhe Gan , Yinfei Yang , Ruoming Pang , Yiming Yang