English
Related papers

Related papers: When to Continue Thinking: Adaptive Thinking Mode …

200 papers

Large reasoning models (LRMs) have achieved remarkable performance in complex reasoning tasks, driven by their powerful inference-time scaling capability. However, LRMs often suffer from overthinking, which results in substantial…

Computation and Language · Computer Science 2026-04-09 Yang Xiang , Yixin Ji , Ruotao Xu , Dan Qiao , Zheming Yang , Juntao Li , Min Zhang

Large Reasoning Models (LRMs) demonstrate exceptional capability in tackling complex mathematical, logical, and coding tasks by leveraging extended Chain-of-Thought (CoT) reasoning. Test-time scaling methods, such as prolonging CoT with…

Machine Learning · Computer Science 2025-06-03 Weizhe Lin , Xing Li , Zhiyuan Yang , Xiaojin Fu , Hui-Ling Zhen , Yaoyuan Wang , Xianzhi Yu , Wulong Liu , Xiaosong Li , Mingxuan Yuan

Large language models (LLMs) are increasingly being deployed in cost and latency-sensitive settings. While chain-of-thought improves reasoning, it can waste tokens on simple requests. We study selective thinking for tool-using LLMs and…

Recursive reasoning models such as Hierarchical Reasoning Model (HRM) and Tiny Recursive Model (TRM) show that small, weight-shared networks can solve compute-heavy and NP puzzles by iteratively refining latent states, but their training…

Artificial Intelligence · Computer Science 2026-03-18 Navid Hakimi

Recent advancements in Large Language Models (LLMs) have significantly enhanced their ability to perform complex reasoning tasks, transitioning from fast and intuitive thinking (System 1) to slow and deep reasoning (System 2). While System…

Computation and Language · Computer Science 2025-04-01 Rui Wang , Hongru Wang , Boyang Xue , Jianhui Pang , Shudong Liu , Yi Chen , Jiahao Qiu , Derek Fai Wong , Heng Ji , Kam-Fai Wong

Reinforcement learning (RL) has recently become the dominant paradigm for strengthening the reasoning abilities of large language models (LLMs). Yet the rule-based reward functions commonly used on mathematical or programming benchmarks…

Artificial Intelligence · Computer Science 2025-09-09 Haoyang He , Zihua Rong , Kun Ji , Chenyang Li , Qing Huang , Chong Xia , Lan Yang , Honggang Zhang

The enhancement of reasoning capabilities in large language models (LLMs) has garnered significant attention, with supervised fine-tuning (SFT) and reinforcement learning emerging as dominant paradigms. While recent studies recognize the…

Artificial Intelligence · Computer Science 2026-03-17 Zhijie Wang

Human cognition operates through two complementary modes: fast intuitive thinking and slow deliberate thinking. Vanilla large language models (LLMs) predominantly follow the fast-thinking paradigm, producing immediate responses; while…

Artificial Intelligence · Computer Science 2026-01-07 Shengjia Zhang , Junjie Wu , Jiawei Chen , Changwang Zhang , Zhe Li , Xingyu Lou , Wangchunshu Zhou , Sheng Zhou , Can Wang , Jun Wang

Video reasoning using Large Multimodal Models (LMMs) relies on costly reinforcement learning (RL) and verbose chain-of-thought, resulting in substantial computational overhead during both training and inference. Moreover, the mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Deepak Sridhar , Kartikeya Bhardwaj , Jeya Pradha Jeyaraj , Nuno Vasconcelos , Ankita Nayak , Harris Teague

Large Reasoning Models (LRMs) employ reasoning to address complex tasks. Such explicit reasoning requires extended context lengths, resulting in substantially higher resource consumption. Prior work has shown that adversarially crafted…

Artificial Intelligence · Computer Science 2026-02-10 Ziwei Wang , Yuanhe Zhang , Jing Chen , Zhenhong Zhou , Ruichao Liang , Ruiying Du , Ju Jia , Cong Wu , Yang Liu

The context window of large language models (LLMs) has been extended significantly in recent years. However, while the context length that the LLM can process has grown, the capability of the model to accurately reason over that context…

Computation and Language · Computer Science 2024-10-07 Huayang Li , Pat Verga , Priyanka Sen , Bowen Yang , Vijay Viswanathan , Patrick Lewis , Taro Watanabe , Yixuan Su

Recent AI advancements, such as OpenAI's new models, are transforming LLMs into LRMs (Large Reasoning Models) that perform reasoning during inference, taking extra time and compute for higher-quality outputs. We aim to uncover the…

Artificial Intelligence · Computer Science 2025-02-11 Guanghao Ye , Khiem Duc Pham , Xinzhi Zhang , Sivakanth Gopi , Baolin Peng , Beibin Li , Janardhan Kulkarni , Huseyin A. Inan

Large language models (LLMs) achieve strong performance by generating long chains of thought, but longer traces always introduce redundant or ineffective reasoning steps. One typical behavior is that they often perform unnecessary…

Computation and Language · Computer Science 2026-01-13 Jinyi Han , Zixiang Di , Zishang Jiang , Ying Liao , Jiaqing Liang , Yongqi Wang , Yanghua Xiao

Large reasoning models (LRMs) achieve state-of-the-art performance by generating long chains-of-thought, but often waste computation on redundant reasoning after the correct answer has already been reached. We introduce Early-Stopping for…

Artificial Intelligence · Computer Science 2026-02-11 Junda Wang , Zhichao Yang , Dongxu Zhang , Sanjit Singh Batra , Robert E. Tillman

Large Reasoning Models (LRMs) have achieved remarkable success on reasoning-intensive tasks such as mathematics and programming. However, their enhanced reasoning capabilities do not necessarily translate to improved safety performance-and…

Computation and Language · Computer Science 2026-04-21 Zhexin Zhang , Xian Qi Loye , Victor Shea-Jay Huang , Junxiao Yang , Qi Zhu , Shiyao Cui , Fei Mi , Lifeng Shang , Yingkang Wang , Hongning Wang , Minlie Huang

The OpenAI o1-series models have demonstrated that leveraging long-form Chain of Thought (CoT) can substantially enhance performance. However, the recursive thinking capabilities of Large Language Models (LLMs) remain limited, particularly…

Computation and Language · Computer Science 2025-06-09 Haoke Zhang , Xiaobo Liang , Cunxiang Wang , Juntao Li , Min Zhang

Reinforcement learning (RL) is effective in enhancing the accuracy of large language models in complex reasoning tasks. Existing RL policy optimization frameworks rely on final-answer correctness as feedback signals and rarely capture the…

Artificial Intelligence · Computer Science 2026-04-13 Jinghan Zhang , Fengran Mo , Tharindu Cyril Weerasooriya , Ruimin Dai , Xiaoyan Han , Yanjie Fu , Dakuo Wang , Kunpeng Liu

Recently, Large Reasoning Models (LRMs) have gradually become a research hotspot due to their outstanding performance in handling complex tasks. Among them, DeepSeek R1 has garnered significant attention for its exceptional performance and…

Artificial Intelligence · Computer Science 2025-08-05 Linan Yue , Yichao Du , Yizhi Wang , Weibo Gao , Fangzhou Yao , Li Wang , Ye Liu , Ziyu Xu , Qi Liu , Shimin Di , Min-Ling Zhang

Large language models have demonstrated strong reasoning capabilities in general knowledge question answering. However, their ability to handle temporal information remains limited. To address this limitation, existing approaches often…

Computation and Language · Computer Science 2026-04-28 Yimin Deng , Yejing Wang , Zhenxi Lin , Zichuan Fu , Guoshuai Zhao , Derong Xu , Yefeng Zheng , Xiangyu Zhao , Xian Wu , Li Zhu , Xueming Qian

While Large Language Models (LLMs) achieve high performance on standard mathematical benchmarks, their problem-solving abilities depend on the context and textual formatting. We introduce the Robust Reasoning Benchmark (RRB), a pipeline of…

Machine Learning · Computer Science 2026-05-22 Pavel Golikov , Evgenii Opryshko , Gennady Pekhimenko , Mark C. Jeffrey