English
Related papers

Related papers: Controlling Thinking Speed in Reasoning Models

200 papers

Large Reasoning Models (LRMs) often suffer from overthinking, generating verbose reasoning traces that compromise both computational efficiency and interpretability. Unlike prior efforts that rely on global length-based rewards, we propose…

Artificial Intelligence · Computer Science 2026-01-07 Jialiang Hong , Taihang Zhen , Kai Chen , Jiaheng Liu , Junlan Feng , Wenpeng Zhu , Jing Huo , Yang Gao , Depeng Wang , Haitao Wan , Xi Yang , Boyan Wang , Fanyu Meng , Yuyao Zhang

The rapid advancement of Large Vision Language Models (LVLMs) has demonstrated excellent abilities in various visual tasks. Building upon these developments, the thinking with images paradigm has emerged, enabling models to dynamically edit…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yujin Zhou , Pengcheng Wen , Jiale Chen , Boqin Yin , Han Zhu , Jiaming Ji , Juntao Dai , Chi-Min Chan , Sirui Han

Recent Large Reasoning Models (LRMs) with thinking traces have shown strong performance on English reasoning tasks. However, their ability to think in other languages is less studied. This capability is as important as answer accuracy for…

Computation and Language · Computer Science 2025-12-12 Jirui Qi , Shan Chen , Zidi Xiong , Raquel Fernández , Danielle S. Bitterman , Arianna Bisazza

Generative Reward Models (GRMs) provide greater flexibility than scalar reward models in capturing human preferences, but their effectiveness is limited by poor reasoning capabilities. This often results in incomplete or overly speculative…

Computation and Language · Computer Science 2025-06-23 Bin Chen , Xinzge Gao , Chuanrui Hu , Penghang Yu , Hua Zhang , Bing-Kun Bao

Reasoning Large Language Models (LLMs) enable test-time scaling, with dataset-level accuracy improving as the token budget increases, motivating adaptive reasoning -- spending tokens when they improve reliability and stopping early when…

Artificial Intelligence · Computer Science 2026-05-15 Xi Wang , Anushri Suresh , Alvin Zhang , Rishi More , William Jurayj , Benjamin Van Durme , Mehrdad Farajtabar , Daniel Khashabi , Eric Nalisnick

The rapid advancements in large Language models (LLMs) have significantly enhanced their reasoning capabilities, driven by various strategies such as multi-agent collaboration. However, unlike the well-established performance improvements…

Artificial Intelligence · Computer Science 2026-04-23 Zihan Chen , Song Wang , Zhen Tan , Xingbo Fu , Zhenyu Lei , Peng Wang , Huan Liu , Cong Shen , Jundong Li

Large language models (LLMs) have demonstrated significant advancements in reasoning capabilities, performing well on various challenging benchmarks. Techniques like Chain-of-Thought prompting have been introduced to further improve…

Computation and Language · Computer Science 2025-06-13 Zehui Ling , Deshu Chen , Hongwei Zhang , Yifeng Jiao , Xin Guo , Yuan Cheng

Large Reasoning Models (LRMs) increasingly rely on reasoning traces with complex internal structures. However, existing work lacks a unified answer to three fundamental questions: (1) what defines high-quality reasoning, (2) how to reliably…

Computation and Language · Computer Science 2026-02-10 Haoran Zhang , Yafu Li , Zhi Wang , Zhilin Wang , Shunkai Zhang , Xiaoye Qu , Yu Cheng

Large reasoning models (LRMs) have achieved remarkable performance in complex reasoning tasks, driven by their powerful inference-time scaling capability. However, LRMs often suffer from overthinking, which results in substantial…

Computation and Language · Computer Science 2026-04-09 Yang Xiang , Yixin Ji , Ruotao Xu , Dan Qiao , Zheming Yang , Juntao Li , Min Zhang

Many state-of-the-art LLMs are trained to think before giving their answer. Reasoning can greatly improve language model capabilities, but it also makes them less interactive: given a new input, a model must stop thinking before it can…

Recent advances in text-only "slow-thinking" reasoning have prompted efforts to transfer this capability to vision-language models (VLMs), for training visual reasoning models (\textbf{VRMs}). owever, such transfer faces critical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Pu Jian , Junhong Wu , Wei Sun , Chen Wang , Shuo Ren , Jiajun Zhang

Currently, many large language models (LLMs) are utilized for software engineering tasks such as code generation. The emergence of more advanced models known as large reasoning models (LRMs), such as OpenAI's o3, DeepSeek R1, and Qwen3.…

Software Engineering · Computer Science 2025-09-18 Kevin Halim , Sin G. Teo , Ruitao Feng , Zhenpeng Chen , Yang Gu , Chong Wang , Yang Liu

The integration of slow-thinking mechanisms into large language models (LLMs) offers a promising way toward achieving Level 2 AGI Reasoners, as exemplified by systems like OpenAI's o1. However, several significant challenges remain,…

Computation and Language · Computer Science 2025-02-10 Xiao-Wen Yang , Xuan-Yi Zhu , Wen-Da Wei , Ding-Chu Zhang , Jie-Jing Shao , Zhi Zhou , Lan-Zhe Guo , Yu-Feng Li

Large Language Models (LLMs) have succeeded remarkably in various natural language processing (NLP) tasks, yet their reasoning capabilities remain a fundamental challenge. While LLMs exhibit impressive fluency and factual recall, their…

Computation and Language · Computer Science 2025-05-29 Avinash Patil , Aryan Jadon

Test-time compute has emerged as a powerful paradigm for improving the performance of large language models (LLMs), where generating multiple outputs or refining individual chains can significantly boost answer accuracy. However, existing…

Machine Learning · Computer Science 2025-09-26 Sheng Liu , Tianlang Chen , Pan Lu , Haotian Ye , Yizheng Chen , Lei Xing , James Zou

Vision-language models (VLMs) have recently demonstrated strong efficacy as visual assistants that can parse natural queries about the visual content and generate human-like outputs. In this work, we explore the ability of these models to…

Computation and Language · Computer Science 2024-03-21 Yangyi Chen , Karan Sikka , Michael Cogswell , Heng Ji , Ajay Divakaran

Large reasoning models (LRMs) have demonstrated impressive capabilities in complex problem-solving, yet their internal reasoning mechanisms remain poorly understood. In this paper, we investigate the reasoning trajectories of LRMs from an…

Artificial Intelligence · Computer Science 2025-06-05 Chen Qian , Dongrui Liu , Haochen Wen , Zhen Bai , Yong Liu , Jing Shao

The rise of Large Reasoning Models (LRMs) signifies a paradigm shift toward advanced computational reasoning. Yet, this progress disrupts traditional agent frameworks, traditionally anchored by execution-oriented Large Language Models…

Artificial Intelligence · Computer Science 2025-05-28 Xueyang Zhou , Guiyao Tie , Guowen Zhang , Weidong Wang , Zhigang Zuo , Di Wu , Duanfeng Chu , Pan Zhou , Neil Zhenqiang Gong , Lichao Sun

Large Vision-Language Models (LVLMs) have exhibited strong reasoning capabilities through chain-of-thought mechanisms that generate step-by-step rationales. However, such slow-thinking approaches often lead to overthinking, where models…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Xingjian Diao , Zheyuan Liu , Chunhui Zhang , Weiyi Wu , Keyi Kong , Lin Shi , Kaize Ding , Soroush Vosoughi , Jiang Gui

While large language models (LLMs) excel in mathematical and code reasoning, we observe they struggle with social reasoning tasks, exhibiting cognitive confusion, logical inconsistencies, and conflation between objective world states and…

Computation and Language · Computer Science 2025-10-14 Jialu Du , Guiyang Hou , Yihui Fu , Chen Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu