English
Related papers

Related papers: PathCal: State-Aware Reflection-Marker Calibration…

200 papers

Large reasoning models (LRMs) "think" by generating structured chain-of-thought (CoT) before producing a final answer, yet they still lack the ability to reason critically about safety alignment and are easily biased when a flawed premise…

Chain-of-Thought (CoT) reasoning has significantly advanced Large Language Models (LLMs) in solving complex tasks. However, its autoregressive paradigm leads to significant computational overhead, hindering its deployment in…

Computation and Language · Computer Science 2025-08-29 Nan Jiang , Ziming Wu , De-Chuan Zhan , Fuming Lai , Shaobing Lian

Large Reasoning Models (LRMs) have revolutionized complex problem-solving, yet they exhibit a pervasive "overthinking", generating unnecessarily long reasoning chains. While current solutions improve token efficiency, they often sacrifice…

Artificial Intelligence · Computer Science 2026-04-10 Weiyang Huang , Xuefeng Bai , Kehai Chen , Xinyang Chen , Yibin Chen , Weili Guan , Min Zhang

Recent Large Reasoning Language Models (LRLMs) employ long chain-of-thought reasoning with complex reflection behaviors, typically signaled by specific trigger words (e.g., "Wait" and "Alternatively") to enhance performance. However, these…

Computation and Language · Computer Science 2025-11-18 Jiameng Huang , Baijiong Lin , Guhao Feng , Jierun Chen , Di He , Lu Hou

Large language models (LLMs) achieve strong reasoning performance through chain-of-thought (CoT) reasoning, yet often generate unnecessarily long reasoning paths that incur high inference cost. Recent self-consistency-based approaches…

Computation and Language · Computer Science 2026-03-19 Juming Xiong , Kevin Guo , Congning Ni , Chao Yan , Katherine Brown , Avinash Baidya , Xiang Gao , Bradley Malin , Zhijun Yin

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks. However, they remain highly susceptible to jailbreak attacks that undermine their safety alignment. Existing defense mechanisms typically…

Cryptography and Security · Computer Science 2026-03-17 Yu Pan , Wenlong Yu , Tiejun Wu , Xiaohu Ye , Qiannan Si , Guangquan Xu , Bin Wu

While recent advances in large reasoning models have demonstrated remarkable performance, efficient reasoning remains critical due to the rapid growth of output length. Existing optimization approaches highlights a tendency toward…

Computation and Language · Computer Science 2025-06-17 Kaiyuan Liu , Chen Shen , Zhanwei Zhang , Junjie Liu , Xiaosong Yuan , Jieping ye

Due to their inherent complexity, reasoning tasks have long been regarded as rigorous benchmarks for assessing the capabilities of machine learning models, especially large language models (LLMs). Although humans can solve these tasks with…

Artificial Intelligence · Computer Science 2026-03-30 Yunlong Deng , Boyang Sun , Yan Li , Lingjing Kong , Zeyu Tang , Kun Zhang , Guangyi Chen

Large Reasoning Models (LRMs) have shown remarkable capabilities in solving complex problems through reinforcement learning (RL), particularly by generating long reasoning traces. However, these extended outputs often exhibit substantial…

Computation and Language · Computer Science 2025-05-22 Wei Liu , Ruochen Zhou , Yiyun Deng , Yuzhen Huang , Junteng Liu , Yuntian Deng , Yizhe Zhang , Junxian He

Solving complex, long-horizon robotic manipulation tasks requires a deep understanding of physical interactions, reasoning about their long-term consequences, and precise high-level planning. Vision-Language Models (VLMs) offer a general…

Robotics · Computer Science 2026-02-24 Yanting Yang , Shenyuan Gao , Qingwen Bu , Li Chen , Dimitris N. Metaxas

The field of Language Reasoning Models (LRMs) has been very active over the past few years with advances in training and inference techniques enabling LRMs to reason longer, and more accurately. However, a growing body of studies show that…

Computation and Language · Computer Science 2026-04-24 Yannis Belkhiter , Seshu Tirupathi , Giulio Zizzo , John D. Kelleher

Reasoning has become a central paradigm for large language models (LLMs), consistently boosting accuracy across diverse benchmarks. Yet its suitability for precision-sensitive tasks remains unclear. We present the first systematic study of…

Computation and Language · Computer Science 2025-10-27 Atoosa Chegini , Hamid Kazemi , Garrett Souza , Maria Safi , Yang Song , Samy Bengio , Sinead Williamson , Mehrdad Farajtabar

Large Language Models (LLMs) employing Chain-of-Thought (CoT) prompting have broadened the scope for improving multi-step reasoning capabilities. We generally divide multi-step reasoning into two phases: path generation to generate the…

Computation and Language · Computer Science 2024-08-20 Shumin Deng , Ningyu Zhang , Nay Oo , Bryan Hooi

Previous studies proposed that the reasoning capabilities of large language models (LLMs) can be improved through self-reflection, i.e., letting LLMs reflect on their own output to identify and correct mistakes in the initial responses.…

Computation and Language · Computer Science 2025-02-18 Fengyuan Liu , Nouar AlDahoul , Gregory Eady , Yasir Zaki , Talal Rahwan

The ability to reason is one of the most fundamental capabilities of large language models (LLMs), enabling a wide range of downstream tasks through sophisticated problem-solving. A critical aspect of this is code reasoning, which involves…

Computation and Language · Computer Science 2025-05-26 Yusheng Zhao , Xiao Luo , Weizhi Zhang , Wei Ju , Zhiping Xiao , Philip S. Yu , Ming Zhang

Large Language Models (LLMs) trained via Reinforcement Learning (RL) have exhibited strong reasoning capabilities and emergent reflective behaviors, such as rethinking and error correction, as a form of in-context exploration. However, the…

Machine Learning · Computer Science 2025-12-09 Shenao Zhang , Yaqing Wang , Yinxiao Liu , Tianqi Liu , Peter Grabowski , Eugene Ie , Zhaoran Wang , Yunxuan Li

This work characterizes large language models' chain-of-thought generation as a structured trajectory through representation space. We show that mathematical reasoning traverses functionally ordered, step-specific subspaces that become…

Computation and Language · Computer Science 2026-04-08 Lihao Sun , Hang Dong , Bo Qiao , Qingwei Lin , Dongmei Zhang , Saravan Rajmohan

Chain-of-thought (CoT) reasoning enables large language models (LLMs) to break down complex problems into interpretable intermediate steps, significantly enhancing model transparency and performance in reasoning tasks. However, conventional…

Machine Learning · Computer Science 2026-01-30 Junda Wu , Yuxin Xiong , Xintong Li , Sheldon Yu , Zhengmian Hu , Tong Yu , Rui Wang , Xiang Chen , Jingbo Shang , Julian McAuley

Large Reasoning Models (LRMs) introduce new opportunities for safety monitoring through their Chain of Thought (CoT) reasoning. However, CoT is not always faithful to the model's final output, undermining its reliability as a monitoring…

Computation and Language · Computer Science 2026-05-19 Maciej Chrabąszcz , Aleksander Szymczyk , Marcin Sendera , Tomasz Trzciński , Sebastian Cygert

Large Reasoning Models (LRMs) have demonstrated strong capabilities in complex multi-step reasoning, opening new opportunities for automating optimization modeling. However, existing domain adaptation methods, originally designed for…

Computation and Language · Computer Science 2025-10-07 Zhengyang Tang , Zihan Ye , Chenyu Huang , Xuhan Huang , Chengpeng Li , Sihang Li , Guanhua Chen , Ming Yan , Zizhuo Wang , Hongyuan Zha , Dayiheng Liu , Benyou Wang