English
Related papers

Related papers: An Empirical Study on Eliciting and Improving R1-l…

200 papers

Large Reasoning Models (LRMs) demonstrate exceptional capability in tackling complex mathematical, logical, and coding tasks by leveraging extended Chain-of-Thought (CoT) reasoning. Test-time scaling methods, such as prolonging CoT with…

Machine Learning · Computer Science 2025-06-03 Weizhe Lin , Xing Li , Zhiyuan Yang , Xiaojin Fu , Hui-Ling Zhen , Yaoyuan Wang , Xianzhi Yu , Wulong Liu , Xiaosong Li , Mingxuan Yuan

Large Reasoning Models (LRMs) have achieved impressive performance on challenging tasks, yet their deep reasoning often incurs substantial computational costs. To achieve efficient reasoning, existing reinforcement learning methods still…

Large Language Models (LLMs) with reasoning capabilities have achieved state-of-the-art performance on a wide range of tasks. Despite its empirical success, the tasks and model scales at which reasoning becomes effective, as well as its…

Computation and Language · Computer Science 2025-09-29 Nicolas Boizard , Hippolyte Gisserot-Boukhlef , Kevin El-Haddad , Céline Hudelot , Pierre Colombo

As Large Language Models (LLMs) are increasingly adopted as automated judges in benchmarking and reward modeling, ensuring their reliability, efficiency, and robustness has become critical. In this work, we present a systematic comparison…

Artificial Intelligence · Computer Science 2026-05-12 Pratik Jayarao , Himanshu Gupta , Neeraj Varshney , Chaitanya Dwivedi

Large Language Models (LLMs) achieve superior performance through Chain-of-Thought (CoT) reasoning, but these token-level reasoning chains are computationally expensive and inefficient. In this paper, we introduce Compressed Latent…

Computation and Language · Computer Science 2026-02-04 Wenhui Tan , Jiaze Li , Jianzhong Ju , Zhenbo Luo , Ruihua Song , Jian Luan

Recent reasoning language models, particularly those that employ long latent chains of thought, achieve strong performance on complex agentic tasks. However, as these models operate over increasingly long time horizons, their internal…

Machine Learning · Computer Science 2026-05-27 Hans Peter Lyngsøe Raaschou-Jensen , Constanza Fierro , Anders Søgaard

Recent advancements in large language models (LLMs), such as DeepSeek-R1 and OpenAI-o1, have demonstrated the significant effectiveness of test-time scaling, achieving substantial performance gains across various benchmarks. These advanced…

Computation and Language · Computer Science 2025-04-15 Haotian Wang , Han Zhao , Shuaiting Chen , Xiaoyu Tian , Sitong Zhao , Yunjie Ji , Yiping Peng , Xiangang Li

Vision-language models (VLMs) have achieved impressive progress in natural image reasoning, yet their potential in medical imaging remains underexplored. Medical vision-language tasks demand precise understanding and clinically coherent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yuxiang Lai , Jike Zhong , Ming Li , Shitian Zhao , Yuheng Li , Konstantinos Psounis , Xiaofeng Yang

Search-augmented reasoning agents interleave multi-step reasoning with external information retrieval, but uncontrolled retrieval often leads to redundant evidence, context saturation, and unstable learning. Existing approaches rely on…

Computation and Language · Computer Science 2026-02-03 Siheng Xiong , Oguzhan Gungordu , Blair Johnson , James C. Kerce , Faramarz Fekri

In this paper, we address the challenge of enforcing strict schema adherence in large language model (LLM) generation by leveraging LLM reasoning capabilities. Building on the DeepSeek R1 reinforcement learning framework, our approach…

Computation and Language · Computer Science 2025-02-24 Bhavik Agarwal , Ishan Joshi , Viktoria Rojkova

Large reasoning models exhibit remarkable reasoning capabilities via long, elaborate reasoning trajectories. Supervised fine-tuning on such reasoning traces, also known as distillation, can be a cost-effective way to boost reasoning…

We introduce ASTRO, the "Autoregressive Search-Taught Reasoner", a framework for training language models to reason like search algorithms, explicitly leveraging self-reflection, backtracking, and exploration in their outputs. Recently,…

Artificial Intelligence · Computer Science 2025-07-02 Joongwon Kim , Anirudh Goyal , Liang Tan , Hannaneh Hajishirzi , Srinivasan Iyer , Tianlu Wang

We introduce ToRL (Tool-Integrated Reinforcement Learning), a framework for training large language models (LLMs) to autonomously use computational tools via reinforcement learning. Unlike supervised fine-tuning, ToRL allows models to…

Computation and Language · Computer Science 2025-04-01 Xuefeng Li , Haoyang Zou , Pengfei Liu

Reasoning-focused large language models (LLMs) are rapidly evolving across various domains, yet their capabilities in handling complex legal problems remains underexplored. In this paper, we introduce Unilaw-R1, a large language model…

Computation and Language · Computer Science 2025-12-09 Hua Cai , Shuang Zhao , Liang Zhang , Xuli Shen , Qing Xu , Weilin Shen , Zihao Wen , Tianke Ban

Current Large Language Models (LLMs) exhibit significant limitations, notably in structured, interpretable, and verifiable medical reasoning, alongside practical deployment challenges related to computational resources and data privacy.…

Computation and Language · Computer Science 2025-06-06 Boqin Zhuang , Chenxiao Song , Huitong Lu , Jiacheng Qiao , Mingqian Liu , Mingxing Yu , Ping Hong , Rui Li , Xiaoxia Song , Xiangjun Xu , Xu Chen , Yaoyao Ma , Yujie Gao

Reinforcement learning with verifiable rewards (RLVR) has been shown to enhance the reasoning capabilities of large language models (LLMs), enabling the development of large reasoning models (LRMs). However, LRMs such as DeepSeek-R1 and…

Artificial Intelligence · Computer Science 2025-11-13 Yuhao Wang , Xiaopeng Li , Cheng Gong , Ziru Liu , Suiyun Zhang , Rui Liu , Xiangyu Zhao

The ongoing evolution of language models has led to the development of large-scale architectures that demonstrate exceptional performance across a wide range of tasks. However, these models come with significant computational and energy…

Artificial Intelligence · Computer Science 2025-11-19 Xialie Zhuang , Peixian Ma , Zhikai Jia , Zane Cao , Shiwei Liu

To advance time series forecasting (TSF), various methods have been proposed to improve prediction accuracy, evolving from statistical techniques to data-driven deep learning architectures. Despite their effectiveness, most existing methods…

Machine Learning · Computer Science 2026-04-21 Yitong Zhou , Yucong Luo , Mingyue Cheng , Qi Liu , Jiahao Wang , Daoyu Wang , Enhong Chen

Large Language Models (LLMs) have achieved impressive performance across a range of natural language processing tasks. However, recent advances demonstrate that further gains particularly in complex reasoning tasks require more than merely…

Computation and Language · Computer Science 2025-09-09 Wei Huang , Yizhe Xiong , Xin Ye , Zhijie Deng , Hui Chen , Zijia Lin , Guiguang Ding

Information seeking demands iterative evidence gathering and reflective reasoning, yet large language models (LLMs) still struggle with it in open-web question answering. Existing prompting and supervised fine-tuning (SFT) methods remain…

Computation and Language · Computer Science 2025-11-11 Wenxuan Shi , Haochen Tan , Chuqiao Kuang , Xiaoguang Li , Xiaozhe Ren , Chen Zhang , Hanting Chen , Yasheng Wang , Lu Hou , Lifeng Shang