English
Related papers

Related papers: Scaling over Scaling: Exploring Test-Time Scaling …

200 papers

Large Language Models (LLMs) have achieved significant advances in reasoning tasks. A key approach is tree-based search with verifiers, which expand candidate reasoning paths and use reward models to guide pruning and selection. Although…

Artificial Intelligence · Computer Science 2025-10-01 Yingqian Cui , Zhenwei Dai , Pengfei He , Bing He , Hui Liu , Xianfeng Tang , Jingying Zeng , Suhang Wang , Yue Xing , Jiliang Tang , Benoit Dumoulin

Recent advancements in improving the reasoning capabilities of Large Language Models have underscored the efficacy of Process Reward Models (PRMs) in addressing intermediate errors through structured feedback mechanisms. This study analyzes…

Computation and Language · Computer Science 2025-06-03 Zhengyu Chen , Yudong Wang , Teng Xiao , Ruochen Zhou , Xuesheng Yang , Wei Wang , Zhifang Sui , Jingang Wang

Large Reasoning Models (LRMs) achieve strong performance on mathematical reasoning tasks but remain unreliable on challenging instances. Existing test-time scaling methods, such as repeated sampling, self-correction, and tree search,…

Artificial Intelligence · Computer Science 2026-04-30 Zhimin Lin , Yixin Ji , Jinpeng Li , Yu Luo , Dong Li , Junhua Fang , Juntao Li , Min Zhang

The advancement of Time Series Foundation Models (TSFMs) has been driven primarily by large-scale pre-training, but inference-time compute potential remains largely untapped. This work systematically investigates two questions: how do TSFMs…

Machine Learning · Computer Science 2026-01-27 Ruijin Hua , Zichuan Liu , Kun Zhang , Yiyuan Yang

Scaling test time compute has shown remarkable success in improving the reasoning abilities of large language models (LLMs). In this work, we conduct the first systematic exploration of applying test-time scaling methods to language agents…

Large language models (LLMs) have shown strong capabilities in complex reasoning, and test-time scaling techniques can enhance their performance with comparably low cost. Many of these methods have been developed and evaluated on…

Large language models (LLMs) have rapidly progressed into general-purpose agents capable of solving a broad spectrum of tasks. However, current models remain inefficient at reasoning: they apply fixed inference-time compute regardless of…

Test-time scaling has recently emerged as a promising approach for enhancing the reasoning capabilities of large language models or vision-language models during inference. Although a variety of test-time scaling strategies have been…

Computation and Language · Computer Science 2025-06-17 Gyutaek Oh , Seoyeon Kim , Sangjoon Park , Byung-Hoon Kim

Inference-time scaling has emerged as a powerful technique for enhancing the reasoning performance of Large Language Models (LLMs). However, existing approaches often rely on heuristic strategies for parallel sampling, lacking a principled…

Machine Learning · Computer Science 2025-12-22 Youkang Wang , Jian Wang , Rubing Chen , Xiao-Yong Wei

Recent multimodal large language models (MLLMs) have begun to support Thinking with Images by invoking visual tools such as zooming and cropping during inference. Yet these systems remain brittle in fine-grained visual reasoning because…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zheng Jiang , Yiming Chen , Nan He , Jiahui Chen , Chaoyang Li , Houde Qian , Lifeng Sun

Test-time compute scaling allocates inference computation uniformly, uses fixed sampling strategies, and applies verification only for reranking. In contrast, we propose a verifier-guided adaptive framework treating reasoning as iterative…

Computation and Language · Computer Science 2026-04-08 Ahsan Bilal , Ahmed Mohsin , Muhammad Umer , Ali Subhan , Hassan Rizwan , Ayesha Mohsin , Dean Hougen

Recent studies have shown that making a model spend more time thinking through longer Chain of Thoughts (CoTs) enables it to gain significant improvements in complex reasoning tasks. While current researches continue to explore the benefits…

Computation and Language · Computer Science 2025-10-14 Wenkai Yang , Shuming Ma , Yankai Lin , Furu Wei

We examine the reasoning and planning capabilities of large language models (LLMs) in solving complex tasks. Recent advances in inference-time techniques demonstrate the potential to enhance LLM reasoning without additional training by…

Artificial Intelligence · Computer Science 2025-02-19 Shubham Parashar , Blake Olson , Sambhav Khurana , Eric Li , Hongyi Ling , James Caverlee , Shuiwang Ji

Recent research has highlighted that Large Language Models (LLMs), even when trained to generate extended long reasoning steps, still face significant challenges on hard reasoning problems. However, much of the existing literature relies on…

Artificial Intelligence · Computer Science 2025-05-29 Fanzeng Xia , Yidong Luo , Tinko Sebastian Bartels , Yaqi Xu , Tongxin Li

This paper presents a simple, effective, and cost-efficient strategy to improve LLM performance by scaling test-time compute. Our strategy builds upon the repeated-sampling-then-voting framework, with a novel twist: incorporating multiple…

Artificial Intelligence · Computer Science 2025-11-11 Jianhao Chen , Zishuo Xun , Bocheng Zhou , Han Qi , Hangfan Zhang , Qiaosheng Zhang , Yang Chen , Wei Hu , Yuzhong Qu , Wanli Ouyang , Shuyue Hu

One critical challenge for large language models (LLMs) for making complex reasoning is their reliance on matching reasoning patterns from training data, instead of proactively selecting the most appropriate cognitive strategy to solve a…

Computation and Language · Computer Science 2025-03-18 Qin Liu , Wenxuan Zhou , Nan Xu , James Y. Huang , Fei Wang , Sheng Zhang , Hoifung Poon , Muhao Chen

Process Reward Models (PRMs) have recently emerged as a powerful framework for enhancing the reasoning capabilities of large reasoning models (LRMs), particularly in the context of test-time scaling (TTS). However, their potential for…

Artificial Intelligence · Computer Science 2025-10-08 Jiaru Zou , Soumya Roy , Vinay Kumar Verma , Ziyi Wang , David Wipf , Pan Lu , Sumit Negi , James Zou , Jingrui He

LLMs can solve complex tasks by generating long, multi-step reasoning chains. Test-time scaling (TTS) can further improve performance by sampling multiple variants of intermediate reasoning steps, verifying their correctness, and selecting…

Recent advances in large language models (LLMs) have enabled near-human performance on software coding benchmarks, but their effectiveness in RTL code generation remains limited due to the scarcity of high-quality training data. While prior…

Hardware Architecture · Computer Science 2025-07-17 Chenhui Deng , Yun-Da Tsai , Guan-Ting Liu , Zhongzhi Yu , Haoxing Ren

Scaling test-time compute through extended chains of thought has become a dominant paradigm for improving large language model reasoning. However, existing research implicitly assumes that longer thinking always yields better results. This…

Artificial Intelligence · Computer Science 2026-04-14 Shu Zhou , Rui Ling , Junan Chen , Xin Wang , Tao Fan , Hao Wang