English
Related papers

Related papers: Budget-aware Test-time Scaling via Discriminative …

200 papers

Scaling test-time compute has emerged as an effective strategy for improving the performance of large language models. However, existing methods typically allocate compute uniformly across all queries, overlooking variation in query…

Artificial Intelligence · Computer Science 2026-04-24 Bowen Zuo , Yinglun Zhu

Test-Time Scaling (TTS) improves the reasoning performance of Large Language Models (LLMs) by allocating additional compute during inference. We conduct a structured survey of TTS methods and categorize them into sampling-based,…

Computation and Language · Computer Science 2025-06-06 Ho-Lam Chung , Teng-Yun Hsiao , Hsiao-Ying Huang , Chunerh Cho , Jian-Ren Lin , Zhang Ziwei , Yun-Nung Chen

Large language models have achieved remarkable success on final-answer mathematical problems, largely due to the ease of applying reinforcement learning with verifiable rewards. However, the reasoning underlying these solutions is often…

Despite substantial advances in scaling test-time compute, an ongoing debate in the community is how it should be scaled up to enable continued and efficient improvements with scaling. There are largely two approaches: first, distilling…

Machine Learning · Computer Science 2025-02-19 Amrith Setlur , Nived Rajaraman , Sergey Levine , Aviral Kumar

Large language models (LLMs) struggle with multi-step reasoning, where inference-time scaling has emerged as a promising strategy for performance improvement. Verifier-guided search outperforms repeated sampling when sample size is limited…

Computation and Language · Computer Science 2025-02-04 Fei Yu , Yingru Li , Benyou Wang

Test-time scaling via solution sampling and aggregation has become a key paradigm for improving the reasoning performance of Large Language Models (LLMs). While reward model selection is commonly employed in this approach, it often fails to…

Machine Learning · Computer Science 2025-09-30 Zhicheng Yang , Zhijiang Guo , Yinya Huang , Yongxin Wang , Yiwei Wang , Xiaodan Liang , Jing Tang

Large language models (LLMs) have rapidly progressed into general-purpose agents capable of solving a broad spectrum of tasks. However, current models remain inefficient at reasoning: they apply fixed inference-time compute regardless of…

Scaling test time compute has shown remarkable success in improving the reasoning abilities of large language models (LLMs). In this work, we conduct the first systematic exploration of applying test-time scaling methods to language agents…

The rapid advancement of large language models (LLMs) has significantly improved code completion tasks, yet the trade-off between accuracy and computational cost remains a critical challenge. While using larger models and incorporating…

Software Engineering · Computer Science 2025-02-17 Boyuan Chen , Mingzhi Zhu , Brendan Dolan-Gavitt , Muhammad Shafique , Siddharth Garg

Advanced test-time computing strategies are essential for scaling reasoning models, but their effectiveness is capped by the models' poor self-evaluation. We propose a pairwise Explanatory Verifier, trained via reinforcement learning…

Artificial Intelligence · Computer Science 2025-09-25 Anisha Garg , Engin Tekin , Yash More , David Bick , Nishit Neema , Ganesh Venkatesh

Recent reasoning models, such as OpenAI's O1 series, have demonstrated exceptional performance on complex reasoning tasks and revealed new test-time scaling laws. Inspired by this, many people have been studying how to train models to…

Computation and Language · Computer Science 2025-06-03 Weizhe Chen , Sven Koenig , Bistra Dilkina

There is intense interest in investigating how inference time compute (ITC) (e.g. repeated sampling, refinements, etc) can improve large language model (LLM) capabilities. At the same time, recent breakthroughs in reasoning models, such as…

Artificial Intelligence · Computer Science 2025-04-22 Junlin Wang , Shang Zhu , Jon Saad-Falcon , Ben Athiwaratkun , Qingyang Wu , Jue Wang , Shuaiwen Leon Song , Ce Zhang , Bhuwan Dhingra , James Zou

Best-of-N selection is a key technique for improving the reasoning performance of Large Language Models (LLMs) through increased test-time computation. Current state-of-the-art methods often employ computationally intensive reward models…

Computation and Language · Computer Science 2025-12-15 Zhewei Kang , Xuandong Zhao , Dawn Song

Frontier Large Language Models (LLMs) can be socially discriminatory or sensitive to spurious features of their inputs. Because only well-resourced corporations can train frontier LLMs, we need robust test-time strategies to control such…

Computation and Language · Computer Science 2024-10-08 Leonardo Cotta , Chris J. Maddison

Verifiers can improve language model capabilities by scoring and ranking responses from generated candidates. Currently, high-quality verifiers are either unscalable (e.g., humans) or limited in utility (e.g., tools like Lean). While LM…

Classification systems are often deployed in resource-constrained settings where labels must be assigned to inputs on a budget of time, memory, etc. Budgeted, sequential classifiers (BSCs) address these scenarios by processing inputs…

Neural and Evolutionary Computing · Computer Science 2022-09-08 Nolan H. Hamilton , Errin Fulp

Test-time scaling (TTS) has been shown to improve the performance of large language models (LLMs) by sampling and aggregating diverse reasoning paths. However, existing research has overlooked a critical issue: selection bias of reasoning…

Artificial Intelligence · Computer Science 2025-09-24 Zongqian Wu , Baoduo Xu , Tianyu Li , Zhu Sun , Xiaofeng Zhu , Lei Feng

Increasing test-time computation is a straightforward approach to enhancing the quality of responses in Large Language Models (LLMs). While Best-of-N sampling and Self-Consistency with majority voting are simple and effective, they require…

Machine Learning · Computer Science 2025-03-04 Chengsong Huang , Langlin Huang , Jixuan Leng , Jiacheng Liu , Jiaxin Huang

Scaling test-time compute via extended reasoning has become a key paradigm for improving the capabilities of large language models (LLMs). However, existing approaches optimize reasoning under fixed or uniformly sampled token budgets,…

Computation and Language · Computer Science 2026-04-23 Amirul Rahman , Aisha Karim , Kenji Nakamura , Yi-Fan Ng

Test-time scaling has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs) by allocating additional computational resources during inference. However, this paradigm is inherently…

Computation and Language · Computer Science 2025-09-08 Shengyin Sun , Yiming Li , Xing Li , Yingzhao Lian , Weizhe Lin , Hui-Ling Zhen , Zhiyuan Yang , Chen Chen , Xianzhi Yu , Mingxuan Yuan , Chen Ma