中文
相关论文

相关论文: Does Thinking More always Help? Mirage of Test-Tim…

200 篇论文

Scaling test-time compute through extended chains of thought has become a dominant paradigm for improving large language model reasoning. However, existing research implicitly assumes that longer thinking always yields better results. This…

人工智能 · 计算机科学 2026-04-14 Shu Zhou , Rui Ling , Junan Chen , Xin Wang , Tao Fan , Hao Wang

Test-time scaling increases inference-time computation by allowing models to generate long reasoning chains, and has improved performance across many domains. However, in this work, we show that this approach is not yet effective for…

人工智能 · 计算机科学 2026-02-03 James Xu Zhao , Bryan Hooi , See-Kiong Ng

As language model (LM) outputs get more and more natural, it is becoming more difficult than ever to evaluate their quality. Simultaneously, increasing LMs' "thinking" time through scaling test-time compute has proven an effective technique…

Test-time scaling is a promising new approach to language modeling that uses extra test-time compute to improve performance. Recently, OpenAI's o1 model showed this capability but did not publicly share its methodology, leading to many…

Scaling the test-time compute of large language models has demonstrated impressive performance on reasoning benchmarks. However, existing evaluations of test-time scaling make the strong assumption that a reasoning system should always give…

计算与语言 · 计算机科学 2025-07-21 William Jurayj , Jeffrey Cheng , Benjamin Van Durme

Recent studies have shown that making a model spend more time thinking through longer Chain of Thoughts (CoTs) enables it to gain significant improvements in complex reasoning tasks. While current researches continue to explore the benefits…

计算与语言 · 计算机科学 2025-10-14 Wenkai Yang , Shuming Ma , Yankai Lin , Furu Wei

Test-time scaling has emerged as an effective approach for improving language model performance by utilizing additional compute at inference time. Recent studies have shown that overriding end-of-thinking tokens (e.g., replacing "</think>"…

计算与语言 · 计算机科学 2026-05-14 Liran Ringel , Elad Tolochinsky , Yaniv Romano

Test-time scaling has emerged as a powerful technique for enhancing the reasoning capabilities of large language models. However, its effectiveness in medical reasoning remains uncertain, as the medical domain fundamentally differs from…

计算与语言 · 计算机科学 2026-02-19 Xiaoke Huang , Juncheng Wu , Hui Liu , Xianfeng Tang , Yuyin Zhou

Reasoning reinforcement learning (RL) has recently revealed a new scaling effect: test-time scaling. Thinking models such as R1 and o1 improve their reasoning accuracy at test time as the length of the reasoning context increases. However,…

机器学习 · 计算机科学 2025-11-24 Chao Yu , Qixin Tan , Jiaxuan Gao , Shi Yu , Hong Lu , Xinting Yang , Zelai Xu , Yu Wang , Yi Wu , Eugene Vinitsky

Reasoning large language models achieve impressive test-time scaling by thinking for longer, but this performance gain comes at significant compute cost. Directly limiting test-time budget hurts overall performance, but not all problems are…

机器学习 · 计算机科学 2025-05-27 Menghua Wu , Cai Zhou , Stephen Bates , Tommi Jaakkola

The remarkable performance of the o1 model in complex reasoning demonstrates that test-time compute scaling can further unlock the model's potential, enabling powerful System-2 thinking. However, there is still a lack of comprehensive…

人工智能 · 计算机科学 2025-07-01 Yixin Ji , Juntao Li , Yang Xiang , Hai Ye , Kaixin Wu , Kai Yao , Jia Xu , Linjian Mo , Min Zhang

Sequential test-time scaling is a promising training-free method to improve large reasoning model accuracy, but as currently implemented, significant limitations have been observed. Inducing models to think for longer can increase their…

人工智能 · 计算机科学 2026-01-16 Michael R. Metel , Yufei Cui , Boxing Chen , Prasanna Parthasarathi

Recent advances in large language models (LLMs), such as OpenAI-o1 and DeepSeek-R1, have demonstrated the effectiveness of test-time scaling, where extended reasoning processes substantially enhance model performance. Despite this, current…

计算与语言 · 计算机科学 2025-03-26 Xiaoyu Tian , Sitong Zhao , Haotian Wang , Shuaiting Chen , Yunjie Ji , Yiping Peng , Han Zhao , Xiangang Li

Inference-time computation has emerged as a promising scaling axis for improving large language model reasoning. However, despite yielding impressive performance, the optimal allocation of inference-time computation remains poorly…

机器学习 · 计算机科学 2026-01-12 Parsa Mirtaheri , Ezra Edelman , Samy Jelassi , Eran Malach , Enric Boix-Adsera

Recent advancements in large language models (LLMs), such as DeepSeek-R1 and OpenAI-o1, have demonstrated the significant effectiveness of test-time scaling, achieving substantial performance gains across various benchmarks. These advanced…

计算与语言 · 计算机科学 2025-04-15 Haotian Wang , Han Zhao , Shuaiting Chen , Xiaoyu Tian , Sitong Zhao , Yunjie Ji , Yiping Peng , Xiangang Li

Recently, scaling test-time compute on Large Language Models (LLM) has garnered wide attention. However, there has been limited investigation of how various reasoning prompting strategies perform as scaling. In this paper, we focus on a…

人工智能 · 计算机科学 2025-08-18 Yexiang Liu , Zekun Li , Zhi Fang , Nan Xu , Ran He , Tieniu Tan

Recent reasoning models, such as OpenAI's O1 series, have demonstrated exceptional performance on complex reasoning tasks and revealed new test-time scaling laws. Inspired by this, many people have been studying how to train models to…

计算与语言 · 计算机科学 2025-06-03 Weizhe Chen , Sven Koenig , Bistra Dilkina

The remarkable performance of models like the OpenAI o1 can be attributed to their ability to emulate human-like long-time thinking during inference. These models employ extended chain-of-thought (CoT) processes, exploring multiple…

Reasoning large language models (LLMs) heavily rely on scaling test-time compute to perform complex reasoning tasks by generating extensive "thinking" chains. While demonstrating impressive results, this approach incurs significant…

计算与语言 · 计算机科学 2026-02-04 Michael Hassid , Gabriel Synnaeve , Yossi Adi , Roy Schwartz

Test-time scaling has emerged as a widely adopted inference-time strategy for boosting reasoning performance. However, its effectiveness has been studied almost exclusively in English, leaving its behavior in other languages largely…

计算与语言 · 计算机科学 2025-05-22 Prasoon Bajpai , Tanmoy Chakraborty
‹ 上一页 1 2 3 10 下一页 ›