中文
相关论文

相关论文: Sticker-TTS: Learn to Utilize Historical Experienc…

200 篇论文

Recent research enhances language model reasoning by scaling test-time compute via longer chain-of-thought traces. This often improves accuracy but also introduces redundancy and high computational cost, especially for small language models…

机器学习 · 计算机科学 2025-05-26 Xuechen Zhang , Zijian Huang , Chenshun Ni , Ziyang Xiong , Jiasi Chen , Samet Oymak

Large Language Models (LLMs) have achieved significant advances in reasoning tasks. A key approach is tree-based search with verifiers, which expand candidate reasoning paths and use reward models to guide pruning and selection. Although…

Test-Time Scaling (TTS) improves the reasoning performance of Large Language Models (LLMs) by allocating additional compute during inference. We conduct a structured survey of TTS methods and categorize them into sampling-based,…

计算与语言 · 计算机科学 2025-06-06 Ho-Lam Chung , Teng-Yun Hsiao , Hsiao-Ying Huang , Chunerh Cho , Jian-Ren Lin , Zhang Ziwei , Yun-Nung Chen

Test-time scaling (TTS) has emerged as a new frontier for scaling the performance of Large Language Models. In test-time scaling, by using more computational resources during inference, LLMs can improve their reasoning process and task…

计算与语言 · 计算机科学 2025-09-10 V Venktesh , Mandeep Rathee , Avishek Anand

As language model (LM) outputs get more and more natural, it is becoming more difficult than ever to evaluate their quality. Simultaneously, increasing LMs' "thinking" time through scaling test-time compute has proven an effective technique…

Recently, scaling test-time compute on Large Language Models (LLM) has garnered wide attention. However, there has been limited investigation of how various reasoning prompting strategies perform as scaling. In this paper, we focus on a…

人工智能 · 计算机科学 2025-08-18 Yexiang Liu , Zekun Li , Zhi Fang , Nan Xu , Ran He , Tieniu Tan

Large language models (LLMs) can improve reasoning at inference time through test-time scaling (TTS), where multiple reasoning traces are generated and the best one is selected. Prior work shows that increasing the number of samples K…

人工智能 · 计算机科学 2025-10-06 Yuheng Wu , Azalia Mirhoseini , Thierry Tambe

Despite advances in reinforcement learning (RL)-based video reasoning with large language models (LLMs), data collection and fine-tuning remain significant challenges. These methods often rely on large-scale supervised fine-tuning (SFT)…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Ziyang Wang , Jaehong Yoon , Shoubin Yu , Md Mohaiminul Islam , Gedas Bertasius , Mohit Bansal

Large Reasoning Models (LRMs) demonstrate exceptional capability in tackling complex mathematical, logical, and coding tasks by leveraging extended Chain-of-Thought (CoT) reasoning. Test-time scaling methods, such as prolonging CoT with…

机器学习 · 计算机科学 2025-06-03 Weizhe Lin , Xing Li , Zhiyuan Yang , Xiaojin Fu , Hui-Ling Zhen , Yaoyuan Wang , Xianzhi Yu , Wulong Liu , Xiaosong Li , Mingxuan Yuan

Fact-checking real-world claims, particularly numerical claims, is inherently complex that require multistep reasoning and numerical reasoning for verifying diverse aspects of the claim. Although large language models (LLMs) including…

计算与语言 · 计算机科学 2025-09-29 Primakov Chungkham , V Venktesh , Vinay Setty , Avishek Anand

The reasoning abilities of large language models (LLMs) have improved with chain-of-thought (CoT) prompting, allowing models to solve complex tasks stepwise. However, training CoT capabilities requires detailed reasoning data, which is…

人工智能 · 计算机科学 2025-04-11 Fu-Chieh Chang , Yu-Ting Lee , Hui-Ying Shih , Yi Hsuan Tseng , Pei-Yuan Wu

Large Reasoning Models (LRMs) achieve strong performance on mathematical reasoning tasks but remain unreliable on challenging instances. Existing test-time scaling methods, such as repeated sampling, self-correction, and tree search,…

人工智能 · 计算机科学 2026-04-30 Zhimin Lin , Yixin Ji , Jinpeng Li , Yu Luo , Dong Li , Junhua Fang , Juntao Li , Min Zhang

Recent advances in inference-time scaling, particularly those leveraging reinforcement learning with verifiable rewards, have substantially enhanced the reasoning capabilities of Large Vision-Language Models (LVLMs). Inspired by this…

计算机视觉与模式识别 · 计算机科学 2025-10-13 Yifan Li , Zhenghao Chen , Ziheng Wu , Kun Zhou , Ruipu Luo , Can Zhang , Zhentao He , Yufei Zhan , Wayne Xin Zhao , Minghui Qiu

Test-Time Scaling (TTS) refers to approaches that improve reasoning performance by allocating extra computation during inference, without altering the model's parameters. While existing TTS methods operate in a discrete token space by…

计算与语言 · 计算机科学 2025-05-28 Yige Xu , Xu Guo , Zhiwei Zeng , Chunyan Miao

Recent advancements in Large Language Models (LLMs) have created new opportunities to enhance performance on complex reasoning tasks by leveraging test-time computation. However, existing scaling methods have key limitations: parallel…

人工智能 · 计算机科学 2025-12-04 Jiefeng Chen , Jie Ren , Xinyun Chen , Chengrun Yang , Ruoxi Sun , Jinsung Yoon , Sercan Ö Arık

Test-Time Scaling (TTS) has proven effective in improving the performance of Large Language Models (LLMs) during inference. However, existing research has overlooked the efficiency of TTS from a latency-sensitive perspective. Through a…

计算与语言 · 计算机科学 2025-09-15 Zili Wang , Tianyu Zhang , Haoli Bai , Lu Hou , Xianzhi Yu , Wulong Liu , Shiming Xiang , Lei Zhu

Despite significant advances in Large Reasoning Models (LRMs) driven by reinforcement learning with verifiable rewards (RLVR), this paradigm is fundamentally limited in specialized or novel domains where such supervision is prohibitively…

机器学习 · 计算机科学 2026-04-10 Sikai Bai , Haoxi Li , Jie Zhang , Yongjiang Liu , Song Guo

Large Language Models (LLMs) now exhibit remarkable reasoning capabilities through test-time compute scaling (TTS), with impressive performance across math and coding benchmarks. In parallel, research in model compression has developed…

人工智能 · 计算机科学 2026-05-29 Ocean Monjur , Shahriar Kabir Nahin , Anshuman Chhabra

Recent advances in large language models (LLMs) have shown that test-time scaling can substantially improve model performance on complex tasks, particularly in the coding domain. Under this paradigm, models use a larger token budget during…

人工智能 · 计算机科学 2026-04-21 Jiaxin Fang , Runyuan He , Sahil Bhatia , Neel Gajare , Alvin Cheung

Large Language Models (LLMs) can achieve enhanced complex problem-solving through test-time computing scaling, yet this often entails longer contexts and numerous reasoning token costs. In this paper, we propose an efficient test-time…

计算与语言 · 计算机科学 2025-04-02 Zhaojian Yu , Yinghao Wu , Yilun Zhao , Arman Cohan , Xiao-Ping Zhang