中文
相关论文

相关论文: FastTTS: Accelerating Test-Time Scaling for Edge L…

200 篇论文

Test-time scaling (TTS) enhances the performance of large language models (LLMs) by allocating additional compute resources during inference. However, existing research primarily investigates TTS in single-stage tasks; while many real-world…

人工智能 · 计算机科学 2025-10-23 Fali Wang , Hui Liu , Zhenwei Dai , Jingying Zeng , Zhiwei Zhang , Zongyu Wu , Chen Luo , Zhen Li , Xianfeng Tang , Qi He , Suhang Wang

Test-time scaling (TTS) has become an effective approach for improving large language model performance by allocating additional computation during inference. However, existing TTS strategies are largely hand-crafted: researchers manually…

Test-Time Scaling (TTS) improves the reasoning performance of Large Language Models (LLMs) by allocating additional compute during inference. We conduct a structured survey of TTS methods and categorize them into sampling-based,…

计算与语言 · 计算机科学 2025-06-06 Ho-Lam Chung , Teng-Yun Hsiao , Hsiao-Ying Huang , Chunerh Cho , Jian-Ren Lin , Zhang Ziwei , Yun-Nung Chen

Test-time scaling (TTS) -- the dynamic allocation of compute during inference -- is a promising direction for improving reasoning in large language models (LLMs). However, a systematic comparison of well-known TTS strategies under identical…

计算与语言 · 计算机科学 2025-12-02 Aradhye Agarwal , Ayan Sengupta , Tanmoy Chakraborty

Parallel test-time scaling (TTS) is a pivotal approach for enhancing large language models (LLMs), typically by sampling multiple token-based chains-of-thought in parallel and aggregating outcomes through voting or search. Recent advances…

计算与语言 · 计算机科学 2026-04-21 Runyang You , Yongqi Li , Meng Liu , Wenjie Wang , Liqiang Nie , Wenjie Li

Test-time scaling (TTS) has emerged as a powerful paradigm for improving the reasoning ability of Large Language Models (LLMs) by allocating additional computation at inference, yet its application to multimodal systems such as…

Test-Time Scaling (TTS) has proven effective in improving the performance of Large Language Models (LLMs) during inference. However, existing research has overlooked the efficiency of TTS from a latency-sensitive perspective. Through a…

计算与语言 · 计算机科学 2025-09-15 Zili Wang , Tianyu Zhang , Haoli Bai , Lu Hou , Xianzhi Yu , Wulong Liu , Shiming Xiang , Lei Zhu

Test-time Scaling (TTS) has been demonstrated to significantly enhance the reasoning capabilities of Large Language Models (LLMs) during the inference phase without altering model parameters. However, existing TTS methods are largely…

计算与语言 · 计算机科学 2025-09-30 Guibin Zhang , Fanci Meng , Guancheng Wan , Zherui Li , Kun Wang , Zhenfei Yin , Lei Bai , Shuicheng Yan

Test-Time Scaling (TTS) refers to approaches that improve reasoning performance by allocating extra computation during inference, without altering the model's parameters. While existing TTS methods operate in a discrete token space by…

计算与语言 · 计算机科学 2025-05-28 Yige Xu , Xu Guo , Zhiwei Zeng , Chunyan Miao

Large language models (LLMs) benefit from test-time scaling but are often hampered by high inference latency. Speculative decoding is a natural way to accelerate the scaling process; however, scaling along both the parallel and sequential…

Large language models (LLMs) have demonstrated impressive reasoning capabilities when provided with chain-of-thought exemplars, but curating large reasoning datasets remains laborious and resource-intensive. In this work, we introduce…

计算与语言 · 计算机科学 2025-10-13 Sondos Mahmoud Bsharat , Zhiqiang Shen

As enthusiasm for scaling computation (data and parameters) in the pretraining era gradually diminished, test-time scaling (TTS), also referred to as ``test-time computing'' has emerged as a prominent research focus. Recent studies…

Test-Time Scaling (TTS) is an important method for improving the performance of Large Language Models (LLMs) by using additional computation during the inference phase. However, current studies do not systematically analyze how policy…

计算与语言 · 计算机科学 2025-02-11 Runze Liu , Junqi Gao , Jian Zhao , Kaiyan Zhang , Xiu Li , Biqing Qi , Wanli Ouyang , Bowen Zhou

Test-time scaling (TTS) has been shown to improve the performance of large language models (LLMs) by sampling and aggregating diverse reasoning paths. However, existing research has overlooked a critical issue: selection bias of reasoning…

人工智能 · 计算机科学 2025-09-24 Zongqian Wu , Baoduo Xu , Tianyu Li , Zhu Sun , Xiaofeng Zhu , Lei Feng

Test-time scaling (TTS) has recently emerged as a promising direction to exploit the hidden reasoning capabilities of pre-trained large language models (LLMs). However, existing scaling methods narrowly focus on the compute-optimal…

性能 · 计算机科学 2025-09-25 Youpeng Zhao , Jinpeng LV , Di Wu , Jun Wang , Christopher Gooley

Large Language Models (LLMs) have demonstrated remarkable progress in reasoning across diverse domains. However, effective reasoning in real-world tasks requires adapting the reasoning strategy to the demands of the problem, ranging from…

计算与语言 · 计算机科学 2025-08-19 Xinda Jia , Jinpeng Li , Zezhong Wang , Jingjing Li , Xingshan Zeng , Yasheng Wang , Weinan Zhang , Yong Yu , Weiwen Liu

The rapid advancement of large language models (LLMs) has enabled an emergence of agentic artificial intelligence (AI) with powerful reasoning and autonomous decision-making capabilities. This integration with edge computing has led to the…

人工智能 · 计算机科学 2026-02-10 Mingyi Luo , Ruichen Zhang , Xiangwang Hou , Jun Du , Chunxiao Jiang , Yong Ren , Dusit Niyato , Shiwen Mao

Recent Large Language Models (LLMs) such as OpenAI o3-mini and DeepSeek-R1 use enhanced reasoning through Chain-of-Thought (CoT). Their potential in hardware design, which relies on expert-driven iterative optimization, remains unexplored.…

人工智能 · 计算机科学 2025-04-15 Luca Collini , Andrew Hennessee , Ramesh Karri , Siddharth Garg

Large Language Models (LLMs) have demonstrated remarkable capabilities in complex tasks. Recent advancements in Large Reasoning Models (LRMs), such as OpenAI o1 and DeepSeek-R1, have further improved performance in System-2 reasoning…

Edge intelligence paradigm is increasingly demanded by the emerging autonomous systems, such as robotics. Beyond ensuring privacy-preserving operation and resilience in connectivity-limited environments, edge deployment offers significant…

分布式、并行与集群计算 · 计算机科学 2025-11-05 Benjamin Kubwimana , Qijing Huang
‹ 上一页 1 2 3 10 下一页 ›