中文
相关论文

相关论文: LiveThinking: Enabling Real-Time Efficient Reasoni…

200 篇论文

Large language models (LLMs) empowered by chain-of-thought reasoning have achieved impressive accuracy on complex tasks but suffer from excessive inference costs and latency when applied uniformly to all problems. We propose SABER…

计算与语言 · 计算机科学 2025-08-15 Kai Zhao , Yanjun Zhao , Jiaming Song , Shien He , Lusheng Zhang , Qiang Zhang , Tianjiao Li

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

机器学习 · 计算机科学 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

Query-service relevance prediction in e-commerce search systems faces strict latency requirements that prevent the direct application of Large Language Models (LLMs). To bridge this gap, we propose a two-stage reasoning distillation…

信息检索 · 计算机科学 2026-01-27 Runze Xia , Yupeng Ji , Yuxi Zhou , Haodong Liu , Teng Zhang , Piji Li

Human cognition operates through two complementary modes: fast intuitive thinking and slow deliberate thinking. Vanilla large language models (LLMs) predominantly follow the fast-thinking paradigm, producing immediate responses; while…

人工智能 · 计算机科学 2026-01-07 Shengjia Zhang , Junjie Wu , Jiawei Chen , Changwang Zhang , Zhe Li , Xingyu Lou , Wangchunshu Zhou , Sheng Zhou , Can Wang , Jun Wang

While Large Language Models (LLMs) have emerged with remarkable capabilities in complex tasks through Chain-of-Thought reasoning, practical resource constraints have sparked interest in transferring these abilities to smaller models.…

计算与语言 · 计算机科学 2026-01-08 Jin Cui , Jiaqi Guo , Jiepeng Zhou , Ruixuan Yang , Jiayi Lu , Jiajun Xu , Jiangcheng Song , Boran Zhao , Pengju Ren

Recent advances in test-time scaling have led to the emergence of thinking LLMs that exhibit self-reflective behaviors and multi-step reasoning. While RL drives this self-improvement paradigm, a recent study (Gandhi et al., 2025) shows that…

人工智能 · 计算机科学 2025-08-22 Aswin RRV , Jacob Dineen , Divij Handa , Md Nayem Uddin , Mihir Parmar , Chitta Baral , Ben Zhou

Existing reasoning segmentation approaches typically fine-tune multimodal large language models (MLLMs) using image-text pairs and corresponding mask labels. However, they exhibit limited generalization to out-of-distribution scenarios…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Song Wang , Gongfan Fang , Lingdong Kong , Xiangtai Li , Jianyun Xu , Sheng Yang , Qiang Li , Jianke Zhu , Xinchao Wang

Large Reasoning Models (LRMs) have achieved impressive performance on challenging tasks, yet their deep reasoning often incurs substantial computational costs. To achieve efficient reasoning, existing reinforcement learning methods still…

Large Reasoning Models (LRMs) often suffer from overthinking, generating verbose reasoning traces that compromise both computational efficiency and interpretability. Unlike prior efforts that rely on global length-based rewards, we propose…

Large language models (LLMs) increasingly rely on thinking models that externalize intermediate steps and allocate extra test-time compute, with think-twice strategies showing that a deliberate second pass can elicit stronger reasoning. In…

计算与语言 · 计算机科学 2026-01-30 Yizhu Jiao , Jiaqi Zeng , Julien Veron Vialard , Oleksii Kuchaiev , Jiawei Han , Olivier Delalleau

Despite recent advancements in large language models (LLMs), their performance on complex reasoning problems requiring multi-step thinking and combining various skills is still limited. To address this, we propose a novel framework HDFlow…

计算与语言 · 计算机科学 2024-09-27 Wenlin Yao , Haitao Mi , Dong Yu

Reinforcement learning with verifiable rewards (RLVR) has demonstrated superior performance in enhancing the reasoning capability of large language models (LLMs). However, this accuracy-oriented learning paradigm often suffers from entropy…

人工智能 · 计算机科学 2026-01-19 Hongye Cao , Zhixin Bai , Ziyue Peng , Boyan Wang , Tianpei Yang , Jing Huo , Yuyao Zhang , Yang Gao

Recent advancements in large language models (LLMs) have demonstrated impressive chain-of-thought reasoning capabilities, with reinforcement learning (RL) playing a crucial role in this progress. While "aha moment" patterns--where models…

计算与语言 · 计算机科学 2025-07-24 Lai Wei , Yuting Li , Kaipeng Zheng , Chen Wang , Yue Wang , Linghe Kong , Lichao Sun , Weiran Huang

Feedback-driven optimization, such as traditional machine learning training, is a static process that lacks real-time adaptability of hyperparameters. Tuning solutions for optimization require trial and error paired with checkpointing and…

机器学习 · 计算机科学 2024-05-14 Soheil Zibakhsh Shabgahi , Nojan Sheybani , Aiden Tabrizi , Farinaz Koushanfar

Hybrid thinking enables LLMs to switch between reasoning and direct answering, offering a balance between efficiency and reasoning capability. Yet our experiments reveal that current hybrid thinking LLMs only achieve partial mode…

机器学习 · 计算机科学 2025-10-15 Shouren Wang , Wang Yang , Xianxuan Long , Qifan Wang , Vipin Chaudhary , Xiaotian Han

Recent advancements in Large Language Models (LLMs) have significantly enhanced their ability to perform complex reasoning tasks, transitioning from fast and intuitive thinking (System 1) to slow and deep reasoning (System 2). While System…

计算与语言 · 计算机科学 2025-04-01 Rui Wang , Hongru Wang , Boyang Xue , Jianhui Pang , Shudong Liu , Yi Chen , Jiahao Qiu , Derek Fai Wong , Heng Ji , Kam-Fai Wong

Large Language Models (LLMs) have demonstrated remarkable capabilities in complex tasks. Recent advancements in Large Reasoning Models (LRMs), such as OpenAI o1 and DeepSeek-R1, have further improved performance in System-2 reasoning…

Being prompted to engage in reasoning has emerged as a core technique for using large language models (LLMs), deploying additional inference-time compute to improve task performance. However, as LLMs increase in both size and adoption,…

计算与语言 · 计算机科学 2025-06-25 C. Nicolò De Sabbata , Theodore R. Sumers , Badr AlKhamissi , Antoine Bosselut , Thomas L. Griffiths

We present ThinkPrune, a simple yet effective method for pruning the thinking length for long-thinking LLMs, which has been found to often produce inefficient and redundant thinking processes. Existing preliminary explorations of reducing…

计算与语言 · 计算机科学 2025-04-03 Bairu Hou , Yang Zhang , Jiabao Ji , Yujian Liu , Kaizhi Qian , Jacob Andreas , Shiyu Chang

Enhancing the reasoning capabilities of Large Language Models (LLMs) with efficiency and scalability remains a fundamental challenge in artificial intelligence research. This paper presents a rigorous experimental investigation into how…

计算与语言 · 计算机科学 2025-04-02 Yunjie Ji , Sitong Zhao , Xiaoyu Tian , Haotian Wang , Shuaiting Chen , Yiping Peng , Han Zhao , Xiangang Li