中文
相关论文

相关论文: OpenDeepThink: Parallel Reasoning via Bradley-Terr…

200 篇论文

Recent Large Reasoning Models (LRMs), such as DeepSeek-R1 and OpenAI o1, have demonstrated strong performance gains by scaling up the length of Chain-of-Thought (CoT) reasoning during inference. However, a growing concern lies in their…

Test-time scaling methods improve the capabilities of large language models (LLMs) by increasing the amount of compute used during inference to make a prediction. Inference-time compute can be scaled in parallel by choosing among multiple…

Scaling pre-training compute has proven effective for achieving mulitlinguality, but does the same hold for test-time scaling? In this work, we introduce MCLM, a multilingual math benchmark featuring competition-level problems in 55…

计算与语言 · 计算机科学 2025-08-04 Guijin Son , Jiwoo Hong , Hyunwoo Ko , James Thorne

Recent advances in large language models (LLMs) have accelerated progress toward artificial general intelligence, with inference-time scaling emerging as a key technique. Contemporary approaches leverage either sequential reasoning…

计算与语言 · 计算机科学 2025-07-10 Zenan Xu , Zexuan Qiu , Guanhua Huang , Kun Li , Siheng Li , Chenchen Zhang , Kejiao Li , Qi Yi , Yuhao Jiang , Bo Zhou , Fengzong Lian , Zhanhui Kang

Large Language Models (LLMs) have achieved significant advances in reasoning tasks. A key approach is tree-based search with verifiers, which expand candidate reasoning paths and use reward models to guide pruning and selection. Although…

Large Language Models (LLMs) often rely on test-time scaling via parallel decoding (for example, 512 samples) to boost reasoning accuracy, but this incurs substantial compute. We introduce CoRefine, a confidence-guided self-refinement…

人工智能 · 计算机科学 2026-02-10 Chen Jin , Ryutaro Tanno , Tom Diethe , Philip Teare

Large reasoning models (LRMs) achieve strong performance via extended chain-of-thought (CoT) reasoning, yet suffer from excessive token consumption and high inference latency. Existing reinforcement learning (RL) approaches for CoT…

机器学习 · 计算机科学 2026-05-19 Tingcheng Bian , Yuzhe Zhang , Jing Jin , Jinchang Luo , MingQuan Cheng , Haiwei Wang , Wenyuan Jiang , Miaohui Wang

Temporal reasoning is pivotal for Large Language Models (LLMs) to comprehend the real world. However, existing works neglect the real-world challenges for temporal reasoning: (1) intensive temporal information, (2) fast-changing event…

人工智能 · 计算机科学 2025-10-09 Shaohang Wei , Wei Li , Feifan Song , Wen Luo , Tianyi Zhuang , Haochen Tan , Zhijiang Guo , Houfeng Wang

Recent advancements in Large Reasoning Models (LRMs), such as OpenAI's o1/o3 and DeepSeek-R1, have demonstrated remarkable performance in specialized reasoning tasks through human-like deliberative thinking and long chain-of-thought…

人工智能 · 计算机科学 2025-11-20 Weixiang Zhao , Xingyu Sui , Jiahe Guo , Yulin Hu , Yang Deng , Yanyan Zhao , Xuda Zhi , Yongbo Huang , Hao He , Wanxiang Che , Ting Liu , Bing Qin

Large language models (LLMs) have shown increasing capability in problem-solving and decision-making, largely based on the step-by-step chain-of-thought reasoning processes. However, evaluating these reasoning abilities has become…

Enabling LLMs to improve their outputs by using more test-time computation is a critical step towards building generally self-improving agents that can operate on open-ended natural language. In this paper, we study the scaling of…

机器学习 · 计算机科学 2024-08-07 Charlie Snell , Jaehoon Lee , Kelvin Xu , Aviral Kumar

Recent LLMs have significantly improved reasoning capabilities, primarily by including an explicit, lengthy Thinking process as part of generation. In this paper, we question whether this explicit thinking is necessary. Using the…

人工智能 · 计算机科学 2025-04-15 Wenjie Ma , Jingxuan He , Charlie Snell , Tyler Griggs , Sewon Min , Matei Zaharia

Many of the recent capabilities demonstrated by Large Language Models (LLMs) arise primarily from their ability to exploit contextual information. In this paper, we explore ways to improve reasoning capabilities of LLMs through (1)…

Small language models (SLMs) offer computational efficiency for scalable deployment, yet they often fall short of the reasoning power exhibited by their larger counterparts (LLMs). To mitigate this gap, current approaches invoke an LLM to…

计算与语言 · 计算机科学 2026-04-30 Wenxuan Ye , Yangyang Zhang , Xueli An , Georg Carle , Yunpu Ma

Test-time scaling (TTS) has been shown to improve the performance of large language models (LLMs) by sampling and aggregating diverse reasoning paths. However, existing research has overlooked a critical issue: selection bias of reasoning…

人工智能 · 计算机科学 2025-09-24 Zongqian Wu , Baoduo Xu , Tianyu Li , Zhu Sun , Xiaofeng Zhu , Lei Feng

Inference-time scaling has emerged as a powerful technique for enhancing the reasoning performance of Large Language Models (LLMs). However, existing approaches often rely on heuristic strategies for parallel sampling, lacking a principled…

机器学习 · 计算机科学 2025-12-22 Youkang Wang , Jian Wang , Rubing Chen , Xiao-Yong Wei

Large Reasoning Models (LRMs) achieve strong performance through explicit chain-of-thought reasoning but suffer from \textit{overthinking}: generating excessive reasoning tokens even for trivial queries. {Beyond inflating cost, overthinking…

As large language models (LLMs) are continuously being developed, their evaluation becomes increasingly important yet challenging. This work proposes Chain-of-Thought Hub, an open-source evaluation suite on the multi-step reasoning…

计算与语言 · 计算机科学 2023-05-30 Yao Fu , Litu Ou , Mingyu Chen , Yuhao Wan , Hao Peng , Tushar Khot

Large language models (LLMs) such as GPT-5 and Gemini 3 have pushed the frontier of automated reasoning and code generation. Yet current benchmarks emphasize accuracy and output quality, neglecting a critical dimension: efficiency of token…

计算与语言 · 计算机科学 2026-02-25 Zheng Du , Hao Kang , Song Han , Tushar Krishna , Ligeng Zhu

Large Language Model (LLM) agents can increasingly automate complex reasoning through Test-Time Scaling (TTS), iterative refinement guided by reward signals. However, many real-world tasks involve multi-stage pipeline whose final outcomes…

机器学习 · 计算机科学 2025-12-30 Shuyu Gan , James Mooney , Pan Hao , Renxiang Wang , Mingyi Hong , Qianwen Wang , Dongyeop Kang