中文
相关论文

相关论文: SoTA with Less: MCTS-Guided Sample Selection for D…

200 篇论文

Recent advancements in Multimodal Large Language Models (MLLMs), particularly through Reinforcement Learning with Verifiable Rewards (RLVR), have significantly enhanced their reasoning abilities. However, a critical gap persists: these…

Recently, slow-thinking systems like GPT-o1 and DeepSeek-R1 have demonstrated great potential in solving challenging problems through explicit reflection. They significantly outperform the best fast-thinking models, such as GPT-4o, on…

机器学习 · 计算机科学 2025-05-09 Haozhe Wang , Chao Qu , Zuming Huang , Wei Chu , Fangzhen Lin , Wenhu Chen

Increasing attention has been placed on improving the reasoning capacities of multi-modal large language models (MLLMs). As the cornerstone for AI agents that function in the physical realm, video-based visual-spatial intelligence (VSI)…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Zhenyi Liao , Qingsong Xie , Yanhao Zhang , Zijian Kong , Haonan Lu , Zhenyu Yang , Zhijie Deng

Mathematical reasoning is a cornerstone of artificial general intelligence and a primary benchmark for evaluating the capabilities of Large Language Models (LLMs). While state-of-the-art models show promise, they often falter when faced…

计算与语言 · 计算机科学 2025-07-29 Yifan Hao , Fangning Chao , Yaqian Hao , Zhaojun Cui , Huan Bai , Haiyu Zhang , Yankai Liu , Chao Deng , Junlan Feng

Outcome-reward reinforcement learning (RL) is a common and increasingly significant way to refine the step-by-step reasoning of multimodal large language models (MLLMs). In the multiple-choice setting - a dominant format for multimodal…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Jiahao Wang , Weiye Xu , Aijun Yang , Wengang Zhou , Lewei Lu , Houqiang Li , Xiaohua Wang , Jinguo Zhu

Multimodal Large Language Models (MLLMs) have shown promise in visual-textual reasoning, with Multimodal Chain-of-Thought (MCoT) prompting significantly enhancing interpretability. However, existing MCoT methods rely on rationale-rich…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Yiwen Jiang , Deval Mehta , Siyuan Yan , Yaling Shen , Zimu Wang , Zongyuan Ge

Large language models (LLMs) have made impressive progress in handling simple math problems, yet they still struggle with more challenging and complex mathematical tasks. In this paper, we introduce a series of LLMs that employs the…

计算与语言 · 计算机科学 2024-07-18 Chengpeng Li , Guanting Dong , Mingfeng Xue , Ru Peng , Xiang Wang , Dayiheng Liu

Test-time scaling (TTS) has emerged as a powerful paradigm for improving the reasoning ability of Large Language Models (LLMs) by allocating additional computation at inference, yet its application to multimodal systems such as…

Existing approaches to mathematical reasoning with large language models (LLMs) rely on Chain-of-Thought (CoT) for generalizability or Tool-Integrated Reasoning (TIR) for precise computation. While efforts have been made to combine these…

计算与语言 · 计算机科学 2026-02-13 Xin Xu , Yan Xu , Tianhao Chen , Yuchen Yan , Chengwu Liu , Zaoyu Chen , Yufei Wang , Yichun Yin , Yasheng Wang , Lifeng Shang , Qun Liu , Lu Yin

Compressing long chain-of-thought (CoT) from large language models (LLMs) is an emerging strategy to improve the reasoning efficiency of LLMs. Despite its promising benefits, existing studies equally compress all thoughts within a long CoT,…

计算与语言 · 计算机科学 2025-05-27 Yansong Ning , Wei Li , Jun Fang , Naiqiang Tan , Hao Liu

Recent advances have shown success in eliciting strong reasoning abilities in multimodal large language models (MLLMs) through rule-based reinforcement learning (RL) with outcome rewards. However, this paradigm typically lacks supervision…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Kaixuan Fan , Kaituo Feng , Haoming Lyu , Dongzhan Zhou , Xiangyu Yue

Multi-modal large language models (MLLMs) exhibit strong general-purpose capabilities, yet still struggle on Fine-Grained Visual Classification (FGVC), a core perception task that requires subtle visual discrimination and is crucial for…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Jie Zhu , Yiyang Su , Xiaoming Liu

Reinforcement Learning Finetuning (RFT) has significantly advanced the reasoning capabilities of large language models (LLMs) by enabling long chains of thought, self-correction, and effective tool use. While recent works attempt to extend…

Despite rapid advancements in large language models (LLMs), the token-level autoregressive nature constrains their complex reasoning capabilities. To enhance LLM reasoning, inference-time techniques, including…

人工智能 · 计算机科学 2026-01-28 Qianyue Hao , Sibo Li , Jian Yuan , Yong Li

Large Language Models (LLMs) can achieve enhanced complex problem-solving through test-time computing scaling, yet this often entails longer contexts and numerous reasoning token costs. In this paper, we propose an efficient test-time…

计算与语言 · 计算机科学 2025-04-02 Zhaojian Yu , Yinghao Wu , Yilun Zhao , Arman Cohan , Xiao-Ping Zhang

Reinforcement Learning (RL) has shown promise in improving the reasoning abilities of Large Language Models (LLMs). However, the specific challenges of adapting RL to multimodal data and formats remain relatively unexplored. In this work,…

机器学习 · 计算机科学 2025-05-20 Zirun Guo , Minjie Hong , Tao Jin

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

计算机视觉与模式识别 · 计算机科学 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

We introduce Motif-2-12.7B-Reasoning, a 12.7B parameter language model designed to bridge the gap between open-weight systems and proprietary frontier models in complex reasoning and long-context understanding. Addressing the common…

Recent advances in Vision-Language Models (VLMs) have benefited from Reinforcement Learning (RL) for enhanced reasoning. However, existing methods still face critical limitations, including the lack of low-level visual information and…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Zhiheng Wu , Tong Wang , Shuning Wang , Naiming Liu , Yumeng Zhang

Mainstream issue-resolving frameworks predominantly rely on commercial models, leading to high costs and privacy concerns. Existing training approaches for issue resolving struggle with poor generalization and fail to fully leverage…

软件工程 · 计算机科学 2025-02-28 Zexiong Ma , Chao Peng , Pengfei Gao , Xiangxin Meng , Yanzhen Zou , Bing Xie