中文
相关论文

相关论文: INTELLECT-2: A Reasoning Model Trained Through Glo…

200 篇论文

We introduce SAIL-RL, a reinforcement learning (RL) post-training framework that enhances the reasoning capabilities of multimodal large language models (MLLMs) by teaching them when and how to think. Existing approaches are limited by…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Fangxun Shu , Yongjie Ye , Yue Liao , Zijian Kang , Weijie Yin , Jiacong Wang , Xiao Liang , Shuicheng Yan , Chao Feng

We propose TraceRL, a trajectory-aware reinforcement learning framework for diffusion language models (DLMs) that incorporates preferred inference trajectory into post-training, and is applicable across different architectures. Equipped…

计算与语言 · 计算机科学 2025-09-09 Yinjie Wang , Ling Yang , Bowen Li , Ye Tian , Ke Shen , Mengdi Wang

Large Reasoning Models (LRMs) often suffer from the ``over-thinking'' problem, generating unnecessarily long reasoning on simple tasks. Some strategies have been proposed to mitigate this issue, such as length penalties or routing…

计算与语言 · 计算机科学 2025-10-16 Jian Xie , Zhendong Chu , Aoxiao Zhong , Kai Zhang , Mingzhe Han , Xing Fan , Jialie Shen , Qingsong Wen

The remarkable capabilities of modern large reasoning models are largely unlocked through post-training techniques such as supervised fine-tuning (SFT) and reinforcement learning (RL). However, the architectural mechanisms behind such…

人工智能 · 计算机科学 2026-04-15 Yein Park , Minbyul Jeong , Jaewoo Kang

Reinforcement learning (RL) has proven highly effective in eliciting the reasoning capabilities of large language models (LLMs). Inspired by this success, recent studies have explored applying similar techniques to vision-language models…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Yan Chen , Long Li , Teng Xi , Long Zeng , Jingdong Wang

Reinforcement Learning (RL) is a popular machine learning paradigm where intelligent agents interact with the environment to fulfill a long-term goal. Driven by the resurgence of deep learning, Deep RL (DRL) has witnessed great success over…

机器学习 · 计算机科学 2025-09-01 Yunpeng Qing , Shunyu Liu , Jie Song , Yang Zhou , Kaixuan Chen , Huiqiong Wang , Mingli Song

Multimodal large language models (MLLMs) have shown promising capabilities in reasoning tasks, yet still struggle with complex problems requiring explicit self-reflection and self-correction, especially compared to their unimodal text-based…

Given a question, a language model (LM) implicitly encodes a distribution over possible answers. In practice, post-training procedures for LMs often collapse this distribution onto a single dominant mode. While this is generally not a…

机器学习 · 计算机科学 2026-03-27 Isha Puri , Mehul Damani , Idan Shenfeld , Marzyeh Ghassemi , Jacob Andreas , Yoon Kim

The integration of reasoning, learning, and decision-making is key to build more general artificial intelligence systems. As a step in this direction, we propose a novel neural-logic architecture, called differentiable logic machine (DLM),…

人工智能 · 计算机科学 2023-07-07 Matthieu Zimmer , Xuening Feng , Claire Glanois , Zhaohui Jiang , Jianyi Zhang , Paul Weng , Dong Li , Jianye Hao , Wulong Liu

Large Reasoning Models (LRMs) demonstrate remarkable capabilities on complex tasks, exhibiting emergent, human-like thinking patterns. Despite their advances, we identify a fundamental limitation: current LRMs lack a dedicated meta-level…

人工智能 · 计算机科学 2025-08-26 Haonan Dong , Haoran Ye , Wenhao Zhu , Kehan Jiang , Guojie Song

Large Language Models (LLMs) have recently achieved remarkable progress by leveraging Reinforcement Learning and extended Chain-of-Thought (CoT) techniques. However, the challenge of performing efficient language reasoning--especially…

Reinforcement Learning (RL) has proven to be an effective post-training strategy for enhancing reasoning in vision-language models (VLMs). Group Relative Policy Optimization (GRPO) is a recent prominent method that encourages models to…

人工智能 · 计算机科学 2025-10-30 Jiaqi Wang , Kevin Qinghong Lin , James Cheng , Mike Zheng Shou

Instruction-driven image editing with unified multimodal generative models has advanced rapidly, yet their underlying visual reasoning remains limited, leading to suboptimal performance on reasoning-centric edits. Reinforcement learning…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Hengjia Li , Liming Jiang , Qing Yan , Yizhi Song , Hao Kang , Zichuan Liu , Xin Lu , Boxi Wu , Deng Cai

Reinforcement learning (RL) has become the dominant paradigm for improving the performance of language models on complex reasoning tasks. Despite the substantial empirical gains demonstrated by RL-based training methods like GRPO, a…

人工智能 · 计算机科学 2025-10-27 Jiayu Wang , Yifei Ming , Zixuan Ke , Caiming Xiong , Shafiq Joty , Aws Albarghouthi , Frederic Sala

We present PCL-Reasoner-V1.5, a 32-billion-parameter large language model (LLM) for mathematical reasoning. The model is built upon Qwen2.5-32B and refined via supervised fine-tuning (SFT) followed by reinforcement learning (RL). A central…

机器学习 · 计算机科学 2026-01-22 Yao Lu , Dengdong Fan , Jianzheng Nie , Fan Xu , Jie Chen , Bin Zhou , Yonghong Tian

While the ``deep reasoning'' paradigm has spurred significant advances in verifiable domains like mathematics, its application to open-ended, creative generation remains a critical challenge. The two dominant methods for instilling…

Large Language Models (LLMs) that can continually improve beyond their training budgets are able to solve increasingly difficult problems by adapting at test time, a property we refer to as extrapolation. However, standard reinforcement…

机器学习 · 计算机科学 2026-03-24 Ian Wu , Yuxiao Qu , Amrith Setlur , Aviral Kumar

While reasoning models (e.g., DeepSeek R1) trained with reinforcement learning (RL), excel in textual reasoning, they struggle in scenarios requiring structured problem-solving, such as geometric reasoning, concise computation, or complex…

计算与语言 · 计算机科学 2025-04-18 Jiazhan Feng , Shijue Huang , Xingwei Qu , Ge Zhang , Yujia Qin , Baoquan Zhong , Chengquan Jiang , Jinxin Chi , Wanjun Zhong

Reinforcement learning (RL) is an effective method of finding reasoning pathways in incomplete knowledge graphs (KGs). To overcome the challenges of a large action space, a self-supervised pre-training method is proposed to warm up the…

计算与语言 · 计算机科学 2025-04-17 Ying Ma , Owen Burns , Mingqiu Wang , Gang Li , Nan Du , Laurent El Shafey , Liqiang Wang , Izhak Shafran , Hagen Soltau

Enhancing the reasoning capabilities of Large Language Models (LLMs) with efficiency and scalability remains a fundamental challenge in artificial intelligence research. This paper presents a rigorous experimental investigation into how…

计算与语言 · 计算机科学 2025-04-02 Yunjie Ji , Sitong Zhao , Xiaoyu Tian , Haotian Wang , Shuaiting Chen , Yiping Peng , Han Zhao , Xiangang Li