中文
相关论文

相关论文: Reinforced MLLM: A Survey on RL-Based Reasoning in…

200 篇论文

We introduce MediX-R1, an open-ended Reinforcement Learning (RL) framework for medical multimodal large language models (MLLMs) that enables clinically grounded, free-form answers beyond multiple-choice formats. MediX-R1 fine-tunes a…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Sahal Shaji Mullappilly , Mohammed Irfan Kurpath , Omair Mohamed , Mohamed Zidan , Fahad Khan , Salman Khan , Rao Anwer , Hisham Cholakkal

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for post-training large language models (LLMs), achieving state-of-the-art performance on tasks with structured, verifiable answers. Applying…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Yiqing Liang , Jielin Qiu , Wenhao Ding , Zuxin Liu , James Tompkin , Mengdi Xu , Mengzhou Xia , Zhengzhong Tu , Laixi Shi , Jiacheng Zhu

The emergence of large language models (LLMs) has revolutionized machine learning and related fields, showcasing remarkable abilities in comprehending, generating, and manipulating human language. However, their conventional usage through…

Standing in 2025, at a critical juncture in the pursuit of Artificial General Intelligence (AGI), reinforcement fine-tuning (RFT) has demonstrated significant potential in enhancing the reasoning capability of large language models (LLMs)…

计算与语言 · 计算机科学 2025-05-27 Haoyuan Sun , Jiaqi Wu , Bo Xia , Yifu Luo , Yifei Zhao , Kai Qin , Xufei Lv , Tiantian Zhang , Yongzhe Chang , Xueqian Wang

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored. To address this gap, we introduce a novel benchmark that…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Mingwei Zhu , Leigang Sha , Yu Shu , Kangjia Zhao , Tiancheng Zhao , Jianwei Yin

In recent years, multimodal large language models (MLLMs) have shown remarkable capabilities in tasks like visual question answering and common sense reasoning, while visual perception models have made significant strides in perception…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Guanqun Wang , Xinyu Wei , Jiaming Liu , Ray Zhang , Yichi Zhang , Kevin Zhang , Maurice Chong , Shanghang Zhang

We introduce SAIL-RL, a reinforcement learning (RL) post-training framework that enhances the reasoning capabilities of multimodal large language models (MLLMs) by teaching them when and how to think. Existing approaches are limited by…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Fangxun Shu , Yongjie Ye , Yue Liao , Zijian Kang , Weijie Yin , Jiacong Wang , Xiao Liang , Shuicheng Yan , Chao Feng

Large language models (LLMs) have recently shown remarkable performance in language tasks and beyond. However, due to their limited inherent causal reasoning ability, LLMs still face challenges in handling tasks that require robust causal…

计算与语言 · 计算机科学 2025-03-13 Xin Li , Zhuo Cai , Shoujin Wang , Kun Yu , Fang Chen

Large Language Models (LLMs) encapsulate an extensive amount of world knowledge, and this has enabled their application in various domains to improve the performance of a variety of Natural Language Processing (NLP) tasks. This has also…

人工智能 · 计算机科学 2024-04-30 Sina Gholamian , Domingo Huh

Reinforcement Learning with Verifiable Rewards(RLVR) has demonstrated great potential in enhancing the reasoning capabilities of large language models (LLMs). However, its success has thus far been largely confined to the mathematical and…

人工智能 · 计算机科学 2026-02-05 Mengyu Zhang , Siyu Ding , Weichong Yin , Yu Sun , Hua Wu

Designing effective reward functions remains a fundamental challenge in reinforcement learning (RL), as it often requires extensive human effort and domain expertise. While RL from human feedback has been successful in aligning agents with…

机器学习 · 计算机科学 2025-06-17 Tung Minh Luu , Younghwan Lee , Donghoon Lee , Sunho Kim , Min Jun Kim , Chang D. Yoo

In this work, we aim to incentivize the reasoning ability of Multimodal Large Language Models (MLLMs) via reinforcement learning (RL) and develop an effective approach that mitigates the sparse reward and advantage vanishing issues during…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Huanjin Yao , Qixiang Yin , Jingyi Zhang , Min Yang , Yibo Wang , Wenhao Wu , Fei Su , Li Shen , Minghui Qiu , Dacheng Tao , Jiaxing Huang

Reinforcement Learning with Verifiable Rewards (RLVR) plays a key role in stimulating the explicit reasoning capability of Large Language Models (LLMs). We can achieve expert-level performance in some specific domains via RLVR, such as…

人工智能 · 计算机科学 2026-03-12 Haoqing Wang , Xiang Long , Ziheng Li , Yilong Xu , Tingguang Li , Yehui Tang

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

人工智能 · 计算机科学 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

机器学习 · 计算机科学 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

Post-training with Reinforcement Learning (RL) has substantially improved reasoning in Large Language Models (LLMs) via test-time scaling. However, extending this paradigm to Multimodal LLMs (MLLMs) through verbose rationales yields limited…

计算与语言 · 计算机科学 2026-02-16 Bangzheng Li , Jianmo Ni , Chen Qu , Ian Miao , Liu Yang , Xingyu Fu , Muhao Chen , Derek Zhiyuan Cheng

DeepSeek-R1-Zero has successfully demonstrated the emergence of reasoning capabilities in LLMs purely through Reinforcement Learning (RL). Inspired by this breakthrough, we explore how RL can be utilized to enhance the reasoning capability…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Wenxuan Huang , Bohan Jia , Zijie Zhai , Shaosheng Cao , Zheyu Ye , Fei Zhao , Zhe Xu , Xu Tang , Yao Hu , Shaohui Lin

Efficiently acquiring external knowledge and up-to-date information is essential for effective reasoning and text generation in large language models (LLMs). Prompting advanced LLMs with reasoning capabilities to use search engines during…

计算与语言 · 计算机科学 2025-08-07 Bowen Jin , Hansi Zeng , Zhenrui Yue , Jinsung Yoon , Sercan Arik , Dong Wang , Hamed Zamani , Jiawei Han

Language serves as a vehicle for conveying thought, enabling communication among individuals. The ability to distinguish between diverse concepts, identify fairness and injustice, and comprehend a range of legal notions fundamentally relies…

计算与语言 · 计算机科学 2023-11-23 Ha-Thanh Nguyen , Wachara Fungwacharakorn , Ken Satoh

Recent advancements in large language models (LLMs) have demonstrated substantial progress in reasoning capabilities, such as DeepSeek-R1, which leverages rule-based reinforcement learning to enhance logical reasoning significantly.…