中文
相关论文

相关论文: Dual-Uncertainty Guided Policy Learning for Multim…

200 篇论文

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

计算机视觉与模式识别 · 计算机科学 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Reinforcement learning from verifiable rewards (RLVR) suffers from sparse outcome signals, creating severe exploration bottlenecks on complex reasoning tasks. Recent on-policy self-distillation methods attempt to address this by utilizing…

机器学习 · 计算机科学 2026-05-20 Yang Li , Erik Nijkamp , Semih Yavuz , Shafiq Joty

Reinforcement learning with verifiable rewards (RLVR) has become an effective paradigm for improving reasoning language models on tasks such as mathematics, coding, and scientific question answering. However, widely used group-relative…

计算与语言 · 计算机科学 2026-05-29 Redacted by arXiv

Aligning Large Language Models (LLMs) to human preferences in content, style, and presentation is challenging, in part because preferences are varied, context-dependent, and sometimes inherently ambiguous. While successful, Reinforcement…

机器学习 · 计算机科学 2024-10-29 Sam Houliston , Alizée Pace , Alexander Immer , Gunnar Rätsch

Visuomotor robot policies, increasingly pre-trained on large-scale datasets, promise significant advancements across robotics domains. However, aligning these policies with end-user preferences remains a challenge, particularly when the…

机器人学 · 计算机科学 2024-12-09 Ran Tian , Yilin Wu , Chenfeng Xu , Masayoshi Tomizuka , Jitendra Malik , Andrea Bajcsy

Reinforcement Learning with Verifiable Rewards (RLVR) demonstrates significant potential in enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing RLVR methods are often constrained by issues such as…

人工智能 · 计算机科学 2026-01-14 Jinpeng Wang , Chao Li , Ting Ye , Mengyuan Zhang , Wei Liu , Jian Luan

Reinforcement Learning with Verifiable Reward (RLVR) has proven effective in improving Large Language Model's (LLM) reasoning ability. However, the learning dynamics of RLVR remain underexplored. In this paper, we reveal a counterintuitive…

机器学习 · 计算机科学 2026-05-19 Yulin Chen , He He , Chen Zhao

Reinforcement learning with verifiable reward has recently emerged as a central paradigm for post-training large language models (LLMs); however, prevailing mean-based methods, such as Group Relative Policy Optimization (GRPO), suffer from…

Reinforcement Learning (RL) methods have emerged as a popular choice for training an efficient and effective dialogue policy. However, these methods suffer from sparse and unstable reward signals returned by a user simulator only when a…

人工智能 · 计算机科学 2020-09-18 Ziming Li , Sungjin Lee , Baolin Peng , Jinchao Li , Julia Kiseleva , Maarten de Rijke , Shahin Shayandeh , Jianfeng Gao

Existing Reinforcement Learning from Verifiable Rewards (RLVR) methods, such as Group Relative Policy Optimization (GRPO), have achieved remarkable progress in improving the reasoning capabilities of Large Reasoning Models (LRMs). However,…

机器学习 · 计算机科学 2026-04-16 Hsiu-Yuan Huang , Chenming Tang , Weijie Liu , Clive Bai , Saiyong Yang , Yunfang Wu

Robust reinforcement learning (RRL) aims at seeking a robust policy to optimize the worst case performance over an uncertainty set of Markov decision processes (MDPs). This set contains some perturbed MDPs from a nominal MDP (N-MDP) that…

机器学习 · 计算机科学 2023-11-21 Ukjo Hwang , Songnam Hong

Video reasoning has advanced with large multimodal models (LMMs), yet their inference is often a single pass that returns an answer without verifying whether the reasoning is evidence-aligned. We introduce Reinforce to Learn, Elect to…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Songyuan Yang , Weijiang Yu , Jilin Ma , Ziyu Liu , Guijian Tang , Wenjing Yang , Huibin Tan , Nong Xiao

While Reinforcement Learning (RL) shows promise in training tool-use Large Language Models (LLMs) using verifiable outcome rewards, existing methods largely overlook the potential of reasoning rewards based on chain-of-thought quality for…

计算与语言 · 计算机科学 2026-01-16 Zihan Lin , Xiaohan Wang , Hexiong Yang , Jiajun Chai , Jie Cao , Guojun Yin , Wei Lin , Ran He

Reinforcement Learning with Verifiable Reward (RLVR) has significantly advanced the complex reasoning abilities of Large Language Models (LLMs). However, it struggles to break through the inherent capability boundaries of the base LLM, due…

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a powerful paradigm for enhancing the reasoning capabilities of LLMs. Existing research has predominantly concentrated on isolated reasoning domains such as mathematical…

人工智能 · 计算机科学 2025-07-24 Yu Li , Zhuoshi Pan , Honglin Lin , Mengyuan Sun , Conghui He , Lijun Wu

Recent advancements in long chain-of-thought (CoT) reasoning, particularly through the Group Relative Policy Optimization algorithm used by DeepSeek-R1, have led to significant interest in the potential of Reinforcement Learning with…

人工智能 · 计算机科学 2025-10-03 Xumeng Wen , Zihan Liu , Shun Zheng , Shengyu Ye , Zhirong Wu , Yang Wang , Zhijian Xu , Xiao Liang , Junjie Li , Ziming Miao , Jiang Bian , Mao Yang

Deep reinforcement learning (RL) has shown remarkable success in complex domains, however, the inherent black box nature of deep neural network policies raises significant challenges in understanding and trusting the decision-making…

机器学习 · 计算机科学 2025-01-20 Peilang Li , Umer Siddique , Yongcan Cao

Reinforcement learning (RL) has proven effective in strengthening the reasoning capabilities of large language models (LLMs). A widely adopted method, Group Relative Policy Optimization (GRPO), has shown strong empirical results in training…

机器学习 · 计算机科学 2026-03-11 Peter Chen , Xiaopeng Li , Ziniu Li , Xi Chen , Tianyi Lin

Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) is a powerful approach to solving Markov Decision Processes (MDPs) when the model of the environment is not known a priori. However, RL models are still faced with challenges…

系统与控制 · 电气工程与系统科学 2024-06-04 Kabirat Olayemi , Mien Van , Luke Maguire , Sean McLoone

Understanding real-world videos with complex semantics and long temporal dependencies remains a fundamental challenge in computer vision. Recent progress in multimodal large language models (MLLMs) has demonstrated strong capabilities in…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Hongyu Li , Songhao Han , Yue Liao , Junfeng Luo , Jialin Gao , Shuicheng Yan , Si Liu