English
Related papers

Related papers: Smooth Operator: Smooth Verifiable Reward Activate…

200 papers

Agentic reasoning models trained with multimodal reinforcement learning (MMRL) have become increasingly capable, yet they are almost universally optimized using sparse, outcome-based rewards computed based on the final answers. Richer…

Effective reward design is a central challenge in Reinforcement Learning (RL) for code generation. Mainstream test-suite-level outcome rewards enforce functional correctness but induce sparsity, while external Reward Models (RMs) provide…

Machine Learning · Computer Science 2026-05-27 Longwen Wang , Yirui Liu , Xuan'er Wu , Xiaohui Hu , Yuankai Fan , Kaidong Yu , Qizhen Weng , Wei Xi , Xuelong Li

Reinforcement learning with verifiable rewards (RLVR) has recently enhanced the reasoning capabilities of large language models (LLMs), particularly for mathematical problem solving. However, a fundamental limitation remains: as the…

Machine Learning · Computer Science 2025-11-03 Wenhao Deng , Long Wei , Chenglei Yu , Tailin Wu

Complex video reasoning remains a significant challenge for Multimodal Large Language Models (MLLMs), as current R1-based methodologies often prioritize text-centric reasoning derived from text-based and image-based developments. In video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Bo Fang , Yuxin Song , Qiangqiang Wu , Haoyuan Sun , Wenhao Wu , Antoni B. Chan

Recent large reasoning models (LRMs) driven by reinforcement learning algorithms (e.g., GRPO) have achieved remarkable performance on challenging reasoning tasks. However, these models suffer from overthinking, generating unnecessarily long…

Artificial Intelligence · Computer Science 2026-03-03 Gang Li , Yan Chen , Ming Lin , Tianbao Yang

Multi-modal Large Language Models (MLLMs) show promise in video understanding. However, their reasoning often suffers from thinking drift and weak temporal comprehension, even when enhanced by Reinforcement Learning (RL) techniques like…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Peiyao Wang , Haotian Xu , Noranart Vesdapunt , Rui Hou , Jingyi Zhang , Haibin Ling , Oleksandr Obiednikov , Ning Zhou , Kah Kuen Fu

Extending large language models (LLMs) to low-resource languages often incurs an "alignment tax": improvements in the target language come at the cost of catastrophic forgetting in general capabilities. We argue that this trade-off arises…

Computation and Language · Computer Science 2026-05-15 Zeli Su , Ziyin Zhang , Zhou Liu , Xuexian Song , Zhankai Xu , Longfei Zheng , Xiaolu Zhang , Rong Fu , Guixian Xu , Wentao Zhang

Reinforcement Learning with Verifiable Rewards (RLVR) has become a key paradigm to improve the reasoning capabilities of Multimodal Large Language Models (MLLMs). However, prevalent group-based algorithms such as GRPO require multi-rollout…

Machine Learning · Computer Science 2025-12-23 Rui Liu , Dian Yu , Lei Ke , Haolin Liu , Yujun Zhou , Zhenwen Liang , Haitao Mi , Pratap Tokekar , Dong Yu

We study a common challenge in reinforcement learning for large language models (LLMs): the Zero-Reward Assumption, where non-terminal actions (i.e., intermediate token generations) receive zero task-specific immediate reward, while only…

Machine Learning · Computer Science 2025-06-04 Shenghua He , Tian Xia , Xuan Zhou , Hui Wei

Reinforcement learning with verifiable rewards (RLVR) has become a central paradigm for improving reasoning and code generation in large language models, and GRPO-style training is widely adopted for its simplicity and effectiveness.…

Machine Learning · Computer Science 2026-05-07 Zhiyuan Zeng , Jiameng Huang , Zhangyue Yin , Jiashuo Liu , Ziniu Li , Bingrui Li , Yuhao Wu , Yining Zheng , Ge Zhang , Wenhao Huang , Xipeng Qiu

Reinforcement learning (RL), particularly GRPO, improves image generation quality significantly by comparing the relative performance of images generated within the same group. However, in the later stages of training, the model tends to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Henglin Liu , Huijuan Huang , Jing Wang , Chang Liu , Xiu Li , Xiangyang Ji

Medical vision-language models (VLMs) have rapidly advanced as general-purpose multimodal assistants, yet their deployment in 3D Computed Tomography (CT) analysis remains constrained by a persistent mismatch between optimization objectives…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Tianwei Lin , Zhongwei Qiu , Jie Cao , Jiang Liu , Wenjie Yan , Bo Zhang , Yu Zhong , Wenqiao Zhang , Yingda Xia , Ling Zhang

Group Relative Policy Optimization (GRPO) has proven effective in RLVR by using outcome-based rewards. While fine-grained dense rewards can theoretically improve performance, we reveal that under practical sampling budgets, Monte Carlo…

Machine Learning · Computer Science 2026-04-13 Fengwei Teng , Jinyi Bai , Xinhao Yao , Demi Ruohan Wang , Jiahao Zhao , Zhijiang Guo

Multimodal Large Language Models (MLLMs) excel in vision-language reasoning but often struggle with structured perception tasks requiring precise localization and robustness. We propose a reinforcement learning framework that augments Group…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Xu Jia

Reinforcement Learning with Verifiable Rewards (RLVR) has proven to be a highly effective strategy for endowing Large Language Models (LLMs) with robust multi-step reasoning abilities. However, its design and optimizations remain tailored…

Computation and Language · Computer Science 2026-04-15 Zhenhailong Wang , Xuehang Guo , Sofia Stoica , Haiyang Xu , Hongru Wang , Hyeonjeong Ha , Xiusi Chen , Yangyi Chen , Ming Yan , Fei Huang , Heng Ji

Most of the traditional Applicant Tracking Systems (ATS) depend on strict matching using keywords, where candidates that are highly qualified are many times disqualified because of minor semantic differences. In this article, the two-stage…

Machine Learning · Computer Science 2026-01-21 Shreyansh Jain , Madhav Singhvi , Shreya Rahul Jain , Pranav S , Dishaa Lokesh , Naren Chittibabu , Akash Anandhan

Group Relative Policy Optimization (GRPO) has recently emerged as an effective approach for improving the reasoning capabilities of large language models through online multi-objective reinforcement learning. While personalization on…

Machine Learning · Computer Science 2026-02-03 Ziyao Wang , Daeun Jung , Yexiao He , Guoheng Sun , Zheyu Shen , Myungjin Lee , Ang Li

Subject-driven image generation models face a fundamental trade-off between identity preservation (fidelity) and prompt adherence (editability). While online reinforcement learning (RL), specifically GPRO, offers a promising solution, we…

Machine Learning · Computer Science 2026-04-23 Ziwei Huang , Ying Shu , Hao Fang , Quanyu Long , Wenya Wang , Qiushi Guo , Tiezheng Ge , Leilei Gan

Generalization in partially observed markov decision processes (POMDPs) is critical for successful applications of visual reinforcement learning (VRL) in real scenarios. A widely used idea is to learn task-relevant representations that…

Machine Learning · Computer Science 2023-02-21 Jie Wang , Rui Yang , Zijie Geng , Zhihao Shi , Mingxuan Ye , Qi Zhou , Shuiwang Ji , Bin Li , Yongdong Zhang , Feng Wu

Vision-Language-Action (VLA) models aim to unify perception, language understanding, and action generation, offering strong cross-task and cross-scene generalization with broad impact on embodied AI. However, current VLA models often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Angen Ye , Zeyu Zhang , Boyuan Wang , Xiaofeng Wang , Dapeng Zhang , Zheng Zhu
‹ Prev 1 4 5 6 7 8 10 Next ›