English
Related papers

Related papers: Prioritizing the Best: Incentivizing Reliable Mult…

200 papers

Multimodal large language models (MLLMs) have rapidly advanced from perception tasks to complex multi-step reasoning, yet reinforcement learning with verifiable rewards (RLVR) often leads to spurious reasoning since only the final-answer…

Computation and Language · Computer Science 2026-04-21 Mengzhao Jia , Zhihan Zhang , Ignacio Cases , Zheyuan Liu , Meng Jiang , Peng Qi

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

Machine Learning · Computer Science 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

RL with Verifiable Rewards (RLVR) has emerged as a promising paradigm for improving the reasoning abilities of large language models (LLMs). Current methods rely primarily on policy optimization frameworks like PPO and GRPO, which follow…

Machine Learning · Computer Science 2025-09-30 Haoran He , Yuxiao Ye , Qingpeng Cai , Chen Hu , Binxing Jiao , Daxin Jiang , Ling Pan

Recent advances in large language models (LLMs) have demonstrated that reinforcement learning with verifiable rewards (RLVR) can significantly enhance reasoning abilities by directly optimizing correctness, rather than relying solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Minbin Huang , Runhui Huang , Chuanyang Zheng , Jingyao Li , Guoxuan Chen , Han Shi , Hong Cheng

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced the reasoning capabilities of Large Language Models (LLMs) by optimizing them against factual outcomes. However, this paradigm falters in long-context…

Computation and Language · Computer Science 2026-03-03 Guanzheng Chen , Michael Qizhe Shieh , Lidong Bing

Reinforcement learning has become a cornerstone for enhancing the reasoning capabilities of Large Language Models, where group-based approaches such as GRPO have emerged as efficient paradigms that optimize policies by leveraging…

Reinforcement Learning from Verifiable Rewards (RLVR) has recently shown that large language models (LLMs) can develop their own reasoning without direct supervision. However, applications in the medical domain, specifically for question…

Machine Learning · Computer Science 2025-09-22 Mirza Farhan Bin Tarek , Rahmatollah Beheshti

Reinforcement learning (RL) has become a standard paradigm for refining large language models (LLMs) beyond pre-training and instruction tuning. A prominent line of work is RL with verifiable rewards (RLVR), which leverages automatically…

Machine Learning · Computer Science 2025-09-23 Bonan Zhang , Zhongqi Chen , Bowen Song , Qinya Li , Fan Wu , Guihai Chen

Reinforcement learning with verifiable rewards (RLVR) has substantially enhanced the reasoning capabilities of multimodal large language models (MLLMs). However, existing RLVR approaches typically rely on outcome-driven optimization that…

Artificial Intelligence · Computer Science 2026-04-10 Ziqi Miao , Haonan Jia , Lijun Li , Chen Qian , Yuan Xiong , Wenting Yan , Jing Shao

Reinforcement learning with verifiable rewards (RLVR) has achieved remarkable success in logical reasoning tasks, yet whether large language model (LLM) alignment requires fundamentally different approaches remains unclear. Given the…

Artificial Intelligence · Computer Science 2026-03-12 Zhaowei Zhang , Xiaohan Liu , Xuekai Zhu , Junchao Huang , Ceyao Zhang , Zhiyuan Feng , Yaodong Yang , Xiaoyuan Yi , Xing Xie

While Reinforcement Learning with Verifiable Rewards (RLVR) is effective for deterministically checkable tasks, many vision-language tasks are partially verifiable, demanding multi-criteria supervision (e.g., perceptual details, reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ya-Qi Yu , Hao Wang , Fangyu Hong , Xiangyang Qu , Gaojie Wu , Qiaoyu Luo , Nuo Xu , Huixin Wang , Wuheng Xu , Yongxin Liao , Zihao Chen , Haonan Li , Ziming Li , Dezhi Peng , Minghui Liao , Jihao Wu , Haoyu Ren , Dandan Tu

Recent breakthroughs in large language models (LLMs) have fundamentally shifted recommender systems from discriminative to generative paradigms, where user behavior modeling is achieved by generating target items conditioned on historical…

Information Retrieval · Computer Science 2025-10-15 Junfei Tan , Yuxin Chen , An Zhang , Junguang Jiang , Bin Liu , Ziru Xu , Han Zhu , Jian Xu , Bo Zheng , Xiang Wang

Reinforcement Learning with Verifiable Rewards has recently advanced the capabilities of Large Language Models in complex reasoning tasks by providing explicit rule-based supervision. Among RLVR methods, GRPO and its variants have achieved…

Machine Learning · Computer Science 2026-03-11 Zepeng Zhai , Meilin Chen , Jiaxuan Zhao , Junlang Qian , Lei Shen , Yuan Lu

Reinforcement Learning with Verifiable Rewards (RLVR) replaces costly human labeling with automated verifiers. To reduce verifier hacking, many RLVR systems binarize rewards to $\{0,1\}$, but imperfect verifiers inevitably introduce…

Machine Learning · Computer Science 2026-05-25 Xin-Qiang Cai , Wei Wang , Feng Liu , Tongliang Liu , Gang Niu , Masashi Sugiyama

Large Reasoning Models (LRMs) with long chain-of-thought capabilities, optimized via reinforcement learning with verifiable rewards (RLVR), excel at objective reasoning tasks like mathematical problem solving and code generation. However,…

Computation and Language · Computer Science 2026-03-03 Yumeng Wang , Zhiyuan Fan , Jiayu Liu , Jen-tse Huang , Yi R. Fung

Reinforcement learning with verifiable rewards (RLVR) is a promising approach for training language models (LMs) on reasoning tasks that elicit emergent long chains of thought (CoTs). Unlike supervised learning, it updates the model using…

Computation and Language · Computer Science 2025-10-28 Xinyu Zhu , Mengzhou Xia , Zhepei Wei , Wei-Lin Chen , Danqi Chen , Yu Meng

Reinforcement Learning with Verifiable Rewards (RLVR) has catalyzed significant breakthroughs in complex LLM reasoning within verifiable domains, such as mathematics and programming. Recent efforts have sought to extend this paradigm to…

Machine Learning · Computer Science 2026-02-03 Zheng Zhang , Ao Lu , Yuanhao Zeng , Ziwei Shan , Jinjin Guo , Lufei Li , Yexin Li , Kan Ren

Inspired by the success of reinforcement learning (RL) in Large Language Model (LLM) training for domains like math and code, recent works have begun exploring how to train LLMs to use search engines more effectively as tools for…

Computation and Language · Computer Science 2026-02-05 Zhichao Xu , Zongyu Wu , Yun Zhou , Aosong Feng , Kang Zhou , Sangmin Woo , Kiran Ramnath , Yijun Tian , Xuan Qi , Weikang Qiu , Lin Lee Cheong , Haibo Ding

Reinforcement Learning with Verifiable Rewards (RLVR) has markedly improved the performance of Large Language Models (LLMs) on tasks requiring multi-step reasoning. However, most RLVR pipelines rely on sparse outcome-based rewards,…

Computation and Language · Computer Science 2026-02-13 Runquan Gui , Yafu Li , Xiaoye Qu , Ziyan Liu , Yeqiu Cheng , Yu Cheng

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for enhancing Large Language Models (LLMs) on complex reasoning tasks. However, existing methods suffer from an exploration dilemma: the sharply peaked initial…

Artificial Intelligence · Computer Science 2025-09-30 Yuhua Jiang , Jiawei Huang , Yufeng Yuan , Xin Mao , Yu Yue , Qianchuan Zhao , Lin Yan