English
Related papers

Related papers: Forge: Quality-Aware Reinforcement Learning for NP…

200 papers

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

Artificial Intelligence · Computer Science 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising approach for training reasoning language models (RLMs) by leveraging supervision from verifiers. Although verifier implementation is easier than solution…

Artificial Intelligence · Computer Science 2026-02-24 Andre He , Nathaniel Weir , Kaj Bostrom , Allen Nie , Darion Cassel , Sam Bayless , Huzefa Rangwala

Large language models (LLMs) have demonstrated their remarkable performance across various language understanding tasks. While emerging benchmarks have been proposed to evaluate LLMs in various domains such as mathematics and computer…

Artificial Intelligence · Computer Science 2024-10-28 Junnan Dong , Zijin Hong , Yuanchen Bei , Feiran Huang , Xinrun Wang , Xiao Huang

While Large Language Models (LLMs) demonstrate remarkable reasoning, complex optimization tasks remain challenging, requiring domain knowledge and robust implementation. However, existing benchmarks focus narrowly on Mathematical…

Computation and Language · Computer Science 2026-04-24 Xinyu Zhang , Boxuan Zhang , Yuchen Wan , Lingling Zhang , YiXing Yao , Bifan Wei , Yaqiang Wu , Jun Liu

Reinforcement learning (RL) has demonstrated strong potential in training large language models (LLMs) capable of complex reasoning for real-world problem solving. More recently, RL has been leveraged to create sophisticated LLM-based…

Computation and Language · Computer Science 2025-05-22 Bowen Jin , Jinsung Yoon , Priyanka Kargupta , Sercan O. Arik , Jiawei Han

Reinforcement Learning (RL) has shown great potential in refining robotic manipulation policies, yet its efficacy remains strongly bottlenecked by the difficulty of designing generalizable reward functions. In this paper, we propose a…

Robotics · Computer Science 2026-03-24 Yanru Wu , Weiduo Yuan , Ang Qi , Vitor Guizilini , Jiageng Mao , Yue Wang

The integration of large language models (LLMs) into medical practice offers transformative potential, yet their real-world clinical applicability remains constrained by critical alignment issues: (1) a misalignment between static…

Artificial Intelligence · Computer Science 2025-12-05 Yongnan Jin , Xurui Li , Feng Cao , Liucun Gao , Juanjuan Yao

Reinforcement learning with verifiable rewards (RLVR) has become a key technique for enhancing LLMs' reasoning abilities, yet its data inefficiency remains a major bottleneck. To address this critical yet challenging issue, we present a…

Machine Learning · Computer Science 2026-04-28 Shipeng Li , Zhiqin Yang , Shikun Li , Xiaobo Xia , Hengyu Liu , Xinghua Zhang , Gaode Chen , Dong Fang , Ying Tai , Zhe Peng

Reinforcement learning with verifiable rewards (RLVR) scales the reasoning ability of large language models (LLMs) but remains bottlenecked by limited labeled samples for continued data scaling. Reinforcement learning with intrinsic rewards…

Machine Learning · Computer Science 2025-10-13 Chuyi Tan , Peiwen Yuan , Xinglin Wang , Yiwei Li , Shaoxiong Feng , Yueqi Zhang , Jiayi Shi , Ji Zhang , Boyuan Pan , Yao Hu , Kan Li

Reinforcement learning from verifiable rewards (RLVR) is a promising paradigm for improving large language model (LLM) agents on long-horizon interactive tasks. However, in partially observable environments, incomplete observations cause…

Computation and Language · Computer Science 2026-05-20 Wenjie Tang , Minne Li , Sijie Huang , Liquan Xiao , Yuan Zhou

Reinforcement Learning with Verifiable Rewards (RLVR) has been successfully applied to significantly boost the capabilities of pretrained large language models, especially in the math and logic problem domains. However, current research and…

Computation and Language · Computer Science 2026-03-16 Konstantin Dobler , Simon Lehnerer , Federico Scozzafava , Jonathan Janke , Mohamed Ali

Reinforcement Learning (RL) has enabled Large Language Models (LLMs) to achieve remarkable reasoning in domains like mathematics and coding, where verifiable rewards provide clear signals. However, extending this paradigm to financial…

Artificial Intelligence · Computer Science 2026-01-09 Rui Sun , Yifan Sun , Sheng Xu , Li Zhao , Jing Li , Daxin Jiang , Cheng Hua , Zuo Bai

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), yet how visual evidence is integrated during reasoning remains poorly understood. We…

Artificial Intelligence · Computer Science 2026-02-13 Zhengbo Jiao , Shaobo Wang , Zifan Zhang , Wei Wang , Bing Zhao , Hu Wei , Linfeng Zhang

Reinforcement learning with verifiable rewards (RLVR) is a simple but powerful paradigm for training LLMs: sample a completion, verify it, and update. In practice, however, the verifier is almost never clean--unit tests probe only limited…

Machine Learning · Computer Science 2026-01-09 Ali Rad , Khashayar Filom , Darioush Keivan , Peyman Mohajerin Esfahani , Ehsan Kamalinejad

Reinforcement Learning from Verifiable Rewards (RLVR) has been widely adopted as the de facto method for enhancing the reasoning capabilities of large language models and has demonstrated notable success in verifiable domains like math and…

Computation and Language · Computer Science 2025-06-24 Jeff Da , Clinton Wang , Xiang Deng , Yuntao Ma , Nikhil Barhate , Sean Hendryx

Large Language Models (LLMs) have recently improved mathematical reasoning through Reinforcement Learning with Verifiable Reward (RLVR). However, existing RLVR algorithms require large query budgets, making annotation costly. We investigate…

Artificial Intelligence · Computer Science 2026-02-02 Hao Yi , Yulan Hu , Xin Li , Sheng Ouyang , Lizhong Ding , Yong Liu

Enhancing the reasoning capabilities of Large Language Models (LLMs) with efficiency and scalability remains a fundamental challenge in artificial intelligence research. This paper presents a rigorous experimental investigation into how…

Computation and Language · Computer Science 2025-04-02 Yunjie Ji , Sitong Zhao , Xiaoyu Tian , Haotian Wang , Shuaiting Chen , Yiping Peng , Han Zhao , Xiangang Li

Large Language Models (LLMs) have demonstrated remarkable progress in complex reasoning tasks through both post-training and test-time scaling laws. While prevalent test-time scaling approaches are often realized by using external reward…

Machine Learning · Computer Science 2025-10-31 Fuxiang Zhang , Jiacheng Xu , Chaojie Wang , Ce Cui , Yang Liu , Bo An

While recent advances have boosted LM proficiency in linguistic benchmarks, LMs consistently struggle to reason correctly on complex tasks like mathematics. We turn to Reinforcement Learning from Human Feedback (RLHF) as a method with which…

Computation and Language · Computer Science 2023-11-13 Sarah Pan , Vladislav Lialin , Sherin Muckatira , Anna Rumshisky

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a powerful approach to enhancing the reasoning capabilities of Large Language Models (LLMs), while its mechanisms are not yet well understood. In this work, we undertake a…