English
Related papers

Related papers: A State-of-the-Art SQL Reasoning Model using RLVR

200 papers

Reinforcement learning with verifiable rewards (RLVR) has recently enhanced the reasoning capabilities of large language models (LLMs), particularly for mathematical problem solving. However, a fundamental limitation remains: as the…

Machine Learning · Computer Science 2025-11-03 Wenhao Deng , Long Wei , Chenglei Yu , Tailin Wu

Reinforcement Learning with Verifiable Rewards~(RLVR) has become a prominent paradigm to enhance the capabilities (i.e.\ long-context) of Large Language Models~(LLMs). However, it often relies on gold-standard answers or explicit evaluation…

Computation and Language · Computer Science 2026-03-03 Yao Xiao , Lei Wang , Yue Deng , Guanzheng Chen , Ziqi Jin , Jung-jae Kim , Xiaoli Li , Roy Ka-wei Lee , Lidong Bing

While Reinforcement Learning for Verifiable Rewards (RLVR) is powerful for training large reasoning models, its training dynamics harbor a critical challenge: RL overfitting, where models gain training rewards but lose generalization. Our…

Artificial Intelligence · Computer Science 2025-11-07 Zeng Zhiyuan , Jiashuo Liu , Zhangyue Yin , Ge Zhang , Wenhao Huang , Xipeng Qiu

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a promising approach to improve correctness in LLMs, however, in many scientific problems, the objective is not necessarily to produce the correct answer, but instead to…

Machine Learning · Computer Science 2025-12-23 Andy Xu , Rohan Desai , Larry Wang , Gabriel Hope , Ethan Ritz

In this work, we present the first application of Reinforcement Learning with Verifiable Reward (RLVR) to an Omni-multimodal large language model in the context of emotion recognition, a task where both visual and audio modalities play…

Machine Learning · Computer Science 2025-03-11 Jiaxing Zhao , Xihan Wei , Liefeng Bo

Recent studies posit that Reinforcement Learning with Verifiable Rewards (RLVR) primarily amplifies behaviors inherent to the pre-training distribution rather than inducing new capabilities, but these insights are predominantly limited to…

Artificial Intelligence · Computer Science 2026-04-15 Minghe Shen , Zhuo Zhi , Chonghan Liu , Shuo Xing , Zhengzhong Tu , Che Liu

Training large language models with reinforcement learning (RL) against verifiable rewards significantly enhances their reasoning abilities, yet remains computationally expensive due to inefficient uniform prompt sampling. We introduce…

Machine Learning · Computer Science 2026-03-06 Ruiqi Zhang , Daman Arora , Song Mei , Andrea Zanette

Reinforcement Learning (RL) is a rapidly growing area of machine learning that finds its application in a broad range of domains, from finance and healthcare to robotics and gaming. Compared to other machine learning techniques, RL agents…

Artificial Intelligence · Computer Science 2024-11-14 Geetansh Kalra , Divye Singh , Justin Jose

Recently DeepSeek R1 has shown that reinforcement learning (RL) can substantially improve the reasoning capabilities of Large Language Models (LLMs) through a simple yet effective design. The core of R1 lies in its rule-based reward…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Haozhan Shen , Peng Liu , Jingcheng Li , Chunxin Fang , Yibo Ma , Jiajia Liao , Qiaoli Shen , Zilun Zhang , Kangjia Zhao , Qianqian Zhang , Ruochen Xu , Tiancheng Zhao

Reinforcement learning with verifiable rewards (RLVR) has demonstrated superior performance in enhancing the reasoning capability of large language models (LLMs). However, this accuracy-oriented learning paradigm often suffers from entropy…

Artificial Intelligence · Computer Science 2026-01-19 Hongye Cao , Zhixin Bai , Ziyue Peng , Boyan Wang , Tianpei Yang , Jing Huo , Yuyao Zhang , Yang Gao

While large language models (LLMs) have substantially improved Text-to-SQL generation, a pronounced gap remains between AI systems and human experts on challenging benchmarks such as BIRD-SQL. We argue this gap stems largely from the…

The reasoning abilities of large language models (LLMs) have been substantially improved by reinforcement learning with verifiable rewards (RLVR). At test time, collaborative reasoning through Multi-Agent Debate (MAD) has emerged as a…

Computation and Language · Computer Science 2026-05-19 Chenxi Liu , Yanshuo Chen , Ruibo Chen , Tianyi Xiong , Tong Zheng , Heng Huang

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a core paradigm for enhancing the reasoning capabilities of Large Language Models (LLMs). To address the lack of verification signals at test time, prior studies…

Computation and Language · Computer Science 2025-10-17 Wenkai Yang , Weijie Liu , Ruobing Xie , Yiju Guo , Lulu Wu , Saiyong Yang , Yankai Lin

The growing disparity between the exponential scaling of computational resources and the finite growth of high-quality text data now constrains conventional scaling approaches for large language models (LLMs). To address this challenge, we…

Reinforcement learning with verifiable rewards (RLVR) has achieved remarkable success in enhancing the reasoning capabilities of large language models (LLMs). However, existing RLVR methods often suffer from exploration inefficiency due to…

Machine Learning · Computer Science 2025-09-09 Ziheng Li , Zexu Sun , Jinman Zhao , Erxue Min , Yongcheng Zeng , Hui Wu , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Xu Chen , Zhi-Hong Deng

We show that reinforcement learning with verifiable rewards (RLVR) can elicit strong mathematical reasoning in certain language models even with spurious rewards that have little, no, or even negative correlation with the correct answer.…

Tabular data serves as the backbone of modern data analysis and scientific research. While Large Language Models (LLMs) fine-tuned via Supervised Fine-Tuning (SFT) have significantly improved natural language interaction with such…

Reward models play a critical role in guiding large language models toward outputs that align with human expectations. However, an open challenge remains in effectively utilizing test-time compute to enhance reward model performance. In…

Computation and Language · Computer Science 2025-05-21 Jiaxin Guo , Zewen Chi , Li Dong , Qingxiu Dong , Xun Wu , Shaohan Huang , Furu Wei

Reinforcement learning has emerged as a powerful paradigm for post-training large language models (LLMs) to improve reasoning. Approaches like Reinforcement Learning from Human Feedback (RLHF) and Reinforcement Learning with Verifiable…

Machine Learning · Computer Science 2025-06-26 Yanzhi Zhang , Zhaoxi Zhang , Haoxiang Guan , Yilin Cheng , Yitong Duan , Chen Wang , Yue Wang , Shuxin Zheng , Jiyan He

Video diffusion models have made rapid progress in perceptual realism and temporal coherence, but they remain primarily optimized for plausible generation rather than verifiable reasoning. This limitation is especially pronounced in tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Tinghui Zhu , Sheng Zhang , James Y. Huang , Selena Song , Xiaofei Wen , Yuankai Li , Hoifung Poon , Muhao Chen