English
Related papers

Related papers: Execution-Verified Reinforcement Learning for Opti…

200 papers

Large language models (LLMs) are increasingly deployed in decision-making tasks, where not only accuracy but also reliable confidence estimates are essential. Well-calibrated confidence enables downstream systems to decide when to trust a…

Machine Learning · Computer Science 2026-01-21 Duygu Nur Yaldiz , Evangelia Spiliopoulou , Zheng Qi , Siddharth Varia , Srikanth Doss , Nikolaos Pappas

Recent advances in reinforcement learning (RL) have significantly enhanced the reasoning capabilities of large language models (LLMs). Group Relative Policy Optimization (GRPO), a lightweight variant of Proximal Policy Optimization (PPO),…

Machine Learning · Computer Science 2025-10-13 Chen Wang , Lai Wei , Yanzhi Zhang , Chenyang Shao , Zedong Dan , Weiran Huang , Yuzhi Zhang , Yue Wang

Vision-to-code tasks require models to reconstruct structured visual inputs, such as charts, tables, and SVGs, into executable or structured representations with high visual fidelity. While recent Large Vision Language Models (LVLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Ziyu Liu , Shengyuan Ding , Xinyu Fang , Xuanlang Dai , Penghui Yang , Jianze Liang , Jiaqi Wang , Kai Chen , Dahua Lin , Yuhang Zang

Test-time compute scaling allocates inference computation uniformly, uses fixed sampling strategies, and applies verification only for reranking. In contrast, we propose a verifier-guided adaptive framework treating reasoning as iterative…

Computation and Language · Computer Science 2026-04-08 Ahsan Bilal , Ahmed Mohsin , Muhammad Umer , Ali Subhan , Hassan Rizwan , Ayesha Mohsin , Dean Hougen

Reinforcement learning with verifiable rewards (RLVR) has demonstrated promising potential to enhance the reasoning capabilities of large language models (LLMs) in domains such as mathematics and coding. However, its applications on…

Computation and Language · Computer Science 2026-05-19 Zhonghang Yuan , Zhefan Wang , Fang Hu , Zihong Chen , Jinzhe Li , Gang Li , Jie Ying , Huanjun Kong , Songyang Zhang , Nanqing Dong

Large Language Models (LLMs) have shown promising capabilities for solving Operations Research (OR) problems. While reinforcement learning serves as a powerful paradigm for LLM training on OR problems, existing works generally face two key…

Artificial Intelligence · Computer Science 2025-10-03 Chenyu Zhou , Tianyi Xu , Jianghao Lin , Dongdong Ge

Reinforcement Learning from Verifiable Rewards (RLVR) has improved language models in domains such as mathematics and code, where correctness can be checked automatically. However, many important tasks are only partially verifiable: prompts…

Computation and Language · Computer Science 2026-05-28 Saurabh Dash , Pierre Clavier , John Dang , Matthias Galle , Marzieh Fadaee , Ahmet Üstün , Beyza Ermis

It is challenging for reinforcement learning (RL) algorithms to succeed in real-world applications like financial trading and logistic system due to the noisy observation and environment shifting between training and evaluation. Thus, it…

Machine Learning · Computer Science 2022-05-20 Zhengyu Yang , Kan Ren , Xufang Luo , Minghuan Liu , Weiqing Liu , Jiang Bian , Weinan Zhang , Dongsheng Li

Video understanding with multimodal large language models (MLLMs) remains challenging due to the long token sequences of videos, which contain extensive temporal dependencies and redundant frames. Existing approaches typically treat MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Yaolun Zhang , Ruohui Wang , Jiahao Wang , Yepeng Tang , Xuanyu Zheng , Haonan Duan , Hao Lu , Hanming Deng , Lewei Lu

Reinforcement Learning with Verifiable Rewards~(RLVR) has emerged as a powerful learn-to-reason paradigm for large reasoning models to tackle complex tasks. However, the current RLVR paradigm is still not efficient enough, as it works in a…

Computation and Language · Computer Science 2026-03-10 Junjie Zhang , Guozheng Ma , Shunyu Liu , Haoyu Wang , Jiaxing Huang , Ting-En Lin , Fei Huang , Yongbin Li , Dacheng Tao

The advancement of embodied intelligence is accelerating the integration of robots into daily life as human assistants. This evolution requires robots to not only interpret high-level instructions and plan tasks but also perceive and adapt…

Robotics · Computer Science 2025-08-19 Zhichen Lou , Kechun Xu , Zhongxiang Zhou , Rong Xiong

Exploration is essential for general-purpose robotic learning, especially in open-ended environments where dense rewards, explicit goals, or task-specific supervision are scarce. Vision-language models (VLMs), with their semantic reasoning…

Robotics · Computer Science 2025-09-12 Seungjae Lee , Daniel Ekpo , Haowen Liu , Furong Huang , Abhinav Shrivastava , Jia-Bin Huang

Reinforcement learning with verifiable rewards (RLVR) has recently advanced the reasoning capabilities of large language models (LLMs). While prior work has emphasized algorithmic design, data curation, and reward shaping, we investigate…

Machine Learning · Computer Science 2025-07-10 Xinjie Chen , Minpeng Liao , Guoxin Chen , Chengxi Li , Biao Fu , Kai Fan , Xinggao Liu

We introduce Reinforcement Learning (RL) with Adaptive Verifiable Environments (RLVE), an approach using verifiable environments that procedurally generate problems and provide algorithmically verifiable rewards, to scale up RL for language…

Large language models (LLMs) have shown promise in performing complex multi-step reasoning, yet they continue to struggle with mathematical reasoning, often making systematic errors. A promising solution is reinforcement learning (RL)…

Machine Learning · Computer Science 2025-09-22 Hanning Zhang , Pengcheng Wang , Shizhe Diao , Yong Lin , Rui Pan , Hanze Dong , Dylan Zhang , Pavlo Molchanov , Tong Zhang

Large Language Models excel at code generation yet struggle with complex programming tasks that demand sophisticated reasoning. To bridge this gap, traditional process supervision relies on learned reward models requiring costly training…

Computation and Language · Computer Science 2025-06-09 Zhuohao Yu , Weizheng Gu , Yidong Wang , Xingru Jiang , Zhengran Zeng , Jindong Wang , Wei Ye , Shikun Zhang

Enhancing the mathematical reasoning capabilities of Large Language Models (LLMs) is of great scientific and practical significance. Researchers typically employ process-supervised reward models (PRMs) to guide the reasoning process,…

Computation and Language · Computer Science 2025-07-24 Wei Sun , Qianlong Du , Fuwei Cui , Jiajun Zhang

Reinforcement learning (RL) is a machine learning approach that trains agents to maximize cumulative rewards through interactions with environments. The integration of RL with deep learning has recently resulted in impressive achievements…

Neural and Evolutionary Computing · Computer Science 2023-08-31 Hui Bai , Ran Cheng , Yaochu Jin

Large language models (LLMs) deployed as agents solve user-specified tasks over multiple steps while keeping the required manual engagement to a minimum. Crucially, such LLMs need to ground their generations in any feedback obtained to…

Computation and Language · Computer Science 2025-02-19 Jonas Gehring , Kunhao Zheng , Jade Copet , Vegard Mella , Quentin Carbonneaux , Taco Cohen , Gabriel Synnaeve

Policy evaluation is a core component of many reinforcement learning (RL) algorithms and a critical tool for ensuring safe deployment of RL policies. However, existing policy evaluation methods often suffer from high variance or bias. To…

Artificial Intelligence · Computer Science 2026-03-23 Shripad Vilasrao Deshmukh , Will Schwarzer , Scott Niekum