English
Related papers

Related papers: GHPO: Adaptive Guidance for Stable and Efficient L…

200 papers

Reinforcement Learning with Verifiable Rewards (RLVR) has become a standard recipe for post-training LLMs on reasoning tasks, with Group Relative Policy Optimization (GRPO) emerging as a leading approach. However, GRPO and its variants are…

Machine Learning · Computer Science 2026-05-12 Chanakya Ekbote , Vijay Lingam , Sujay Sanghavi , Jun Huan , Behrooz Omidvar-Tehrani , Anoop Deoras , Stefano Soatto

Reinforcement learning with verifiable rewards (RLVR) has become a powerful paradigm for improving language models on reasoning-intensive tasks, but its effectiveness is often limited by exploration. For example, models often fail on hard…

Machine Learning · Computer Science 2026-05-26 Ruitao Liu , Qinghao Hu , Alex Hu , Yecheng Wu , Shang Yang , Luke J. Huang , Zhuoyang Zhang , Han Cai , Song Han

Recent advances in large language models (LLMs) have introduced latent reasoning as a promising alternative to autoregressive reasoning. By performing internal computation with hidden states from previous steps, latent reasoning benefit…

Computation and Language · Computer Science 2025-10-24 Zhenrui Yue , Bowen Jin , Huimin Zeng , Honglei Zhuang , Zhen Qin , Jinsung Yoon , Lanyu Shang , Jiawei Han , Dong Wang

Recent advancements in reinforcement learning, particularly through Group Relative Policy Optimization (GRPO), have significantly improved multimodal large language models for complex reasoning tasks. However, two critical limitations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jisheng Dang , Jingze Wu , Teng Wang , Xuanhui Lin , Nannan Zhu , Hongbo Chen , Wei-Shi Zheng , Meng Wang , Tat-Seng Chua

Reinforcement learning with verifiable rewards (RLVR) has demonstrated superior performance in enhancing the reasoning capability of large language models (LLMs). However, this accuracy-oriented learning paradigm often suffers from entropy…

Artificial Intelligence · Computer Science 2026-01-19 Hongye Cao , Zhixin Bai , Ziyue Peng , Boyan Wang , Tianpei Yang , Jing Huo , Yuyao Zhang , Yang Gao

Existing Reinforcement Learning with Verifiable Rewards (RLVR) algorithms, such as GRPO, rely on rigid, uniform, and symmetric trust region mechanisms that are fundamentally misaligned with the complex optimization dynamics of Large…

Machine Learning · Computer Science 2026-04-21 Xiaoliang Fu , Jiaye Lin , Yangyi Fang , Binbin Zheng , Chaowen Hu , Zekai Shao , Cong Qin , Lu Pan , Ke Zeng , Xunliang Cai

Post-training has become essential for adapting large language models (LLMs) to complex downstream behaviors, including instruction following, preference alignment, and multi-step reasoning. Reinforcement learning with verifiable rewards…

Machine Learning · Computer Science 2026-05-20 Chengqian Zhang , Wei Zhu , Kyumin Lee

Recent large reasoning models (LRMs) driven by reinforcement learning algorithms (e.g., GRPO) have achieved remarkable performance on challenging reasoning tasks. However, these models suffer from overthinking, generating unnecessarily long…

Artificial Intelligence · Computer Science 2026-03-03 Gang Li , Yan Chen , Ming Lin , Tianbao Yang

Recent works have demonstrated the effectiveness of reinforcement learning (RL)-based post-training for enhancing the reasoning capabilities of large language models (LLMs). In particular, Group Relative Policy Optimization (GRPO) has shown…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Jinyoung Park , Jeehye Na , Jinyoung Kim , Hyunwoo J. Kim

While Reinforcement Learning from Verifiable Rewards (RLVR) has advanced reasoning in Large Vision-Language Models (LVLMs), prevailing frameworks suffer from a foundational methodological flaw: by distributing identical advantages across…

Artificial Intelligence · Computer Science 2026-04-09 Zekai Ye , Qiming Li , Xiaocheng Feng , Ruihan Chen , Ziming Li , Haoyu Ren , Kun Chen , Dandan Tu , Bing Qin

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

Machine Learning · Computer Science 2022-07-14 Atish Dixit , Ahmed H. ElSheikh

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

Machine Learning · Computer Science 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

Group Relative Policy Optimization (GRPO) has recently emerged as an effective approach for improving the reasoning capabilities of large language models through online multi-objective reinforcement learning. While personalization on…

Machine Learning · Computer Science 2026-02-03 Ziyao Wang , Daeun Jung , Yexiao He , Guoheng Sun , Zheyu Shen , Myungjin Lee , Ang Li

Multimodal large language models (MLLMs) have recently shown strong performance in visual understanding, yet they often lack temporal awareness, particularly in egocentric settings where reasoning depends on the correct ordering and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhiyang Xu , Tian Qin , Bowen Jin , Zhengfeng Lai , Meng Cao , Lifu Huang , Peng Zhang

Large language models (LLMs) have shown remarkable abilities in logical reasoning, in-context learning, and code generation. However, translating natural language instructions into effective robotic control policies remains a significant…

Machine Learning · Computer Science 2025-08-28 Utsav Singh , Pramit Bhattacharyya , Vinay P. Namboodiri

Large language models (LLMs) have exhibited extraordinary performance in a variety of tasks while it remains challenging for them to solve complex multi-step tasks as agents. In practice, agents sensitive to the outcome of certain key steps…

Artificial Intelligence · Computer Science 2025-05-28 Zilong Wang , Jingfeng Yang , Sreyashi Nag , Samarth Varshney , Xianfeng Tang , Haoming Jiang , Jingbo Shang , Sheikh Muhammad Sarwar

Recent advances in large language models (LLMs) have demonstrated that reinforcement learning with verifiable rewards (RLVR) can significantly enhance reasoning abilities by directly optimizing correctness, rather than relying solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Minbin Huang , Runhui Huang , Chuanyang Zheng , Jingyao Li , Guoxuan Chen , Han Shi , Hong Cheng

Video generation models produce visually coherent content but struggle with tasks requiring spatial reasoning and multi-step planning. Reinforcement learning (RL) offers a path to improve generalization, but its effectiveness in video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ming Liu , Yunbei Zhang , Shilong Liu , Liwen Wang , Wensheng Zhang

Reinforcement learning with verifiable rewards (RLVR) has shown promise in enhancing the reasoning performance of large language models (LLMs) by increasing test-time compute. However, even after extensive RLVR training, such models still…

Artificial Intelligence · Computer Science 2026-03-10 Pinzheng Wang , Shuli Xu , Juntao Li , Yu Luo , Dong Li , Jianye Hao , Min Zhang

Recent advances in large reasoning models (LRMs) demonstrate that sophisticated behaviors such as multi-step reasoning and self-reflection can emerge via reinforcement learning with verifiable rewards~(\textit{RLVR}). However, existing…

Machine Learning · Computer Science 2025-06-24 Jianhao Yan , Yafu Li , Zican Hu , Zhi Wang , Ganqu Cui , Xiaoye Qu , Yu Cheng , Yue Zhang