English
Related papers

Related papers: Sharpness-Guided Group Relative Policy Optimizatio…

200 papers

Reinforcement Learning with Verifiable Rewards (RLVR) has achieved remarkable success in improving autoregressive models, especially in domains requiring correctness like mathematical reasoning and code generation. However, directly…

Machine Learning · Computer Science 2026-03-03 Chenxing Wei , Jiazhen Kang , Hong Wang , Jianqing Zhang , Hao Jiang , Xiaolong Xu , Ningyuan Sun , Ying He , F. Richard Yu , Yao Shu , Bo Jiang

Finetuning Large Vision-Language Models with reinforcement learning has emerged as a promising approach to enhance their capability in object-level grounding. However, existing methods, mainly based on GRPO, assign rewards at the response…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yuyuan Liu , Yiping Ji , Anjie Le , Jiayuan Zhu , Jiazhen Pan , Can Peng , Jiajun Deng , Fengbei Liu , Junde Wu

Building speech deepfake detection models that are generalizable to unseen attacks remains a challenging problem. Although the field has shifted toward a pre-training and fine-tuning paradigm using speech foundation models, most approaches…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-04 Xin Wang , Ge Wanying , Junichi Yamagishi

Reinforcement Learning with Verifiable Rewards (RLVR) has catalyzed a leap in Large Language Model (LLM) reasoning, yet its optimization dynamics remain fragile. Standard algorithms like GRPO enforce stability via "hard clipping", which…

Machine Learning · Computer Science 2026-04-21 Xiaoliang Fu , Jiaye Lin , Yangyi Fang , Chaowen Hu , Cong Qin , Zekai Shao , Binbin Zheng , Lu Pan , Ke Zeng

Reinforcement learning with verifiable rewards (RLVR) has become a central paradigm for improving reasoning and code generation in large language models, and GRPO-style training is widely adopted for its simplicity and effectiveness.…

Machine Learning · Computer Science 2026-05-07 Zhiyuan Zeng , Jiameng Huang , Zhangyue Yin , Jiashuo Liu , Ziniu Li , Bingrui Li , Yuhao Wu , Yining Zheng , Ge Zhang , Wenhao Huang , Xipeng Qiu

The recent success and openness of DeepSeek-R1 have brought widespread attention to Group Relative Policy Optimization (GRPO) as a reinforcement learning method for large reasoning models (LRMs). In this work, we analyze the GRPO objective…

Machine Learning · Computer Science 2026-01-07 Gang Li , Ming Lin , Tomer Galanti , Zhengzhong Tu , Tianbao Yang

While Group Relative Policy Optimization (GRPO) offers a powerful framework for LLM post-training, its effectiveness in open-ended domains like Machine Translation hinges on accurate intra-group ranking. We identify that standard Scalar…

Computation and Language · Computer Science 2026-02-17 Sen Yang , Shanbo Cheng , Lu Xu , Jianbing Zhang , Shujian Huang

Reinforcement learning from verifiable rewards (RLVR) is an emerging paradigm for improving the reasoning ability of large language models. However, standard on-policy training discards rollout experiences after a single update, leading to…

Machine Learning · Computer Science 2026-03-03 Runzhe Zhan , Yafu Li , Zhi Wang , Xiaoye Qu , Dongrui Liu , Jing Shao , Derek F. Wong , Yu Cheng

Recent advances in large language models (LLMs) have broadened their applicability across diverse tasks, yet specialized domains still require targeted post training. Among existing methods, Group Relative Policy Optimization (GRPO) stands…

Machine Learning · Computer Science 2025-08-08 Ziyin Gu , Jingyao Wang , Ran Zuo , Chuxiong Sun , Zeen Song , Changwen Zheng , Wenwen Qiang

As a key component of large language model (LLM) post-training, Reinforcement Learning from Verifiable Rewards (RLVR) has substantially improved reasoning performance. However, existing RLVR algorithms exhibit distinct stability issues:…

Computation and Language · Computer Science 2026-04-13 Kun Yang , Zikang chen , Yanmeng Wang , Zhigen Li , Ning Cheng , Shaojun Wang , Jing Xiao

Reinforcement learning (RL) has garnered increasing attention in text-to-image (T2I) generation. However, most existing RL approaches are tailored to either diffusion models or autoregressive models, overlooking an important alternative:…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yifu Luo , Xinhao Hu , Keyu Fan , Haoyuan Sun , Zeyu Chen , Bo Xia , Tiantian Zhang , Yongzhe Chang , Xueqian Wang

In an era where tool-augmented AI agents are becoming increasingly vital, our findings highlight the ability of Group Relative Policy Optimization (GRPO) to empower SLMs, which are traditionally constrained in tool use. The ability to use…

Computation and Language · Computer Science 2025-09-10 Dhruvi Paprunia , Vansh Kharidia , Pankti Doshi

Recent studies have demonstrated that Reinforcement Learning (RL), notably Group Relative Policy Optimization (GRPO), can intrinsically elicit and enhance the reasoning capabilities of Vision-Language Models (VLMs). However, despite the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Xinyu Tian , Shu Zou , Zhaoyuan Yang , Mengqi He , Peter Tu , Jing Zhang

Large Language Models (LLMs) often suffer from mode collapse, repeatedly generating the same few completions even when many valid answers exist, limiting their diversity across a wide range of tasks. We introduce Group-Aware Policy…

Reinforcement learning with verifiable rewards (RLVR) plays a pivotal role in improving the reasoning ability of large language models. However, widely used PPO surrogate objectives are fundamentally local, as they rely on a local…

Machine Learning · Computer Science 2026-05-21 Deokgyu Yoon , Hyungkyu Kang , Joongkyu Lee , Byeongchan Kim , Gyungin Shin , Sungrae Park , Min-hwan Oh

Group Relative Policy Optimization (GRPO) significantly enhances the reasoning performance of Large Language Models (LLMs). However, this success heavily relies on expensive external verifiers or human rules. Such dependency not only leads…

Computation and Language · Computer Science 2026-03-03 Nonghai Zhang , Weitao Ma , Zhanyu Ma , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He , Jingwen Xu

The Group Relative Policy Optimization (GRPO) algorithm has demonstrated considerable success in enhancing the reasoning capabilities of large language models (LLMs), as evidenced by DeepSeek-R1. However, the absence of intermediate…

Machine Learning · Computer Science 2025-06-06 Fei Ding , Baiqiao Wang , Zijian Zeng , Youwei Wang

Group Relative Policy Optimization (GRPO) has recently emerged as an effective approach for improving the reasoning capabilities of large language models through online multi-objective reinforcement learning. While personalization on…

Machine Learning · Computer Science 2026-02-03 Ziyao Wang , Daeun Jung , Yexiao He , Guoheng Sun , Zheyu Shen , Myungjin Lee , Ang Li

We propose reinforcement learning (RL) strategies tailored for reasoning in large language models (LLMs) under strict memory and compute limits, with a particular focus on compatibility with LoRA fine-tuning. Building on early policy…

Machine Learning · Computer Science 2025-06-13 Alan Lee , Harry Tong

Reinforcement Learning (RL) in partially observable environments poses significant challenges due to the complexity of learning under uncertainty. While additional information, such as that available in simulations, can enhance training,…

Machine Learning · Computer Science 2026-03-16 Yueheng Li , Guangming Xie , Zongqing Lu