English
Related papers

Related papers: Signal Reshaping for GRPO in Weak-Feedback Agentic…

200 papers

Group Relative Policy Optimization (GRPO) has emerged as a promising critic-free reinforcement learning paradigm for reasoning tasks. However, standard GRPO employs a coarse-grained credit assignment mechanism that propagates group-level…

Computation and Language · Computer Science 2026-01-13 Ziheng Li , Liu Kang , Feng Xiao , Luxi Xing , Qingyi Si , Zhuoran Li , Weikang Gong , Deqing Yang , Yanghua Xiao , Hongcheng Guo

Group-relative RL training (GRPO) samples a small group of parallel rollouts for every training prompt and uses their within-group reward spread to compute per-trajectory advantages. In agentic environments each rollout is a long multi-turn…

Machine Learning · Computer Science 2026-05-08 Zhiyuan Zhai , Xin Wang

Reinforcement learning (RL) is widely used for post-training large language models (LLMs) in code editing, where group-relative methods, such as GRPO, are popular due to their critic-free and normalized advantage estimation. However, in…

Machine Learning · Computer Science 2026-01-09 Jianqing Zhang , Zhezheng Hao , Wei Xia , Hande Dong , Hong Wang , Chenxing Wei , Yuyan Zhou , Yubin Qi , Qiang Lin , Jian Cao

Large Language Models (LLMs) empowered with Tool-Integrated Reasoning (TIR) can iteratively plan, call external tools, and integrate returned information to solve complex, long-horizon reasoning tasks. Agentic Reinforcement Learning…

Computation and Language · Computer Science 2026-01-21 Jianghao Su , Xia Zeng , Luhui Liu , Chao Luo , Ye Chen , Zhuoran Zhuang

Reinforcement learning has become the primary paradigm for aligning large language models (LLMs) on complex reasoning tasks, with group relative policy optimization (GRPO) widely used in large-scale post-training. However, GRPO faces…

Machine Learning · Computer Science 2026-01-08 Amir Hossein Yari , Fajri Koto

Group-relative policy optimization methods train language models by generating multiple rollouts per prompt and normalizing rewards with a shared mean reward baseline. In resource-constrained settings where the rollout budget is small,…

Machine Learning · Computer Science 2026-02-02 Youngeun Kim

Optimizing communication topology is fundamental to the efficiency and effectiveness of Large Language Model (LLM)-based Multi-Agent Systems (MAS). While recent approaches utilize reinforcement learning to dynamically construct…

Computation and Language · Computer Science 2026-03-04 Yueyang Cang , Xiaoteng Zhang , Erlu Zhao , Zehua Ji , Yuhang Liu , Yuchen He , Zhiyuan Ning , Chen Yijun , Wenge Que , Li Shi

Finetuning Large Vision-Language Models with reinforcement learning has emerged as a promising approach to enhance their capability in object-level grounding. However, existing methods, mainly based on GRPO, assign rewards at the response…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yuyuan Liu , Yiping Ji , Anjie Le , Jiayuan Zhu , Jiazhen Pan , Can Peng , Jiajun Deng , Fengbei Liu , Junde Wu

Group Relative Policy Optimization (GRPO) is widely used for critic-free Large Language Model (LLM) post-training, but its KL regularization is usually implemented as a local loss-side token penalty. We show that this misses the…

Machine Learning · Computer Science 2026-05-26 Jiarui Yao , Ruida Wang , Hao Bai , Tong Zhang

Recently, GRPO-based reinforcement learning has shown remarkable progress in optimizing flow-matching models, effectively improving their alignment with task-specific rewards. Within these frameworks, the policy update relies on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Jing Wang , Jiajun Liang , Jie Liu , Henglin Liu , Gongye Liu , Jun Zheng , Wanyuan Pang , Ao Ma , Zhenyu Xie , Xintao Wang , Meng Wang , Pengfei Wan , Xiaodan Liang

Reinforcement learning (RL) has become a key driver of language model reasoning. Among RL algorithms, Group Relative Policy Optimization (GRPO) is the de facto standard, avoiding the need for a critic by using per-prompt baselines and…

Machine Learning · Computer Science 2026-02-02 Cheng Ge , Caitlyn Heqi Yin , Hao Liang , Jiawei Zhang

Agentic reinforcement learning (RL) for software engineering spends much of its compute on stateful trajectories whose grouped binary rewards are highly skewed and weakly contrastive. We frame this as pass-rate control and show that the…

Machine Learning · Computer Science 2026-05-18 Tianshu Zhu , Wenyu Zhang , Xiaoying Zuo , Lun Tian , Haotian Zhao , Yucheng Zeng , Jingnan Gu , Daxiang Dong , Jianmin Wu , Dawei Yin , Dou Shen

RLVR has become a widely adopted paradigm for improving LLMs' reasoning capabilities, and GRPO is one of its most representative algorithms. In this paper, we first show that GRPO admits an equivalent discriminative reformulation as a…

Machine Learning · Computer Science 2026-05-19 Feng Zhang , Xinhong Ma , Ziqiang Dong , Xi Leng , Jianfei Zhao , Xin Sun , Yang Yang , Guanjun Jiang

Reinforcement learning (RL), particularly GRPO, improves image generation quality significantly by comparing the relative performance of images generated within the same group. However, in the later stages of training, the model tends to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Henglin Liu , Huijuan Huang , Jing Wang , Chang Liu , Xiu Li , Xiangyang Ji

Group-Relative Policy Optimization (GRPO) has emerged as the standard for training reasoning capabilities in large language models through reinforcement learning. By estimating advantages using group-mean rewards rather than a learned…

Artificial Intelligence · Computer Science 2026-03-06 Anisha Garg , Claire Zhang , Nishit Neema , David Bick , Ganesh Venkatesh , Joel Hestness

While Large Language Models (LLMs) excel at generating human-like text, aligning their outputs with complex, qualitative goals like pedagogical soundness remains a significant challenge. Standard reinforcement learning techniques often rely…

Computation and Language · Computer Science 2025-09-17 Francesco Pappone , Ruggero Marino Lazzaroni , Federico Califano , Niccolò Gentile , Roberto Marras

As language models become increasingly capable, users expect them to provide not only accurate responses but also behaviors aligned with diverse human preferences across a variety of scenarios. To achieve this, Reinforcement learning (RL)…

The success of Deepseek-R1 has drawn the LLM community's attention to reinforcement learning (RL) methods like GRPO. However, such rule-based 0/1 outcome reward methods lack the capability to regulate the intermediate reasoning processes…

Artificial Intelligence · Computer Science 2025-05-26 Muzhi Dai , Shixuan Liu , Qingyi Si

Group Relative Policy Optimization (GRPO) has recently emerged as a practical recipe for aligning large language models with verifiable objectives. However, under sparse terminal rewards, GRPO often stalls because rollouts within a group…

Machine Learning · Computer Science 2026-02-04 Baohao Liao , Hanze Dong , Xinxing Xu , Christof Monz , Jiang Bian

Multi-turn tool calling is challenging for Large Language Models (LLMs) because rewards are sparse and exploration is expensive. A common recipe, SFT followed by GRPO, can stall when within-group reward variation is low (e.g., more rollouts…

Artificial Intelligence · Computer Science 2026-02-04 Haitian Zhong , Jixiu Zhai , Lei Song , Jiang Bian , Qiang Liu , Tieniu Tan
‹ Prev 1 2 3 10 Next ›