English
Related papers

Related papers: Adaptive Group Policy Optimization: Towards Stable…

200 papers

The rapid evolution of agentic workflows has demonstrated strong performance of LLM-based agents in addressing complex reasoning tasks. However, existing workflow optimization methods typically formulate workflow synthesis as a static,…

Artificial Intelligence · Computer Science 2026-02-03 Mingze Kong , Zikun Qu , Zhongquan Zhou , Pengyu Liang , Xiang Li , Zhiwei Shang , Zhi Hong , Kaiyu Huang , Zhiyong Wang , Zhongxiang Dai

Large Language Models (LLMs) have demonstrated remarkable capabilities in knowledge acquisition, reasoning, and tool use, making them promising candidates for autonomous agent applications. However, training LLM agents for complex…

Machine Learning · Computer Science 2025-12-09 Hanjiang Hu , Changliu Liu , Na Li , Yebin Wang

Group Relative Policy Optimization (GRPO) significantly enhances the reasoning performance of Large Language Models (LLMs). However, this success heavily relies on expensive external verifiers or human rules. Such dependency not only leads…

Computation and Language · Computer Science 2026-03-03 Nonghai Zhang , Weitao Ma , Zhanyu Ma , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He , Jingwen Xu

Reinforcement learning has become a powerful paradigm for post-training large language model agents, yet credit assignment in multi-turn environments remains a challenge. Agents often receive sparse, trajectory-level rewards only at the end…

Computation and Language · Computer Science 2026-05-14 Siyuan Zhu , Chao Yu , Rongxin Yang , Zongkai Liu , Jinjun Hu , Qiwen Chen , Yibo Zhang

Trust region policy optimization (TRPO) is a popular and empirically successful policy search algorithm in Reinforcement Learning (RL) in which a surrogate problem, that restricts consecutive policies to be 'close' to one another, is…

Machine Learning · Computer Science 2019-12-13 Lior Shani , Yonathan Efroni , Shie Mannor

Post-training with reinforcement learning (RL) has recently shown strong promise for advancing multimodal agents beyond supervised imitation. However, RL remains limited by poor data efficiency, particularly in settings where interaction…

Machine Learning · Computer Science 2026-03-05 Chengxuan Lu , Zhenquan Zhang , Shukuan Wang , Qunzhi Lin , Baigui Sun , Yang Liu

Developing high-quality text-to-speech (TTS) systems for low-resource languages is challenging due to the scarcity of paired text and speech data. In contrast, automatic speech recognition (ASR) models for such languages are often more…

Group Relative Policy Optimization (GRPO) has recently emerged as an effective approach for improving the reasoning capabilities of large language models through online multi-objective reinforcement learning. While personalization on…

Machine Learning · Computer Science 2026-02-03 Ziyao Wang , Daeun Jung , Yexiao He , Guoheng Sun , Zheyu Shen , Myungjin Lee , Ang Li

Visual-Language-Action (VLA) models have demonstrated strong cross-scenario generalization capabilities in various robotic tasks through large-scale pre-training and task-specific fine-tuning. However, their training paradigm mainly relies…

Robotics · Computer Science 2025-09-30 Zengjue Chen , Runliang Niu , He Kong , Qi Wang , Qianli Xing , Zipei Fan

Enhancing LLMs with the ability to actively search external knowledge is crucial for complex and real-world tasks. Current approaches either rely on prompting to elicit the model's innate agent capabilities, or suffer from performance…

Computation and Language · Computer Science 2026-03-20 Chenyang Gu , Yewen Pu , Bruce Yang , Xiaofan Li , Huan Gao

Group Relative Policy Optimization (GRPO) has proven highly effective in enhancing the alignment capabilities of Large Language Models (LLMs). However, current adaptations of GRPO for the flow matching-based image generation neglect a…

Machine Learning · Computer Science 2025-12-16 Yawen Shao , Jie Xiao , Kai Zhu , Yu Liu , Wei Zhai , Yang Cao , Zheng-Jun Zha

Recent advances in large language models (LLMs) have shown that reasoning ability can be significantly enhanced through Reinforcement Learning with Verifiable Rewards (RLVR). Group Relative Policy Optimization (GRPO) has emerged as the de…

Computation and Language · Computer Science 2025-10-13 Jingyu Zhou , Lu Ma , Hao Liang , Chengyu Shen , Bin Cui , Wentao Zhang

The enhancement of reasoning capabilities in large language models (LLMs) has garnered significant attention, with supervised fine-tuning (SFT) and reinforcement learning emerging as dominant paradigms. While recent studies recognize the…

Artificial Intelligence · Computer Science 2026-03-17 Zhijie Wang

Reinforcement learning with verifiable rewards (RLVR), particularly Group Relative Policy Optimization (GRPO), has advanced LLM reasoning. However, GRPO suffers from three credit assignment failures: uniform token-level granularity that…

Machine Learning · Computer Science 2026-05-07 Song Yu , Li Li , Wenwen Zhao , Zhisheng Yang

Recent advances in large language models (LLMs) have broadened their applicability across diverse tasks, yet specialized domains still require targeted post training. Among existing methods, Group Relative Policy Optimization (GRPO) stands…

Machine Learning · Computer Science 2025-08-08 Ziyin Gu , Jingyao Wang , Ran Zuo , Chuxiong Sun , Zeen Song , Changwen Zheng , Wenwen Qiang

We introduce Self-correction Relative Policy Optimization (ScRPO), a novel reinforcement learning framework designed to empower large language models with advanced mathematical reasoning capabilities through iterative self-reflection and…

Artificial Intelligence · Computer Science 2026-01-06 Lianrui Li , Dakuan Lu , Jiawei Shao , Xuelong Li

This research introduces a novel AI techniques as Mixture-of-Experts Transformers with Group Relative Policy Optimization (GRPO) for voice health care applications on voice pathology detection. With the architectural innovations, we adopt…

Sound · Computer Science 2025-03-07 Enkhtogtokh Togootogtokh , Christian Klasen

Recent studies have demonstrated that Reinforcement Learning (RL), notably Group Relative Policy Optimization (GRPO), can intrinsically elicit and enhance the reasoning capabilities of Vision-Language Models (VLMs). However, despite the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Xinyu Tian , Shu Zou , Zhaoyuan Yang , Mengqi He , Peter Tu , Jing Zhang

To facilitate efficient learning, policy gradient approaches to deep reinforcement learning (RL) are typically paired with variance reduction measures and strategies for making large but safe policy changes based on a batch of experiences.…

Machine Learning · Computer Science 2023-11-13 Jared Markowitz , Edward W. Staley

Reinforcement learning is crucial for aligning large language models to perform complex reasoning tasks. However, current algorithms such as Group Relative Policy Optimization suffer from coarse grained, sequence level credit assignment,…

Machine Learning · Computer Science 2026-05-11 Hongbo Jin , Rongpeng Zhu , Zhongjing Du , Xu Jiang , Jingqi Tian , Qiaoman Zhang , Jiayu Ding