English
Related papers

Related papers: Hierarchy-of-Groups Policy Optimization for Long-H…

200 papers

LLM agents have emerged as powerful systems for tackling multi-turn tasks by interleaving internal reasoning and external tool interactions. Agentic Reinforcement Learning has recently drawn significant research attention as a critical…

Artificial Intelligence · Computer Science 2026-01-09 Zefang Zong , Dingwei Chen , Yang Li , Qi Yi , Bo Zhou , Chengming Li , Bo Qian , Peng Chen , Jie Jiang

While reinforcement learning methods such as Group Relative Preference Optimization (GRPO) have significantly enhanced Large Language Models, adapting them to diffusion models remains challenging. In particular, GRPO demands a stochastic…

Machine Learning · Computer Science 2025-10-10 Yihong Luo , Tianyang Hu , Jing Tang

The Group Relative Policy Optimization (GRPO), a reinforcement learning method used to fine-tune large language models (LLMs), has proved its effectiveness in practical applications such as DeepSeek-R1. It raises a question whether GRPO can…

Machine Learning · Computer Science 2025-11-20 Yanchen Xu , Ziheng Jiao , Hongyuan Zhang , Xuelong Li

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

Machine Learning · Computer Science 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Reinforcement learning is widely used to improve the reasoning ability of large language models, especially when answers can be automatically checked. Standard GRPO-style training updates the model using only the current step, while full…

Machine Learning · Computer Science 2026-05-11 Ismam Nur Swapnil , Aranya Saha , Tanvir Ahmed Khan , Mohammad Ariful Haque , Ser-Nam Lim

Recent large reasoning models (LRMs) driven by reinforcement learning algorithms (e.g., GRPO) have achieved remarkable performance on challenging reasoning tasks. However, these models suffer from overthinking, generating unnecessarily long…

Artificial Intelligence · Computer Science 2026-03-03 Gang Li , Yan Chen , Ming Lin , Tianbao Yang

Reinforcement learning from verifiable rewards has significantly advanced the reasoning capabilities of large language models. However, Group Relative Policy Optimization (GRPO) typically assigns a uniform, sequence-level advantage to all…

Machine Learning · Computer Science 2026-04-06 Song Yu , Li Li , Wenwen Zhao , Zhisheng Yang

Proximal Policy Optimization (PPO) is central to aligning Large Language Models (LLMs) in reasoning tasks with verifiable rewards. However, standard token-level PPO struggles in this setting due to the instability of temporal credit…

Artificial Intelligence · Computer Science 2026-04-13 Tianyi Wang , Yixia Li , Long Li , Yibiao Chen , Shaohan Huang , Yun Chen , Peng Li , Yang Liu , Guanhua Chen

Large Language Models (LLMs) have achieved strong performance on a wide range of complex reasoning tasks, yet further gains are often possible by leveraging the complementary strengths of multiple models. While multi-agent frameworks can…

Multiagent Systems · Computer Science 2025-07-15 Andrew Estornell , Jean-Francois Ton , Muhammad Faaiz Taufiq , Hang Li

Analyzing the human factors behind aviation accidents is crucial for preventing future incidents, yet traditional methods using the Human Factors Analysis and Classification System (HFACS) are limited by scalability and consistency. To…

Computation and Language · Computer Science 2025-09-01 Arash Ahmadi , Sarah Sharif , Yaser Banad

Large language model (LLM) agents have recently demonstrated strong capabilities in interactive decision-making, yet they remain fundamentally limited in long-horizon tasks that require structured planning and reliable execution. Existing…

Artificial Intelligence · Computer Science 2026-05-06 Hongbo Jin , Rongpeng Zhu , Jiayu Ding , Guibo Luo , Ge Li

Multi-agent systems (MAS) and reinforcement learning (RL) are widely used to enhance the agentic capabilities of large language models (LLMs). MAS improves task performance through role-based orchestration, while RL uses environmental…

Machine Learning · Computer Science 2026-02-02 Yujie Zhao , Lanxiang Hu , Yang Wang , Minmin Hou , Hao Zhang , Ke Ding , Jishen Zhao

Latent reasoning offers a more efficient alternative to explicit reasoning by compressing intermediate reasoning into continuous representations and substantially shortening reasoning chains. However, existing latent reasoning methods…

Machine Learning · Computer Science 2026-05-01 Jingcheng Deng , Zihao Wei , Liang Pang , Junhong Wu , Shicheng Xu , Zenghao Duan , Huawei Shen

Search agents extend Large Language Models (LLMs) beyond static parametric knowledge by enabling access to up-to-date and long-tail information unavailable during pretraining. While reinforcement learning has been widely adopted for…

Machine Learning · Computer Science 2026-04-21 Junzhe Wang , Zhiheng Xi , Yajie Yang , Hao Luo , Shihan Dou , Tao Gui , Qi Zhang

Trust region methods rigorously enabled reinforcement learning (RL) agents to learn monotonically improving policies, leading to superior performance on a variety of tasks. Unfortunately, when it comes to multi-agent reinforcement learning…

Artificial Intelligence · Computer Science 2022-04-05 Jakub Grudzien Kuba , Ruiqing Chen , Muning Wen , Ying Wen , Fanglei Sun , Jun Wang , Yaodong Yang

Reinforcement learning with verifiers (RLVR) has become a central paradigm for improving LLM reasoning, yet popular group-based optimization algorithms like GRPO often suffer from exploration collapse, where the models prematurely converge…

Artificial Intelligence · Computer Science 2026-05-19 Haoxuan Chen , Tianming Liang , Wei-Shi Zheng , Jian-Fang Hu

On-policy reinforcement learning methods, like Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), often demand extensive data per update, leading to sample inefficiency. This paper introduces Reflective Policy…

Machine Learning · Computer Science 2024-06-07 Yaozhong Gan , Renye Yan , Zhe Wu , Junliang Xing

Solving long-horizon goal-conditioned tasks remains a significant challenge in reinforcement learning (RL). Hierarchical reinforcement learning (HRL) addresses this by decomposing tasks into more manageable sub-tasks, but the automatic…

Machine Learning · Computer Science 2025-09-09 Yang Yu

As reconfigurable intelligent surfaces (RIS) emerge as a pivotal technology in the upcoming sixth-generation (6G) networks, their deployment within practical multiple operator (OP) networks presents significant challenges, including the…

Systems and Control · Electrical Eng. & Systems 2025-02-24 Haocheng Zhang , Wei Wang , Hao Zhou , Zhiping Lu , Ming Li

This work considers the problem of learning cooperative policies in multi-agent settings with partially observable and non-stationary environments without a communication channel. We focus on improving information sharing between agents and…

Machine Learning · Computer Science 2021-09-03 Eshagh Kargar , Ville Kyrki