中文
相关论文

相关论文: Hierarchy-of-Groups Policy Optimization for Long-H…

200 篇论文

LLM agents have emerged as powerful systems for tackling multi-turn tasks by interleaving internal reasoning and external tool interactions. Agentic Reinforcement Learning has recently drawn significant research attention as a critical…

人工智能 · 计算机科学 2026-01-09 Zefang Zong , Dingwei Chen , Yang Li , Qi Yi , Bo Zhou , Chengming Li , Bo Qian , Peng Chen , Jie Jiang

While reinforcement learning methods such as Group Relative Preference Optimization (GRPO) have significantly enhanced Large Language Models, adapting them to diffusion models remains challenging. In particular, GRPO demands a stochastic…

机器学习 · 计算机科学 2025-10-10 Yihong Luo , Tianyang Hu , Jing Tang

The Group Relative Policy Optimization (GRPO), a reinforcement learning method used to fine-tune large language models (LLMs), has proved its effectiveness in practical applications such as DeepSeek-R1. It raises a question whether GRPO can…

机器学习 · 计算机科学 2025-11-20 Yanchen Xu , Ziheng Jiao , Hongyuan Zhang , Xuelong Li

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

机器学习 · 计算机科学 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Reinforcement learning is widely used to improve the reasoning ability of large language models, especially when answers can be automatically checked. Standard GRPO-style training updates the model using only the current step, while full…

机器学习 · 计算机科学 2026-05-11 Ismam Nur Swapnil , Aranya Saha , Tanvir Ahmed Khan , Mohammad Ariful Haque , Ser-Nam Lim

Recent large reasoning models (LRMs) driven by reinforcement learning algorithms (e.g., GRPO) have achieved remarkable performance on challenging reasoning tasks. However, these models suffer from overthinking, generating unnecessarily long…

人工智能 · 计算机科学 2026-03-03 Gang Li , Yan Chen , Ming Lin , Tianbao Yang

Reinforcement learning from verifiable rewards has significantly advanced the reasoning capabilities of large language models. However, Group Relative Policy Optimization (GRPO) typically assigns a uniform, sequence-level advantage to all…

机器学习 · 计算机科学 2026-04-06 Song Yu , Li Li , Wenwen Zhao , Zhisheng Yang

Proximal Policy Optimization (PPO) is central to aligning Large Language Models (LLMs) in reasoning tasks with verifiable rewards. However, standard token-level PPO struggles in this setting due to the instability of temporal credit…

人工智能 · 计算机科学 2026-04-13 Tianyi Wang , Yixia Li , Long Li , Yibiao Chen , Shaohan Huang , Yun Chen , Peng Li , Yang Liu , Guanhua Chen

Large Language Models (LLMs) have achieved strong performance on a wide range of complex reasoning tasks, yet further gains are often possible by leveraging the complementary strengths of multiple models. While multi-agent frameworks can…

多智能体系统 · 计算机科学 2025-07-15 Andrew Estornell , Jean-Francois Ton , Muhammad Faaiz Taufiq , Hang Li

Analyzing the human factors behind aviation accidents is crucial for preventing future incidents, yet traditional methods using the Human Factors Analysis and Classification System (HFACS) are limited by scalability and consistency. To…

计算与语言 · 计算机科学 2025-09-01 Arash Ahmadi , Sarah Sharif , Yaser Banad

Large language model (LLM) agents have recently demonstrated strong capabilities in interactive decision-making, yet they remain fundamentally limited in long-horizon tasks that require structured planning and reliable execution. Existing…

人工智能 · 计算机科学 2026-05-06 Hongbo Jin , Rongpeng Zhu , Jiayu Ding , Guibo Luo , Ge Li

Multi-agent systems (MAS) and reinforcement learning (RL) are widely used to enhance the agentic capabilities of large language models (LLMs). MAS improves task performance through role-based orchestration, while RL uses environmental…

机器学习 · 计算机科学 2026-02-02 Yujie Zhao , Lanxiang Hu , Yang Wang , Minmin Hou , Hao Zhang , Ke Ding , Jishen Zhao

Latent reasoning offers a more efficient alternative to explicit reasoning by compressing intermediate reasoning into continuous representations and substantially shortening reasoning chains. However, existing latent reasoning methods…

机器学习 · 计算机科学 2026-05-01 Jingcheng Deng , Zihao Wei , Liang Pang , Junhong Wu , Shicheng Xu , Zenghao Duan , Huawei Shen

Search agents extend Large Language Models (LLMs) beyond static parametric knowledge by enabling access to up-to-date and long-tail information unavailable during pretraining. While reinforcement learning has been widely adopted for…

机器学习 · 计算机科学 2026-04-21 Junzhe Wang , Zhiheng Xi , Yajie Yang , Hao Luo , Shihan Dou , Tao Gui , Qi Zhang

Trust region methods rigorously enabled reinforcement learning (RL) agents to learn monotonically improving policies, leading to superior performance on a variety of tasks. Unfortunately, when it comes to multi-agent reinforcement learning…

人工智能 · 计算机科学 2022-04-05 Jakub Grudzien Kuba , Ruiqing Chen , Muning Wen , Ying Wen , Fanglei Sun , Jun Wang , Yaodong Yang

Reinforcement learning with verifiers (RLVR) has become a central paradigm for improving LLM reasoning, yet popular group-based optimization algorithms like GRPO often suffer from exploration collapse, where the models prematurely converge…

人工智能 · 计算机科学 2026-05-19 Haoxuan Chen , Tianming Liang , Wei-Shi Zheng , Jian-Fang Hu

On-policy reinforcement learning methods, like Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), often demand extensive data per update, leading to sample inefficiency. This paper introduces Reflective Policy…

机器学习 · 计算机科学 2024-06-07 Yaozhong Gan , Renye Yan , Zhe Wu , Junliang Xing

Solving long-horizon goal-conditioned tasks remains a significant challenge in reinforcement learning (RL). Hierarchical reinforcement learning (HRL) addresses this by decomposing tasks into more manageable sub-tasks, but the automatic…

机器学习 · 计算机科学 2025-09-09 Yang Yu

As reconfigurable intelligent surfaces (RIS) emerge as a pivotal technology in the upcoming sixth-generation (6G) networks, their deployment within practical multiple operator (OP) networks presents significant challenges, including the…

系统与控制 · 电气工程与系统科学 2025-02-24 Haocheng Zhang , Wei Wang , Hao Zhou , Zhiping Lu , Ming Li

This work considers the problem of learning cooperative policies in multi-agent settings with partially observable and non-stationary environments without a communication channel. We focus on improving information sharing between agents and…

机器学习 · 计算机科学 2021-09-03 Eshagh Kargar , Ville Kyrki