中文
相关论文

相关论文: Robust Tool Use via Fission-GRPO: Learning to Reco…

200 篇论文

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach for improving the reasoning abilities of large language models (LLMs). The Group Relative Policy Optimization (GRPO) family has demonstrated strong…

计算与语言 · 计算机科学 2025-11-10 Chenxi Liu , Junjie Liang , Yuqi Jia , Bochuan Cao , Yang Bai , Heng Huang , Xun Chen

Group-based reinforcement learning algorithms such as Group Reward Policy Optimization (GRPO) have proven effective for fine-tuning large language models (LLMs) with human feedback. However, generating and storing multiple responses per…

机器学习 · 计算机科学 2025-07-01 Liangyu Wang , Huanyi Xie , Xinhai Wang , Tianjin Huang , Mengdi Li , Di Wang

Group Relative Policy Optimization (GRPO) is highly effective for post-training autoregressive (AR) language models, yet its direct application to diffusion large language models (dLLMs) often triggers reward collapse. We identify two…

机器学习 · 计算机科学 2026-03-10 Jianyuan Zhong , Kaibo Wang , Ding Ding , Zijin Feng , Haoli Bai , Yang Xiang , Jiacheng Sun , Qiang Xu

On-policy reinforcement learning (RL) has become a popular framework for solving sequential decision problems due to its computational efficiency and theoretical simplicity. Some on-policy methods guarantee every policy update is…

机器学习 · 计算机科学 2023-12-12 K. R. Zentner , Ujjwal Puri , Zhehui Huang , Gaurav S. Sukhatme

The growing complexity of Edge Video Analytics (EVA) facilitates new kind of intelligent applications, but creates challenges in real-time inference serving systems. State-of-the-art (SOTA) scheduling systems optimize global workload…

分布式、并行与集群计算 · 计算机科学 2025-07-25 Lucas Liebe , Thanh-Tung Nguyen , Dongman Lee

Recent progress in flow-based generative models and reinforcement learning (RL) has improved text-image alignment and visual quality. However, current RL training for flow models still has two main problems: (i) GRPO-style fixed per-prompt…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Kaijie Chen , Zhiyang Xu , Ying Shen , Zihao Lin , Yuguang Yao , Lifu Huang

When applying reinforcement learning--typically through GRPO--to large vision-language model reasoning struggles to effectively scale reasoning length or generates verbose outputs across all tasks with only marginal gains in accuracy. To…

计算与语言 · 计算机科学 2025-10-24 Wenyi Xiao , Leilei Gan

Group Relative Policy Optimization (GRPO) has been a key driver of recent progress in reinforcement learning with verifiable rewards (RLVR) for large language models, but it is typically trained in a low-staleness, near-on-policy regime…

机器学习 · 计算机科学 2026-05-19 Minghao Tian , Yunfei Xie , Chen Wei

Recent research has highlighted the powerful capabilities of imitation learning in robotics. Leveraging generative models, particularly diffusion models, these approaches offer notable advantages such as strong multi-task generalization,…

机器人学 · 计算机科学 2025-09-15 Xinyao Qin , Xiaoteng Ma , Yang Qi , Qihan Liu , Chuanyi Xue , Ning Gui , Qinyu Dong , Jun Yang , Bin Liang

Multi-agent systems (MAS) and reinforcement learning (RL) are widely used to enhance the agentic capabilities of large language models (LLMs). MAS improves task performance through role-based orchestration, while RL uses environmental…

机器学习 · 计算机科学 2026-02-02 Yujie Zhao , Lanxiang Hu , Yang Wang , Minmin Hou , Hao Zhang , Ke Ding , Jishen Zhao

We present Future-KL Influenced Policy Optimization (FIPO), a reinforcement learning algorithm designed to overcome reasoning bottlenecks in large language models. While GRPO style training scales effectively, it typically relies on…

Group Relative Policy Optimization (GRPO) has emerged as a popular algorithm for reinforcement learning with large language models (LLMs). However, upon analyzing its clipping mechanism, we argue that it is suboptimal in certain scenarios.…

机器学习 · 计算机科学 2026-01-08 Chi Liu , Xin Chen

Reinforcement learning (RL) has garnered increasing attention in text-to-image (T2I) generation. However, most existing RL approaches are tailored to either diffusion models or autoregressive models, overlooking an important alternative:…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Yifu Luo , Xinhao Hu , Keyu Fan , Haoyuan Sun , Zeyu Chen , Bo Xia , Tiantian Zhang , Yongzhe Chang , Xueqian Wang

Multi-fidelity Reinforcement Learning (RL) frameworks efficiently utilize computational resources by integrating analysis models of varying accuracy and costs. The prevailing methodologies, characterized by transfer learning, human-inspired…

机器学习 · 计算机科学 2025-03-25 Akash Agrawal , Christopher McComb

Reinforcement Learning with Human Feedback (RLHF) has been the dominant approach for improving the reasoning capabilities of Large Language Models (LLMs). Recently, Reinforcement Learning with Verifiable Rewards (RLVR) has simplified this…

计算与语言 · 计算机科学 2025-10-10 Yining Wang , Jinman Zhao , Chuangxin Zhao , Shuhao Guan , Gerald Penn , Shinan Liu

In this work, we study the problem of code generation with a large language model (LLM), with a focus on generating SQL queries from natural language questions. We ask: Instead of using supervised fine tuning with text-code pairs, can we…

计算与语言 · 计算机科学 2025-06-09 Atharv Kulkarni , Vivek Srikumar

RL-based post-training with GRPO is widely used to improve large language models on individual reasoning tasks. However, real-world deployment requires reliable performance across diverse tasks. A straightforward multi-task adaptation of…

Tool-use capability is a fundamental component of LLM agents, enabling them to interact with external systems through structured function calls. However, existing research exhibits inconsistent interaction representations, largely overlooks…

人工智能 · 计算机科学 2026-05-26 Yijuan Liang , Xinghao Chen , Yifan Ge , Ziyi Wu , Hao Wu , Changyu Zeng , Wei Xing , Xiaoyu Shen

Code repair is a fundamental task in software development, facilitating efficient bug resolution and software maintenance. Although large language models (LLMs) have demonstrated considerable potential in automated code repair, their…

软件工程 · 计算机科学 2026-02-27 Dekun Dai , MingWei Liu , Anji Li , Jialun Cao , Yanlin Wang , Chong Wang , Xin Peng , Zibin Zheng

Reinforcement Learning with Verifiable Rewards (RLVR) is an essential paradigm that enhances the reasoning capabilities of Large Language Models (LLMs). However, existing methods typically rely on static policy optimization schemes that…

计算与语言 · 计算机科学 2026-05-08 Yiming Huang , Zhenbo Shi , Shuzheng Gao , Cuiyun Gao , Peiyi Han , Chuanyi Liu