中文
相关论文

相关论文: On the Hidden Objective Biases of Group-based Rein…

200 篇论文

Latent reasoning offers a more efficient alternative to explicit reasoning by compressing intermediate reasoning into continuous representations and substantially shortening reasoning chains. However, existing latent reasoning methods…

机器学习 · 计算机科学 2026-05-01 Jingcheng Deng , Zihao Wei , Liang Pang , Junhong Wu , Shicheng Xu , Zenghao Duan , Huawei Shen

Reinforcement learning (RL) has emerged as an effective approach for enhancing the reasoning capabilities of large language models (LLMs), especially in scenarios where supervised fine-tuning (SFT) falls short due to limited…

机器学习 · 计算机科学 2026-04-15 Jian Xiong , Jingbo Zhou , Jingyong Ye , Qiang Huang , Dejing Dou

Automated Theorem Proving (ATP) represents a fundamental challenge in Artificial Intelligence (AI), requiring the construction of machine-verifiable proofs in formal languages such as Lean to evaluate AI reasoning capabilities.…

人工智能 · 计算机科学 2026-01-23 Zhengqing Yan , Xinyang Liu , Yi Zhang , Fan Guo , ChengXun Jia , Junchen Wan , Yao Liu , Qi Liu , Jihao Huang , Kang Song

Large language models are typically post-trained using supervised fine-tuning (SFT) and reinforcement learning (RL), yet effectively unifying efficient knowledge injection with robust generalization remains challenging. In this work, we…

人工智能 · 计算机科学 2026-05-05 Wangjie Gan , Miao Pan , Linbo Xi , Wenqi Zhang , Jintao Chen , Jianwei Yin , Xuhong Zhang

Generative models, particularly diffusion models, have achieved remarkable success in density estimation for multimodal data, drawing significant interest from the reinforcement learning (RL) community, especially in policy modeling in…

机器学习 · 计算机科学 2024-12-03 Jinouwen Zhang , Rongkun Xue , Yazhe Niu , Yun Chen , Jing Yang , Hongsheng Li , Yu Liu

Group Relative Policy Optimization (GRPO) has emerged as an effective and lightweight framework for post-training visual generative models. However, its performance is fundamentally limited by the ambiguity of textual visual correspondence:…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Ruiying Liu , Yuanzhi Liang , Haibin Huang , Tianshu Yu , Chi Zhang

Group Relative Policy Optimization (GRPO) is effective for training language models on complex reasoning. However, since the objective is defined relative to a group of sampled trajectories, extended deliberation can create more chances to…

Unsupervised speech emotion recognition (SER) focuses on addressing the problem of data sparsity and annotation bias of emotional speech. Reinforcement learning (RL) is a promising method which enhances the performance through rule-based or…

音频与语音处理 · 电气工程与系统科学 2026-02-09 Yingying Gao , Shilei Zhang , Runyan Yang , Zihao Cui , Junlan Feng

Text-to-Image (T2I) generation has achieved remarkable progress in recent years. Meanwhile, reinforcement learning methods, particularly those based on Group Relative Policy Optimization (GRPO), have attracted widespread attention and been…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Baoteng Li , Xianghao Zang , Xinran Wang , Xiangyu Na , Zhixiang He , Hao Sun , Chi Zhang , Zhongjiang He , Tianwei Cao , Kongming Liang , Zhanyu Ma

Multimodal Large Language Models (MLLMs) excel in vision-language reasoning but often struggle with structured perception tasks requiring precise localization and robustness. We propose a reinforcement learning framework that augments Group…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Xu Jia

Reinforcement learning (RL) has proven effective in strengthening the reasoning capabilities of large language models (LLMs). A widely adopted method, Group Relative Policy Optimization (GRPO), has shown strong empirical results in training…

机器学习 · 计算机科学 2026-03-11 Peter Chen , Xiaopeng Li , Ziniu Li , Xi Chen , Tianyi Lin

Group Relative Policy Optimization (GRPO) assigns a single scalar advantage to all tokens in a completion. For structured generations with explicit segments and objectives, this couples unrelated reward signals across segments, leading to…

机器学习 · 计算机科学 2026-02-12 Kirill Pavlenko , Alexander Golubev , Simon Karasik , Boris Yangel

Preference optimization is widely used to align Large Language Models (LLMs) with preference feedback. However, most existing methods train on a single positive-negative pair per prompt, discarding additional supervision available in…

计算与语言 · 计算机科学 2026-04-20 Jixuan Leng , Si Si , Hsiang-Fu Yu , Vinod Raman , Inderjit S. Dhillon

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

机器学习 · 计算机科学 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

Group Relative Policy Optimization (GRPO) has become a standard approach for training mathematical reasoning models; however, its reliance on multiple completions per prompt makes training computationally expensive. Although recent work has…

机器学习 · 计算机科学 2026-01-15 Kangda Wei , Ruihong Huang

Learning interactive motion behaviors among multiple agents is a core challenge in autonomous driving. While imitation learning models generate realistic trajectories, they often inherit biases from datasets dominated by safe…

机器人学 · 计算机科学 2025-12-16 Hyunki Seong , Jeong-Kyun Lee , Heesoo Myeong , Yongho Shin , Hyun-Mook Cho , Duck Hoon Kim , Pranav Desai , Monu Surana

Reinforcement Learning with Verifiable Rewards (RLVR) has markedly enhanced the reasoning abilities of large language models (LLMs). Its success, however, largely depends on strong base models with rich world knowledge, yielding only modest…

人工智能 · 计算机科学 2025-08-19 Yongxin Guo , Wenbo Deng , Zhenglin Cheng , Xiaoying Tang

Fine-tuning pre-trained generative models with Reinforcement Learning (RL) has emerged as an effective approach for aligning outputs more closely with nuanced human preferences. In this paper, we investigate the application of Group…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Matteo Gallici , Haitz Sáez de Ocáriz Borde

Large Language Models (LLMs) are increasingly deployed in business-critical domains such as finance, education, healthcare, and customer support, where users expect consistent and reliable recommendations. Yet LLMs often exhibit variability…

机器学习 · 计算机科学 2026-04-20 Sonal Prabhune , Balaji Padmanabhan , Kaushik Dutta

Group-Relative Policy Optimization (GRPO) has emerged as an efficient paradigm for aligning Large Language Models (LLMs), yet its efficacy is primarily confined to domains with verifiable ground truths. Extending GRPO to open-domain…

机器学习 · 计算机科学 2026-04-14 Yang Zhao , Hepeng Wang , Xiao Ding , Yangou Ouyang , Bibo Cai , Kai Xiong , Jinglong Gao , Zhouhao Sun , Li Du , Bing Qin , Ting Liu