中文
相关论文

相关论文: Post-Training and Test-Time Scaling of Generative …

200 篇论文

Model-based reinforcement learning approaches carry the promise of being data efficient. However, due to challenges in learning dynamics models that sufficiently match the real-world dynamics, they struggle to achieve the same asymptotic…

机器学习 · 计算机科学 2018-09-17 Ignasi Clavera , Jonas Rothfuss , John Schulman , Yasuhiro Fujita , Tamim Asfour , Pieter Abbeel

Group Relative Policy Optimization (GRPO) has become the dominant method for reinforcement learning with verifiable rewards in large language models, but it suffers from two critical limitations: gradient vanishing and diversity collapse.…

机器学习 · 计算机科学 2026-05-20 Khiem Le , Phuc Nguyen , Youssef Mroueh , Chi-Heng Lin , Shangqian Gao , Ting Hua , Nitesh V. Chawla

An open problem in autonomous vehicle safety validation is building reliable models of human driving behavior in simulation. This work presents an approach to learn neural driving policies from real world driving demonstration data. We…

As the industry of autonomous driving grows, so does the potential interaction of groups of autonomous cars. Combined with the advancement of Artificial Intelligence and simulation, such groups can be simulated, and safety-critical models…

机器学习 · 计算机科学 2024-02-22 Omar Tanner

Group Relative Policy Optimization (GRPO) has emerged as an effective and lightweight framework for post-training visual generative models. However, its performance is fundamentally limited by the ambiguity of textual visual correspondence:…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Ruiying Liu , Yuanzhi Liang , Haibin Huang , Tianshu Yu , Chi Zhang

Current post-training methodologies for adapting Large Vision-Language Models (LVLMs) generally fall into two paradigms: Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL). Despite their prevalence, both approaches suffer from…

机器学习 · 计算机科学 2026-04-21 Yuming Yan , Kai Tang , Sihong Chen , Ke Xu , Dan Hu , Qun Yu , Pengfei Hu

Reinforcement learning (RL) is attracting increasing interests in autonomous driving due to its potential to solve complex classification and control problems. However, existing RL algorithms are rarely applied to real vehicles for two…

机器学习 · 计算机科学 2020-03-04 Lu Wen , Jingliang Duan , Shengbo Eben Li , Shaobing Xu , Huei Peng

Outcome-driven reinforcement learning has advanced reasoning in large language models (LLMs), but prevailing tool-augmented approaches train a single, monolithic policy that interleaves thoughts and tool calls under full context; this…

人工智能 · 计算机科学 2025-10-08 Zhuofeng Li , Haoxiang Zhang , Seungju Han , Sheng Liu , Jianwen Xie , Yu Zhang , Yejin Choi , James Zou , Pan Lu

Reinforcement learning (RL) is a key paradigm for post-training large language models (LLMs), but the widely used Group Relative Policy Optimization (GRPO) often suffers from entropy collapse: exploration quickly disappears, policies…

机器学习 · 计算机科学 2026-05-19 Chen Wang , Zhaochun Li , Jionghao Bai , Hexuan Deng , Ge Lan , Yue Wang

Group Relative Policy Optimization (GRPO), which is widely adopted by R1-like reasoning models, has advanced mathematical reasoning. Nevertheless, GRPO faces challenges in reward sparsity, verbosity, and inadequate focus on problem…

计算与语言 · 计算机科学 2025-09-23 Jixiao Zhang , Chunsheng Zuo

Large Language Models (LLMs) have shown promise in solving complex mathematical problems, yet they still fall short of producing accurate and consistent solutions. Reinforcement Learning (RL) is a framework for aligning these models with…

人工智能 · 计算机科学 2026-02-10 Ali Hatamizadeh , Shrimai Prabhumoye , Igor Gitman , Ximing Lu , Seungju Han , Wei Ping , Yejin Choi , Jan Kautz

Although deep reinforcement learning (DRL) has shown promising results for autonomous navigation in interactive traffic scenarios, existing work typically adopts a fixed behavior policy to control social vehicles in the training…

机器人学 · 计算机科学 2023-07-20 Kanghoon Lee , Jiachen Li , David Isele , Jinkyoo Park , Kikuo Fujimura , Mykel J. Kochenderfer

Group Relative Policy Optimization (GRPO) has significantly advanced the training of large language models and enhanced their reasoning capabilities, while it remains susceptible to instability due to the use of hard clipping. Soft Adaptive…

机器学习 · 计算机科学 2026-03-26 Egor Denisov , Svetlana Glazyrina , Maksim Kryzhanovskiy , Roman Ischenko

Group-relative RL training (GRPO) samples a small group of parallel rollouts for every training prompt and uses their within-group reward spread to compute per-trajectory advantages. In agentic environments each rollout is a long multi-turn…

机器学习 · 计算机科学 2026-05-08 Zhiyuan Zhai , Xin Wang

Group Relative Policy Optimization (GRPO) enables stable and preference-oriented updates via group-wise comparisons for post-training video generation. However, GRPO directly optimizes reward-induced advantages. Under sustained…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Rui Li , Yuanzhi Liang , Ziqi Ni , Haibing Huang , Chi Zhang , Xuelong Li

Simulation environments are good for learning different driving tasks like lane changing, parking or handling intersections etc. in an abstract manner. However, these simulation environments often restrict themselves to operate under…

机器学习 · 计算机科学 2021-11-01 Ashish Rana , Avleen Malhi

Large reasoning models that use long chain-of-thought excel at problem-solving yet waste compute on redundant checks. Curbing this overthinking is hard: training-time length penalties can cripple ability, while inference-time early-exit…

人工智能 · 计算机科学 2026-04-21 Benteng Chen , Weida Wang , Shufei Zhang , Mingbao Lin , Min Zhang

Imitation learning trains control policies by mimicking pre-recorded expert demonstrations. In partially observable settings, imitation policies must rely on observation histories, but many seemingly paradoxical results show better…

机器学习 · 计算机科学 2021-06-14 Chuan Wen , Jierui Lin , Jianing Qian , Yang Gao , Dinesh Jayaraman

The potential benefits of model-free reinforcement learning to real robotics systems are limited by its uninformed exploration that leads to slow convergence, lack of data-efficiency, and unnecessary interactions with the environment. To…

机器人学 · 计算机科学 2020-11-04 Yuchen Wu , Melissa Mozifian , Florian Shkurti

This paper proposes an adaptive behavioral decision-making method for autonomous vehicles (AVs) focusing on complex merging scenarios. Leveraging principles from non-cooperative game theory, we develop a vehicle interaction behavior model…

多智能体系统 · 计算机科学 2024-03-19 Heye Huang , Jinxin Liu , Guanya Shi , Shiyue Zhao , Boqi Li , Jianqiang Wang