中文
相关论文

相关论文: VAR RL Done Right: Tackling Asynchronous Policy Co…

200 篇论文

Reinforcement learning (RL) has shown extraordinary potential in aligning diffusion models to downstream tasks, yet most of them still suffer from significant reward hacking, which degrades generative diversity and quality by inducing…

机器学习 · 计算机科学 2026-05-14 Jiaming Li , Chenyu Zhu , Nanxi Yi , Youjun Bao , Li Sun , Quanying Lv , Xiang Fang , Daizong Liu , Jianjun Li , Kun He , Bowen Zhou , Zhiyuan Ma

The rapid proliferation of AI-generated video necessitates robust detection tools that offer both high accuracy and human-interpretable explanations. While existing MLLM-based detectors rely on supervised fine-tuning (SFT) or direct…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Kyoungjun Park , Yifan Yang , Juheon Yi , Shicheng Zheng , Yifei Shen , Dongqi Han , Caihua Shan , Muhammad Muaz , Lili Qiu

Self-supervised reinforcement learning (RL) presents a promising approach for enhancing the reasoning capabilities of Large Language Models (LLMs) without reliance on expensive human-annotated data. However, we find that existing methods…

人工智能 · 计算机科学 2025-12-16 Bizhe Bai , Hongming Wu , Peng Ye , Tao Chen

Aligning denoising generative models with human preferences or verifiable rewards remains a key challenge. While policy-gradient online reinforcement learning (RL) offers a principled post-training framework, its direct application is…

机器学习 · 计算机科学 2026-04-28 Bingda Tang , Yuhui Zhang , Xiaohan Wang , Jiayuan Mao , Ludwig Schmidt , Serena Yeung-Levy

Video diffusion models have made rapid progress in perceptual realism and temporal coherence, but they remain primarily optimized for plausible generation rather than verifiable reasoning. This limitation is especially pronounced in tasks…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Tinghui Zhu , Sheng Zhang , James Y. Huang , Selena Song , Xiaofei Wen , Yuankai Li , Hoifung Poon , Muhao Chen

Alignment methodologies have emerged as a critical pathway for enhancing language model alignment capabilities. While SFT (supervised fine-tuning) accelerates convergence through direct token-level loss intervention, its efficacy is…

Reinforcement Learning with Verifiable Rewards (RLVR), primarily driven by the Group Relative Policy Optimization (GRPO) algorithm, is a leading approach for enhancing the reasoning abilities of Large Language Models (LLMs). Despite its…

机器学习 · 计算机科学 2025-10-21 Kangqi Ni , Zhen Tan , Zijie Liu , Pingzhi Li , Tianlong Chen

Reinforcement Learning with Verifiable Rewards (RLVR) has demonstrated notable success in enhancing the reasoning performance of large language models (LLMs). However, recent studies reveal that while current RLVR methods improve sampling…

人工智能 · 计算机科学 2026-05-08 Yang Xu , Kun Yao , Yiming Deng , Zheng Fang , Kai Ming Ting , Ming Pang

Unified models capable of interleaved generation have emerged as a promising paradigm, with the community increasingly converging on autoregressive modeling for text and flow matching for image generation. To advance this direction, we…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Jie Liu , Zilyu Ye , Linxiao Yuan , Shenhan Zhu , Yu Gao , Jie Wu , Kunchang Li , Xionghui Wang , Xiaonan Nie , Weilin Huang , Wanli Ouyang

Visual autoregressive (VAR) models have recently emerged as a promising alternative for image generation, offering stable training, non-iterative inference, and high-fidelity synthesis through next-scale prediction. This encourages the…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Cencen Liu , Dongyang Zhang , Wen Yin , Jielei Wang , Tianyu Li , Ji Guo , Wenbo Jiang , Guoqing Wang , Guoming Lu

We introduce Heterogeneous Agent Collaborative Reinforcement Learning (HACRL), a new Reinforcement Learning from Verifiable Reward (RLVR) problem that addresses the inefficiencies of isolated multi-agent on-policy optimization. HACRL…

Text-to-audio (T2A) generation has advanced considerably in recent years, yet existing methods continue to face challenges in accurately rendering complex text prompts, particularly those involving intricate audio effects, and achieving…

音频与语音处理 · 电气工程与系统科学 2026-03-03 Yi Gu , Yanqing Liu , Chen Yang , Sheng Zhao

A fundamental objective of manipulation policy design is to endow robots to comprehend human instructions, reason about scene cues, and execute generalized actions in dynamic environments. Recent autoregressive vision-language-action (VLA)…

Recent advancements in Reinforcement Learning (RL), particularly Group Relative Policy Optimization (GRPO), have significantly enhanced the reasoning capabilities of Large Language Models. However, applying these problem-centric…

计算与语言 · 计算机科学 2026-05-26 Yihong Tang , Kehai Chen , Liang Yue , Benyou Wang , Min Zhang

High-level autonomous driving requires motion planners capable of modeling multimodal future uncertainties while remaining robust in closed-loop interactions. Although diffusion-based planners are effective at modeling complex trajectory…

计算机视觉与模式识别 · 计算机科学 2026-04-17 Hao Gao , Shaoyu Chen , Yifan Zhu , Yuehao Song , Wenyu Liu , Qian Zhang , Xinggang Wang

Existing Reinforcement Learning from Verifiable Rewards (RLVR) methods, such as Group Relative Policy Optimization (GRPO), have achieved remarkable progress in improving the reasoning capabilities of Large Reasoning Models (LRMs). However,…

机器学习 · 计算机科学 2026-04-16 Hsiu-Yuan Huang , Chenming Tang , Weijie Liu , Clive Bai , Saiyong Yang , Yunfang Wu

Group Relative Policy Optimization (GRPO) has shown promise in discrete action spaces by eliminating value function dependencies through group-based advantage estimation. However, its application to continuous control remains unexplored,…

机器人学 · 计算机科学 2025-07-29 Rajat Khanda , Mohammad Baqar , Sambuddha Chakrabarti , Satyasaran Changdar

Recent advancements in flow-matching have enabled high-quality text-to-image generation. However, the deterministic nature of flow-matching models makes them poorly suited for reinforcement learning, a key tool for improving image quality…

计算机视觉与模式识别 · 计算机科学 2025-10-06 Benjamin Yu , Jackie Liu , Justin Cui

Reinforcement learning (RL) is an effective approach to learn an optimal dialog policy for task-oriented visual dialog systems. A common practice is to apply RL on a neural sequence-to-sequence (seq2seq) framework with the action space…

计算与语言 · 计算机科学 2019-10-30 Mingyang Zhou , Josh Arnold , Zhou Yu

While Reinforcement Learning from Verifiable Rewards (RLVR) has advanced reasoning in Large Vision-Language Models (LVLMs), prevailing frameworks suffer from a foundational methodological flaw: by distributing identical advantages across…

人工智能 · 计算机科学 2026-04-09 Zekai Ye , Qiming Li , Xiaocheng Feng , Ruihan Chen , Ziming Li , Haoyu Ren , Kun Chen , Dandan Tu , Bing Qin