中文
相关论文

相关论文: Learning to Credit the Right Steps: Objective-awar…

200 篇论文

Deploying GRPO on Flow Matching models has proven effective for text-to-image generation. However, existing paradigms typically propagate an outcome-based reward to all preceding denoising steps without distinguishing the local effect of…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Yunze Tong , Mushui Liu , Canyu Zhao , Wanggui He , Shiyi Zhang , Hongwei Zhang , Peng Zhang , Jinlong Liu , Ju Huang , Jiamang Wang , Hao Jiang , Pipei Huang

Image fusion is a crucial technique in the field of computer vision, and its goal is to generate high-quality fused images and improve the performance of downstream tasks. However, existing fusion methods struggle to balance these two…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Hui Li , Congcong Bian , Zeyang Zhang , Xiaoning Song , Xi Li , Xiao-Jun Wu

Achieving high-fidelity generation in extremely few sampling steps has long been a central goal of generative modeling. Existing approaches largely rely on distillation-based frameworks to compress the original multi-step denoising process…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Rui Li , Bingyu Li , Yuanzhi Liang , Haibin Huang , Chi Zhang , XueLong Li

Group Relative Policy Optimization (GRPO) assigns a single scalar advantage to all tokens in a completion. For structured generations with explicit segments and objectives, this couples unrelated reward signals across segments, leading to…

机器学习 · 计算机科学 2026-02-12 Kirill Pavlenko , Alexander Golubev , Simon Karasik , Boris Yangel

Recent Progress in post-training flow matching for text-to-image (T2I) generation with Group Relative Policy Optimization (GRPO) has demonstrated strong potential. However, it is hindered by a critical limitation: inaccurate advantage…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Yifu Luo , Haoyuan Sun , Xinhao Hu , Penghui Du , Keyu Fan , Bo Li , Sinan Du , Xu Wan , Zhiyu Chen , Bo Xia , Tiantian Zhang , Yongzhe Chang , Changqian Yu , Kun Gai , Xueqian Wang

Group Relative Policy Optimization (GRPO), which is widely adopted by R1-like reasoning models, has advanced mathematical reasoning. Nevertheless, GRPO faces challenges in reward sparsity, verbosity, and inadequate focus on problem…

计算与语言 · 计算机科学 2025-09-23 Jixiao Zhang , Chunsheng Zuo

Recent advancements adopt online reinforcement learning (RL) from LLMs to text-to-image rectified flow diffusion models for reward alignment. The use of group-level rewards successfully aligns the model with the targeted reward. However, it…

机器学习 · 计算机科学 2026-01-06 Yiyang Wang , Xi Chen , Xiaogang Xu , Yu Liu , Hengshuang Zhao

Recent advancements in multimodal reward models (RMs) have significantly propelled the development of visual generation. Existing frameworks typically adopt Bradley-Terry-style preference modeling or leverage generative VLMs as judges, and…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Yibin Wang , Yuhang Zang , Feng Han , Jiazi Bu , Yujie Zhou , Cheng Jin , Jiaqi Wang

Current mainstream methods of aligning diffusion models with human preferences typically employ VLM-based reward models. However, these reward models, pre-trained for semantic alignment, struggle to capture the essential perceptual…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Jaxon Zhang , Binxin Yang , Hubery Yin , Chen Li , Jing Lyu

Generative AI has significantly changed industries by enabling text-driven image generation, yet challenges remain in achieving high-resolution outputs that align with fine-grained user preferences. Consequently, multi-round interactions…

计算机视觉与模式识别 · 计算机科学 2025-04-28 Kun Li , Jianhui Wang , Yangfan He , Xinyuan Song , Ruoyu Wang , Hongyang He , Wenxin Zhang , Jiaqi Chen , Keqin Li , Sida Li , Miao Zhang , Tianyu Shi , Xueqian Wang

Expressive generative models have advanced robotic manipulation by capturing complex, multi-modal action distributions over temporally extended trajectories. However, fine-tuning these policies via RL remains challenging due to instability…

机器人学 · 计算机科学 2026-04-03 Yuhui Chen , Haoran Li , Zhennan Jiang , Yuxing Qin , Yuxuan Wan , Weiheng Liu , Dongbin Zhao

Recently, reinforcement learning (RL) has been employed for improving generative image super-resolution (ISR) performance. However, the current efforts are focused on multi-step generative ISR, while one-step generative ISR remains…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Qiaosi Yi , Shuai Li , Rongyuan Wu , Lingchen Sun , Zhengqiang Zhang , Lei Zhang

Recent advancements in reinforcement learning, particularly through Group Relative Policy Optimization (GRPO), have significantly improved multimodal large language models for complex reasoning tasks. However, two critical limitations…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Jisheng Dang , Jingze Wu , Teng Wang , Xuanhui Lin , Nannan Zhu , Hongbo Chen , Wei-Shi Zheng , Meng Wang , Tat-Seng Chua

Group-based reinforcement learning methods, like Group Relative Policy Optimization (GRPO), are widely used nowadays to post-train large language models. Despite their empirical success, they exhibit structural mismatches between reward…

机器学习 · 计算机科学 2026-01-09 Aleksandar Fontana , Marco Simoni , Giulio Rossolini , Andrea Saracino , Paolo Mori

Contemporary reinforcement learning with verifiable reward methods post-train language models on multi-step reasoning by assigning a single outcome reward uniformly across all tokens in a trajectory. Such uniform assignment ignores which…

Despite the promising progress of recent autoregressive models in text-to-image (T2I) generation, their ability to handle multi-attribute and ambiguous prompts remains limited. To address these limitations, existing works have applied…

计算机视觉与模式识别 · 计算机科学 2025-08-27 Yaqi Li , Peng Chen , Mingyang Han , Pi Bu , Haoxiang Shi , Runzhou Zhao , Yang Yao , Xuan Zhang , Jun Song , Bo Zheng

Recent advances in flow matching models, particularly with reinforcement learning (RL), have significantly enhanced human preference alignment in few step text to image generators. However, existing RL based approaches for flow matching…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Zhixiong Yue , Zixuan Ni , Feiyang Ye , Jinshan Zhang , Sheng Shen , Zhenpeng Mi

Intent detection, a critical component in task-oriented dialogue (TOD) systems, faces significant challenges in adapting to the rapid influx of integrable tools with complex interrelationships. Existing approaches, such as zero-shot…

计算与语言 · 计算机科学 2025-04-22 Zihao Feng , Xiaoxue Wang , Ziwei Bai , Donghang Su , Bowen Wu , Qun Yu , Baoxun Wang

Despite rapid advances in text-to-image generation, faithfully realizing user intent remains challenging, often requiring manual multi-turn trial and error. To automate this process, existing systems rely on either simple prompt rewriting…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Jinming Liu , Ruoyu Feng , Yuqi Wang , Wenjun Zeng , Xin Jin

While Reinforcement Learning from Verifiable Rewards (RLVR) has advanced reasoning in Large Vision-Language Models (LVLMs), prevailing frameworks suffer from a foundational methodological flaw: by distributing identical advantages across…

人工智能 · 计算机科学 2026-04-09 Zekai Ye , Qiming Li , Xiaocheng Feng , Ruihan Chen , Ziming Li , Haoyu Ren , Kun Chen , Dandan Tu , Bing Qin