中文
相关论文

相关论文: UDM-GRPO: Stable and Efficient Group Relative Poli…

200 篇论文

Reinforcement learning has emerged as a powerful tool for improving diffusion-based text-to-image models, but existing methods are largely limited to single-task optimization. Extending RL to multiple tasks is challenging: joint…

机器学习 · 计算机科学 2026-05-15 Quanhao Li , Junqiu Yu , Kaixun Jiang , Yujie Wei , Zhen Xing , Pandeng Li , Ruihang Chu , Shiwei Zhang , Yu Liu , Zuxuan Wu

While few-step generative models have enabled powerful image and video generation at significantly lower cost, generic reinforcement learning (RL) paradigms for few-step models remain an unsolved problem. Existing RL approaches for few-step…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Yihong Luo , Tianyang Hu , Weijian Luo , Jing Tang

While likelihood-based generative models, particularly diffusion and autoregressive models, have achieved remarkable fidelity in visual generation, the maximum likelihood estimation (MLE) objective, which minimizes the forward KL…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Kaiwen Zheng , Yongxin Chen , Huayu Chen , Guande He , Ming-Yu Liu , Jun Zhu , Qinsheng Zhang

This study presents a generative optimization framework that builds on a fine-tuned diffusion model and reward-directed sampling to generate high-performance engineering designs. The framework adopts a parametric representation of the…

机器学习 · 计算机科学 2025-08-05 Hadi Keramati , Patrick Kirchen , Mohammed Hannan , Rajeev K. Jaiman

Diffusion models have recently emerged as expressive policy representations for online reinforcement learning (RL). However, their iterative generative processes introduce substantial training and inference overhead. To overcome this…

机器学习 · 计算机科学 2026-04-17 Xiaoyi Dong , Xi Sheryl Zhang , Jian Cheng

Diffusion distillation, exemplified by Distribution Matching Distillation (DMD), has shown great promise in few-step generation but often sacrifices quality for sampling speed. While integrating Reinforcement Learning (RL) into distillation…

机器学习 · 计算机科学 2026-04-22 Linwei Dong , Ruoyu Guo , Ge Bai , Zehuan Yuan , Yawei Luo , Changqing Zou

Diffusion-based generative models (DGMs) have recently attracted attention in speech enhancement research (SE) as previous works showed a remarkable generalization capability. However, DGMs are also computationally intensive, as they…

音频与语音处理 · 电气工程与系统科学 2024-06-21 Chenda Li , Samuele Cornell , Shinji Watanabe , Yanmin Qian

In medical imaging, the diffusion models have shown great potential for synthetic image generation tasks. However, these approaches often lack the interpretable connections between the generated and real images and can create anatomically…

图像与视频处理 · 电气工程与系统科学 2026-02-12 Jian-Qing Zheng , Yuanhan Mo , Yang Sun , Jiahua Li , Fuping Wu , Ziyang Wang , Tonia Vincent , Bartłomiej W. Papież

Designing de novo 3D molecules with desirable properties remains a fundamental challenge in drug discovery and molecular engineering. While diffusion models have demonstrated remarkable capabilities in generating high-quality 3D molecular…

机器学习 · 计算机科学 2026-01-15 Lianghong Chen , Dongkyu Eugene Kim , Mike Domaratzki , Pingzhao Hu

Recent progress in aligning image and video generative models with Group Relative Policy Optimization (GRPO) has improved human preference alignment, but existing variants remain inefficient due to sequential rollouts and large numbers of…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Yuming Li , Yikai Wang , Yuying Zhu , Zhongyu Zhao , Ming Lu , Qi She , Shanghang Zhang

Group Relative Policy Optimization (GRPO) is a powerful technique for aligning generative models, but its effectiveness is bottlenecked by the conflict between large group sizes and prohibitive computational costs. In this work, we…

计算机视觉与模式识别 · 计算机科学 2025-12-18 Shiran Ge , Chenyi Huang , Yuang Ai , Qihang Fan , Huaibo Huang , Ran He

The probabilistic diffusion model (DM), generating content by inferencing through a recursive chain structure, has emerged as a powerful framework for visual generation. After pre-training on enormous data, the model needs to be properly…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Tao Ren , Zishi Zhang , Jingyang Jiang , Zehao Li , Shentao Qin , Yi Zheng , Guanghao Li , Qianyou Sun , Yan Li , Jiafeng Liang , Xinping Li , Yijie Peng

The performance of machine learning (ML) models critically depends on the quality and representativeness of the training data. In applications with multiple heterogeneous data generating sources, standard ML methods often learn spurious…

The vast applications of deep generative models are anchored in three core capabilities -- generating new instances, reconstructing inputs, and learning compact representations -- across various data types, such as discrete text/protein…

Despite the proliferation of generative models, achieving fast sampling during inference without compromising sample diversity and quality remains challenging. Existing models such as Denoising Diffusion Probabilistic Models (DDPM) deliver…

机器学习 · 计算机科学 2023-10-12 Yanwu Xu , Mingming Gong , Shaoan Xie , Wei Wei , Matthias Grundmann , Kayhan Batmanghelich , Tingbo Hou

Recent studies indicate that the denoising process in deep generative diffusion models implicitly learns and memorizes semantic information from the data distribution. These findings suggest that capturing more complex data distributions…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Yi Tang , Peng Sun , Zhenglin Cheng , Tao Lin

Recent research has highlighted the powerful capabilities of imitation learning in robotics. Leveraging generative models, particularly diffusion models, these approaches offer notable advantages such as strong multi-task generalization,…

机器人学 · 计算机科学 2025-09-15 Xinyao Qin , Xiaoteng Ma , Yang Qi , Qihan Liu , Chuanyi Xue , Ning Gui , Qinyu Dong , Jun Yang , Bin Liang

Large-scale flow matching models have achieved strong performance across generative tasks such as text-to-image, video, 3D, and speech synthesis. However, aligning their outputs with human preferences and task-specific objectives remains…

机器学习 · 计算机科学 2026-03-10 Zexiang Liu , Xianglong He , Yangguang Li

The Stable Diffusion Model (SDM) is a prevalent and effective model for text-to-image (T2I) and image-to-image (I2I) generation. Despite various attempts at sampler optimization, model distillation, and network quantification, these…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Jinchao Zhu , Yuxuan Wang , Siyuan Pan , Pengfei Wan , Di Zhang , Gao Huang

Decision-making under distribution shift is a central challenge in reinforcement learning (RL), where training and deployment environments differ. We study this problem through the lens of robust Markov decision processes (RMDPs), which…

机器学习 · 计算机科学 2025-10-17 Jingwen Gu , Yiting He , Zhishuai Liu , Pan Xu