中文
相关论文

相关论文: CogniEdit: Dense Gradient Flow Optimization for Fi…

200 篇论文

This paper studies full-body 3D human motion recovery from head-mounted device signals. Existing diffusion-based methods often rely on global distribution matching, leading to local joint reconstruction errors. We propose MotionGRPO, a…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Nanjie Yao , Junlong Ren , Wenhao Shen , Hao Wang

Diffusion models are a class of flexible generative models trained with an approximation to the log-likelihood objective. However, most use cases of diffusion models are not concerned with likelihoods, but instead with downstream objectives…

机器学习 · 计算机科学 2024-01-08 Kevin Black , Michael Janner , Yilun Du , Ilya Kostrikov , Sergey Levine

Group Relative Policy Optimization (GRPO) has emerged as a powerful framework for preference alignment in text-to-image (T2I) flow models. However, we observe that the standard paradigm where evaluating a group of generated samples against…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Jiazi Bu , Pengyang Ling , Yujie Zhou , Yibin Wang , Yuhang Zang , Tianyi Wei , Xiaohang Zhan , Jiaqi Wang , Tong Wu , Xingang Pan , Dahua Lin

Discrete diffusion models have demonstrated great promise in modeling various sequence data, ranging from human language to biological sequences. Inspired by the success of RL in language models, there is growing interest in further…

机器学习 · 计算机科学 2026-02-03 Jiaqi Han , Austin Wang , Minkai Xu , Wenda Chu , Meihua Dang , Haotian Ye , Huayu Chen , Yisong Yue , Stefano Ermon

Diffusion models have demonstrated empirical successes in various applications and can be adapted to task-specific needs via guidance. This paper studies a form of gradient guidance for adapting a pre-trained diffusion model towards…

机器学习 · 统计学 2024-10-17 Yingqing Guo , Hui Yuan , Yukang Yang , Minshuo Chen , Mengdi Wang

Current mainstream methods of aligning diffusion models with human preferences typically employ VLM-based reward models. However, these reward models, pre-trained for semantic alignment, struggle to capture the essential perceptual…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Jaxon Zhang , Binxin Yang , Hubery Yin , Chen Li , Jing Lyu

Diffusion-based image editing offers strong semantic controllability, but remains computationally expensive due to iterative high-resolution denoising over all spatial tokens. Dynamic-resolution sampling reduces this cost by performing…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Zhengan Yan , Shikang Zheng , Haoran Qin , Xiaobing Tu , Yinggui Wang , Jiacheng Liu , Jiaxuan Ren , Yuqi Lin , Peiliang Cai , Jinkui Ren , Xiantao Zhang , Linfeng Zhang

With the success of image generation, generative diffusion models are increasingly adopted for discriminative tasks, as pixel generation provides a unified perception interface. However, directly repurposing the generative denoising process…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Ziqi Pang , Xin Xu , Yu-Xiong Wang

Fine-tuning pre-trained generative models with Reinforcement Learning (RL) has emerged as an effective approach for aligning outputs more closely with nuanced human preferences. In this paper, we investigate the application of Group…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Matteo Gallici , Haitz Sáez de Ocáriz Borde

Recently, Group Relative Policy Optimization (GRPO) has shown promising potential for aligning text-to-image (T2I) models, yet existing GRPO-based methods suffer from two critical limitations. (1) \textit{Shared credit assignment}:…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Qiang Lyu , Zicong Chen , Chongxiao Wang , Haolin Shi , Shibo Gao , Ran Piao , Youwei Zeng , Jianlou Si , Fei Ding , Jing Li , Chun Pong Lau , Weiqiang Wang

How to perform effective information fusion of different modalities is a core factor in boosting the performance of RGBT tracking. This paper presents a novel deep fusion algorithm based on the representations from an end-to-end trained…

计算机视觉与模式识别 · 计算机科学 2019-08-12 Yabin Zhu , Chenglong Li , Bin Luo , Jin Tang , Xiao Wang

Classifier guidance -- using the gradients of an image classifier to steer the generations of a diffusion model -- has the potential to dramatically expand the creative control over image generation and editing. However, currently…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Bram Wallace , Akash Gokul , Stefano Ermon , Nikhil Naik

We propose Diffusion-Sharpening, a fine-tuning approach that enhances downstream alignment by optimizing sampling trajectories. Existing RL-based fine-tuning methods focus on single training timesteps and neglect trajectory-level alignment,…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Ye Tian , Ling Yang , Xinchen Zhang , Yunhai Tong , Mengdi Wang , Bin Cui

Instruction-based image editing has made a great process in using natural human language to manipulate the visual content of images. However, existing models are limited by the quality of the dataset and cannot accurately localize editing…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Tiancheng Li , Jinxiu Liu , Huajun Chen , Qi Liu

Direct preference optimization (DPO) has shown success in aligning diffusion models with human preference. Previous approaches typically assume a consistent preference label between final generations and noisy samples at intermediate steps,…

机器学习 · 计算机科学 2025-02-05 Jie Ren , Yuhang Zhang , Dongrui Liu , Xiaopeng Zhang , Qi Tian

While reinforcement learning methods such as Group Relative Preference Optimization (GRPO) have significantly enhanced Large Language Models, adapting them to diffusion models remains challenging. In particular, GRPO demands a stochastic…

机器学习 · 计算机科学 2025-10-10 Yihong Luo , Tianyang Hu , Jing Tang

The colorization of grayscale images is a complex and subjective task with significant challenges. Despite recent progress in employing large-scale datasets with deep neural networks, difficulties with controllability and visual quality…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Nir Zabari , Aharon Azulay , Alexey Gorkor , Tavi Halperin , Ohad Fried

Group Relative Policy Optimization (GRPO), which is widely adopted by R1-like reasoning models, has advanced mathematical reasoning. Nevertheless, GRPO faces challenges in reward sparsity, verbosity, and inadequate focus on problem…

计算与语言 · 计算机科学 2025-09-23 Jixiao Zhang , Chunsheng Zuo

Recent research has made significant progress in optimizing diffusion models for downstream objectives, which is an important pursuit in fields such as graph generation for drug design. However, directly applying these models to graph…

机器学习 · 计算机科学 2024-10-28 Yijing Liu , Chao Du , Tianyu Pang , Chongxuan Li , Min Lin , Wei Chen

Graduated optimization is a global optimization technique that is used to minimize a multimodal nonconvex function by smoothing the objective function with noise and gradually refining the solution. This paper experimentally evaluates the…

机器学习 · 计算机科学 2024-12-17 Naoki Sato , Hideaki Iiduka