English
Related papers

Related papers: Deep Reward Supervisions for Tuning Text-to-Image …

200 papers

Despite strong image-generation performance, diffusion models' reconstruction objectives limit alignment with human preferences. RL enables such alignment through explicit rewards. However, most studies apply RL to the full denoising…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Renye Yan , Jikang Cheng , Shikun Sun , Yi Sun , You Wu , Wei Peng , Zongwei Wang , Ling Liang , Junliang Xing , Yimao Cai

We propose a diffusion-based framework for prompt optimization that leverages Diffusion Language Models (DLMs) to iteratively refine system prompts through masked denoising. By conditioning on interaction traces, including user queries,…

Computation and Language · Computer Science 2026-02-24 Shiyu Wang , Haolin Chen , Liangwei Yang , Jielin Qiu , Rithesh Murthy , Ming Zhu , Zixiang Chen , Silvio Savarese , Caiming Xiong , Shelby Heinecke , Huan Wang

Diffusion models have emerged as a dominant paradigm for generative modeling across a wide range of domains, including prompt-conditional generation. The vast majority of samplers, however, rely on forward discretization of the reverse…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhenghan Fang , Jian Zheng , Qiaozi Gao , Xiaofeng Gao , Jeremias Sulam

Reinforcement learning (RL) has emerged as a powerful tool for aligning diffusion models with human preferences, typically by optimizing a single reward function under a KL regularization constraint. In practice, however, human preferences…

Machine Learning · Computer Science 2026-04-17 Qi Zhang , Dawei Wang , Shaofeng Zou

Reinforcement learning (RL) has become a standard technique for post-training diffusion-based image synthesis models, as it enables learning from reward signals to explicitly improve desirable aspects such as image quality and prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 David McAllister , Miika Aittala , Tero Karras , Janne Hellsten , Angjoo Kanazawa , Timo Aila , Samuli Laine

Previous text-to-image diffusion models typically employ supervised fine-tuning (SFT) to enhance pre-trained base models. However, this approach primarily minimizes the loss of mean squared error (MSE) at the pixel level, neglecting the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Liang Peng , Boxi Wu , Haoran Cheng , Yibo Zhao , Xiaofei He

Large Language Models (LLMs) have demonstrated remarkable capabilities in code generation. However, the quality of the generated code is heavily dependent on the structure and composition of the prompts used. Crafting high-quality prompts…

Software Engineering · Computer Science 2025-04-08 Jinyang Li , Sangwon Hyun , M. Ali Babar

Recent work uses reinforcement learning (RL) to fine-tune text-to-image diffusion models, improving text-image alignment and sample quality. However, existing approaches introduce unnecessary complexity: they cache the full sampling…

Machine Learning · Computer Science 2025-07-02 Yanting Miao , William Loh , Pacal Poupart , Suraj Kothawade

Reward-based fine-tuning steers a pretrained diffusion or flow-based generative model toward higher-reward samples while remaining close to the pretrained model. Although existing methods are derived from different perspectives, we show…

Machine Learning · Computer Science 2026-05-08 Jeongjae Lee , Jinho Chang , Jeongsol Kim , Jong Chul Ye

In recent years, motion generative models have undergone significant advancement, yet pose challenges in aligning with downstream objectives. Recent studies have shown that using differentiable rewards to directly align the preference of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Xiaofeng Tan , Wanjiang Weng , Haodong Lei , Hongsong Wang

Diffusion models have become the de-facto approach for generating visual data, which are trained to match the distribution of the training dataset. In addition, we also want to control generation to fulfill desired properties such as…

Machine Learning · Computer Science 2024-12-30 Dinghuai Zhang , Yizhe Zhang , Jiatao Gu , Ruixiang Zhang , Josh Susskind , Navdeep Jaitly , Shuangfei Zhai

Self-rewarding have emerged recently as a powerful tool in the field of Natural Language Processing (NLP), allowing language models to generate high-quality relevant responses by providing their own rewards during training. This innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Safouane El Ghazouali , Arnaud Gucciardi , Umberto Michelucci

Existing unsupervised low-light image enhancement methods lack enough effectiveness and generalization in practical applications. We suppose this is because of the absence of explicit supervision and the inherent gap between real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Shuzhou Yang , Xuanyu Zhang , Yinhuai Wang , Jiwen Yu , Yuhan Wang , Jian Zhang

While burst LR images are useful for improving the SR image quality compared with a single LR image, prior SR networks accepting the burst LR images are trained in a deterministic manner, which is known to produce a blurry SR image. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Kyotaro Tokoro , Kazutoshi Akita , Norimichi Ukita

The efficient Test-Time Scaling (TTS) paradigm offers a promising perspective for enhancing the generation performance of diffusion models. However, current solutions are limited to a static, pre-defined noise pool and suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Gang Dai , Yining Huang , Yiming Xia , Guohao Chen , Shuaicheng Niu

Recent advancements in diffusion models have notably improved the perceptual quality of generated images in text-to-image synthesis tasks. However, diffusion models often struggle to produce images that accurately reflect the intended…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Tiviatis Sim , Kenji Kawaguchi

Reinforcement learning from human feedback (RLHF), which aligns a diffusion model with input prompt, has become a crucial step in building reliable generative AI models. Most works in this area use a discrete-time formulation, which is…

Machine Learning · Computer Science 2025-08-25 Hanyang Zhao , Haoxian Chen , Ji Zhang , David D. Yao , Wenpin Tang

Diffusion models have become a central paradigm for image and multimodal generation, yet their deployment raises persistent questions about alignment, safety, preference satisfaction, and robustness to misuse. This survey reviews recent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Preeti Lamba , Kiran Ravish , Ankita Kushwaha , Pawan Kumar

Diffusion models have been widely studied for removing unsafe content learned during pre-training. Existing methods require expensive supervised data, either unsafe-text paired with safe-image groundtruth or negative/positive image pairs,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Komal Kumar , Ankan Deria , Abhishek Basu , Fahad Shamshad , Hisham Cholakkal , Karthik Nandakumar

Discrete diffusion models have demonstrated great promise in modeling various sequence data, ranging from human language to biological sequences. Inspired by the success of RL in language models, there is growing interest in further…

Machine Learning · Computer Science 2026-02-03 Jiaqi Han , Austin Wang , Minkai Xu , Wenda Chu , Meihua Dang , Haotian Ye , Huayu Chen , Yisong Yue , Stefano Ermon