English
Related papers

Related papers: Free Lunch Alignment of Text-to-Image Diffusion Mo…

200 papers

Existing methods for preference tuning of text-to-image (T2I) diffusion models often rely on computationally expensive generation steps to create positive and negative pairs of images. These approaches frequently yield training pairs that…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Sanjana Reddy , Ishaan Malhi , Sally Ma , Praneet Dutta

Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Jiangweizhi Peng , Zhiwei Tang , Gaowen Liu , Charles Fleming , Mingyi Hong

We investigate a general approach for improving user prompts in text-to-image (T2I) diffusion models by finding prompts that maximize a reward function specified at test-time. Although diverse reward models are used for evaluating image…

Machine Learning · Computer Science 2025-09-30 Semin Kim , Yeonwoo Cha , Jaehoon Yoo , Seunghoon Hong

Without using explicit reward, direct preference optimization (DPO) employs paired human preference data to fine-tune generative models, a method that has garnered considerable attention in large language models (LLMs). However, exploration…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yunhong Lu , Qichao Wang , Hengyuan Cao , Xierui Wang , Xiaoyin Xu , Min Zhang

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models often struggle with simple or underspecified prompts, leading to suboptimal image-text alignment, aesthetics, and quality. We propose a…

Computation and Language · Computer Science 2025-10-16 Ruibo Chen , Jiacheng Pan , Heng Huang , Zhenheng Yang

Diffusion models for Text-to-Image (T2I) conditional generation have recently achieved tremendous success. Yet, aligning these models with user's intentions still involves a laborious trial-and-error process, and this challenging alignment…

Machine Learning · Computer Science 2025-02-12 Chao Wang , Giulio Franzese , Alessandro Finamore , Massimo Gallo , Pietro Michiardi

RLHF techniques like DPO can significantly improve the generation quality of text-to-image diffusion models. However, these methods optimize for a single reward that aligns model generation with population-level preferences, neglecting the…

Machine Learning · Computer Science 2025-01-14 Meihua Dang , Anikait Singh , Linqi Zhou , Stefano Ermon , Jiaming Song

Text-to-Image (T2I) diffusion models have achieved remarkable success in image generation. Despite their progress, challenges remain in both prompt-following ability, image quality and lack of high-quality datasets, which are essential for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jingkun An , Yinghao Zhu , Zongjian Li , Enshen Zhou , Haoran Feng , Xijie Huang , Bohua Chen , Yemin Shi , Chengwei Pan

In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current models still face misalignment issues (e.g., problematic spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Leigang Qu , Shengqiong Wu , Hao Fei , Liqiang Nie , Tat-Seng Chua

Diffusion models have demonstrated remarkable success in various visual generation tasks, including image, video, and 3D content generation. Preference optimization (PO) is a prominent and growing area of research that aims to align these…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Fu-Yun Wang , Keqiang Sun , Yao Teng , Xihui Liu , Jiale Yuan , Jiaming Song , Hongsheng Li

Optical illusion hidden picture is an interesting visual perceptual phenomenon where an image is cleverly integrated into another picture in a way that is not immediately obvious to the viewer. Established on the off-the-shelf text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Xiang Gao , Shuai Yang , Jiaying Liu

Text-to-image diffusion models deliver high-quality images, yet aligning them with human preferences remains challenging. We revisit diffusion-based Direct Preference Optimization (DPO) for these models and identify a critical pathology:…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Minghao Fu , Guo-Hua Wang , Tianyu Cui , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang

Image restoration (IR) models are typically trained to recover high-quality images using L1 or LPIPS loss. To handle diverse unknown degradations, zero-shot IR methods have also been introduced. However, existing pre-trained and zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Bingchen Li , Xin Li , Jiaqi Xu , Jiaming Guo , Wenbo Li , Renjing Pei , Zhibo Chen

Diffusion Models have revolutionized the field of human motion generation by offering exceptional generation quality and fine-grained controllability through natural language conditioning. Their inherent stochasticity, that is the ability…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Massimiliano Pappa , Luca Collorone , Giovanni Ficarra , Indro Spinelli , Fabio Galasso

Recent advancements in human preference optimization, initially developed for Language Models (LMs), have shown promise for text-to-image Diffusion Models, enhancing prompt alignment, visual appeal, and user preference. Unlike LMs,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Alexander Gambashidze , Anton Kulikov , Yuriy Sosnin , Ilya Makarov

Despite their impressive capabilities, diffusion-based text-to-image (T2I) models can lack faithfulness to the text prompt, where generated images may not contain all the mentioned objects, attributes or relations. To alleviate these…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Shyamgopal Karthik , Karsten Roth , Massimiliano Mancini , Zeynep Akata

Text-to-image (T2I) diffusion models have become prominent tools for generating high-fidelity images from text prompts. However, when trained on unfiltered internet data, these models can produce unsafe, incorrect, or stylistically…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Rohit Jena , Ali Taghibakhshi , Sahil Jain , Gerald Shen , Nima Tajbakhsh , Arash Vahdat

Diffusion models have emerged as a dominant paradigm for generative modeling across a wide range of domains, including prompt-conditional generation. The vast majority of samplers, however, rely on forward discretization of the reverse…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhenghan Fang , Jian Zheng , Qiaozi Gao , Xiaofeng Gao , Jeremias Sulam

Diffusion models have achieved impressive results in generative tasks for text-to-video (T2V) synthesis. However, achieving accurate text alignment in T2V generation remains challenging due to the complex temporal dependencies across…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Jaemin Kim , Bryan Sangwoo Kim , Jong Chul Ye

Diffusion models have achieved remarkable success in generating realistic and versatile images from text prompts. Inspired by the recent advancements of language models, there is an increasing interest in further improving the models by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Binxu Li , Minkai Xu , Jiaqi Han , Meihua Dang , Stefano Ermon