English
Related papers

Related papers: DyCoRM: Dynamic Criterion-Aware Reward Modeling fo…

200 papers

Learning from human feedback has been shown to improve text-to-image models. These techniques first learn a reward function that captures what humans care about in the task and then improve the models based on the learned reward function.…

Diffusion models have emerged as a dominant paradigm for generative modeling across a wide range of domains, including prompt-conditional generation. The vast majority of samplers, however, rely on forward discretization of the reverse…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhenghan Fang , Jian Zheng , Qiaozi Gao , Xiaofeng Gao , Jeremias Sulam

Continuous emotional image generation (C-EICG) is emerging rapidly due to its ability to produce images aligned with both user descriptions and continuous emotional values. However, existing approaches lack emotional feedback from generated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jingyang Jia , Kai Shu , Gang Yang , Long Xing , Xun Chen , Aiping Liu

Recently, diffusion-based deep generative models (e.g., Stable Diffusion) have shown impressive results in text-to-image synthesis. However, current text-to-image models often require multiple passes of prompt engineering by humans in order…

Computation and Language · Computer Science 2023-11-14 Tingfeng Cao , Chengyu Wang , Bingyan Liu , Ziheng Wu , Jinhui Zhu , Jun Huang

The default paradigm of post-training text-to-image generators includes post-hoc selection of generated images, and subsequent training with one reward model to align the generator to the reward, typically user preference. This discards…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Nicolas Dufour , Lucas Degeorge , Arijit Ghosh , Vicky Kalogeiton , David Picard

Recent advances in text-to-video generation have achieved impressive perceptual quality, yet generated content often violates fundamental principles of physical plausibility - manifesting as implausible object dynamics, incoherent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Peiyao Wang , Weining Wang , Qi Li

Recent advances in video reward models and post-training strategies have improved text-to-video (T2V) generation. While these models typically assess visual quality, motion quality, and text alignment, they often overlook key structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yuan Wang , Borui Liao , Huijuan Huang , Jinda Lu , Ouxiang Li , Kuien Liu , Meng Wang , Xiang Wang

We investigate a general approach for improving user prompts in text-to-image (T2I) diffusion models by finding prompts that maximize a reward function specified at test-time. Although diverse reward models are used for evaluating image…

Machine Learning · Computer Science 2025-09-30 Semin Kim , Yeonwoo Cha , Jaehoon Yoo , Seunghoon Hong

Text-to-image models produce images that align well with natural language prompts, but compositional generation has long been a central challenge. Models often struggle to satisfy multiple concepts within a single prompt, frequently…

Artificial Intelligence · Computer Science 2026-03-20 Jungmyung Wi , Hyunsoo Kim , Donghyun Kim

Existing text-to-image (T2I) benchmarks largely rely on fixed prompt sets, leaving them vulnerable to overfitting and benchmark contamination once publicly released and repeatedly reused. In this work, we propose DynT2I-Eval, a fully…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Juntong Wang , Jiarui Wang , Huiyu Duan , Lewei Li , Guangtao Zhai , Xiongkuo Min

Recent advancements in text-to-image (T2I) generation models have transformed the field. However, challenges persist in generating images that reflect demanding textual descriptions, especially for fine-grained details and unusual…

Multimedia · Computer Science 2025-02-21 Ran Li , Xiaomeng Jin , Heng ji

Text-to-image (T2I) diffusion models have become prominent tools for generating high-fidelity images from text prompts. However, when trained on unfiltered internet data, these models can produce unsafe, incorrect, or stylistically…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Rohit Jena , Ali Taghibakhshi , Sahil Jain , Gerald Shen , Nima Tajbakhsh , Arash Vahdat

Aligning text-to-image diffusion model (T2I) with preference has been gaining increasing research attention. While prior works exist on directly optimizing T2I by preference data, these methods are developed under the bandit assumption of a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Shentao Yang , Tianqi Chen , Mingyuan Zhou

Over the past few years, Text-to-Image (T2I) generation approaches based on diffusion models have gained significant attention. However, vanilla diffusion models often suffer from spelling inaccuracies in the text displayed within the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Sanyam Lakhanpal , Shivang Chopra , Vinija Jain , Aman Chadha , Man Luo

With the continuous advancement of image generation technology, advanced models such as GPT-Image-1 and Qwen-Image have achieved remarkable text-to-image consistency and world knowledge However, these models still fall short in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Junyan Ye , Leiqi Zhu , Yuncheng Guo , Dongzhi Jiang , Zilong Huang , Yifan Zhang , Zhiyuan Yan , Haohuan Fu , Conghui He , Weijia Li

Fine-tuning text-to-image models with reward functions trained on human feedback data has proven effective for aligning model behavior with human intent. However, excessive optimization with such reward models, which serve as mere proxy…

Machine Learning · Computer Science 2024-04-03 Kyuyoung Kim , Jongheon Jeong , Minyong An , Mohammad Ghavamzadeh , Krishnamurthy Dvijotham , Jinwoo Shin , Kimin Lee

Imaging and hyperspectral data analysis is central to progress across biology, medicine, chemistry, and physics. The core challenge lies in converting high-resolution or high-dimensional datasets into interpretable representations that…

Image and Video Processing · Electrical Eng. & Systems 2025-12-29 Kamyar Barakati , Yu Liu , Utkarsh Pratiush , Boris N. Slautin , Sergei V. Kalinin

A reliable reward function is essential for reinforcement learning (RL) in image generation. Most current RL approaches depend on pre-trained preference models that output scalar rewards to approximate human preferences. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Weijia Mao , Hao Chen , Zhenheng Yang , Mike Zheng Shou

Recent text-to-image (T2I) models have benefited from large-scale and high-quality data, demonstrating impressive performance. However, these T2I models still struggle to produce images that are aesthetically pleasing, geometrically…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jianshu Guo , Wenhao Chai , Jie Deng , Hsiang-Wei Huang , Tian Ye , Yichen Xu , Jiawei Zhang , Jenq-Neng Hwang , Gaoang Wang

Reinforcement learning (RL) has become a standard approach for post-training large language models and, more recently, for improving image generation models, which uses reward functions to enhance generation quality and human preference…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Yunqi Hong , Kuei-Chun Kao , Hengguang Zhou , Cho-Jui Hsieh