English
Related papers

Related papers: DyCoRM: Dynamic Criterion-Aware Reward Modeling fo…

200 papers

Current text-to-image (T2I) benchmarks evaluate models on rigid prompts, potentially underestimating true generative capabilities due to prompt sensitivity and creating biases that favor certain models while disadvantaging others. We…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Haosheng Gan , Berk Tinaz , Mohammad Shahab Sepehri , Zalan Fabian , Mahdi Soltanolkotabi

Text-to-Image (T2I) models have made significant advancements in recent years, but they still struggle to accurately capture intricate details specified in complex compositional prompts. While fine-tuning T2I models with reward objectives…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Luca Eyring , Shyamgopal Karthik , Karsten Roth , Alexey Dosovitskiy , Zeynep Akata

Reinforcement learning (RL) has improved guided image generation with diffusion models by directly optimizing rewards that capture image quality, aesthetics, and instruction following capabilities. However, the resulting generative policies…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Owen Oertell , Jonathan D. Chang , Yiyi Zhang , Kianté Brantley , Wen Sun

Recently, we have witnessed great progress in image editing with natural language instructions. Several closed-source models like GPT-Image-1, Seedream, and Google-Nano-Banana have shown highly promising progress. However, the open-source…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Keming Wu , Sicong Jiang , Max Ku , Ping Nie , Minghao Liu , Wenhu Chen

Visual generative models have achieved remarkable progress in synthesizing photorealistic images and videos, yet aligning their outputs with human preferences across critical dimensions remains a persistent challenge. Though reinforcement…

Instruction-guided image editing has achieved remarkable progress, yet current models still face challenges with complex instructions and often require multiple samples to produce a desired result. Reinforcement Learning (RL) offers a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xin Luo , Jiahao Wang , Chenyuan Wu , Shitao Xiao , Xiyan Jiang , Defu Lian , Jiajun Zhang , Dong Liu , Zheng liu

High-quality training triplets (instruction, original image, edited image) are essential for instruction-based image editing. Predominant training datasets (e.g., InsPix2Pix) are created using text-to-image generative models (e.g., Stable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Xin Gu , Ming Li , Libo Zhang , Fan Chen , Longyin Wen , Tiejian Luo , Sijie Zhu

Personalized text-to-image (T2I) generation has emerged as a key application for creating user-specific concepts from a few reference images. The core challenge is concept disentanglement: separating the target concept from irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Minseo Kim , Minchan Kwon , Dongyeun Lee , Yunho Jeon , Junmo Kim

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models often struggle with simple or underspecified prompts, leading to suboptimal image-text alignment, aesthetics, and quality. We propose a…

Computation and Language · Computer Science 2025-10-16 Ruibo Chen , Jiacheng Pan , Heng Huang , Zhenheng Yang

Text-to-image generative models excel in creating images from text but struggle with ensuring alignment and consistency between outputs and prompts. This paper introduces TextMatch, a novel framework that leverages multimodal optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Yucong Luo , Mingyue Cheng , Jie Ouyang , Xiaoyu Tao , Qi Liu

Diffusion models have revitalized the image generation domain, playing crucial roles in both academic research and artistic expression. With the emergence of new diffusion models, assessing the performance of text-to-image models has become…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Chutian Meng , Fan Ma , Jiaxu Miao , Chi Zhang , Yi Yang , Yueting Zhuang

Recent image editing models have achieved remarkable progress in instruction following, multimodal understanding, and complex visual editing. However, existing benchmarks often fail to faithfully reflect human judgment, especially for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Xuehai Bai , Yang Shi , Yi-Fan Zhang , Xuanyu Zhu , Yuran Wang , Yifan Dai , Xinyu Liu , Yiyan Ji , Xiaoling Gu , Yuanxing Zhang

We propose T2I-ReasonBench, a benchmark evaluating reasoning capabilities of text-to-image (T2I) models. It consists of four dimensions: Idiom Interpretation, Textual Image Design, Entity-Reasoning and Scientific-Reasoning. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Kaiyue Sun , Rongyao Fang , Chengqi Duan , Xian Liu , Xihui Liu

Modern text-to-image (T2I) models generate high-fidelity visuals but remain indifferent to individual user preferences. While existing reward models optimize for "average" human appeal, they fail to capture the inherent subjectivity of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Anne-Sofie Maerten , Juliane Verwiebe , Shyamgopal Karthik , Ameya Prabhu , Johan Wagemans , Matthias Bethge

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models still struggle with prompts that require rich world knowledge and implicit reasoning: both of which are critical for producing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Daoan Zhang , Che Jiang , Ruoshi Xu , Biaoxiang Chen , Zijian Jin , Yutian Lu , Jianguo Zhang , Liang Yong , Jiebo Luo , Shengda Luo

Reward models are critical for reinforcement learning from human feedback, as they determine the alignment quality and reliability of generative models. For complex tasks such as image editing, reward models are required to capture global…

Advanced diffusion models like RPG, Stable Diffusion 3 and FLUX have made notable strides in compositional text-to-image generation. However, these methods typically exhibit distinct strengths for compositional generation, with some…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Xinchen Zhang , Ling Yang , Guohao Li , Yaqi Cai , Jiake Xie , Yong Tang , Yujiu Yang , Mengdi Wang , Bin Cui

Text-to-image models are powerful for producing high-quality images based on given text prompts, but crafting these prompts often requires specialized vocabulary. To address this, existing methods train rewriting models with supervision…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Hongji Yang , Yucheng Zhou , Wencheng Han , Jianbing Shen

Step-by-step verifiers -- also known as process reward models (PRMs) -- are a key ingredient for test-time scaling. PRMs require step-level supervision, making them expensive to train. This work aims to build data-efficient PRMs as…

Machine Learning · Computer Science 2025-12-09 Muhammad Khalifa , Rishabh Agarwal , Lajanugen Logeswaran , Jaekyeom Kim , Hao Peng , Moontae Lee , Honglak Lee , Lu Wang

Instruction-driven image editing with unified multimodal generative models has advanced rapidly, yet their underlying visual reasoning remains limited, leading to suboptimal performance on reasoning-centric edits. Reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Hengjia Li , Liming Jiang , Qing Yan , Yizhi Song , Hao Kang , Zichuan Liu , Xin Lu , Boxi Wu , Deng Cai