English
Related papers

Related papers: DyCoRM: Dynamic Criterion-Aware Reward Modeling fo…

200 papers

Recent text-to-image (T2I) models generate semantically coherent images from textual prompts, yet evaluating how well they align with individual user preferences remains an open challenge. Conventional evaluation methods, general reward…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Jeongeun Lee , Ryang Heo , Dongha Lee

The rapid advancement of text-to-image (T2I) models has increased the need for reliable human preference modeling, a demand further amplified by recent progress in reinforcement learning for preference alignment. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yuxiang Guo , Jiang Liu , Ze Wang , Hao Chen , Ximeng Sun , Yang Zhao , Jialian Wu , Xiaodong Yu , Zicheng Liu , Emad Barsoum

Aligning Text-to-Image (T2I) generation models with human preferences increasingly relies on image reward models that score or rank generated images according to prompt alignment and perceptual quality. Existing reward models are commonly…

Artificial Intelligence · Computer Science 2026-05-22 Kuei-Chun Kao , Daixuan Huo , Yuanhao Ban , Cho-Jui Hsieh

Recent advances in text-to-image (T2I) diffusion model fine-tuning leverage reinforcement learning (RL) to align generated images with learnable reward functions. The existing approaches reformulate denoising as a Markov decision process…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Xinyao Liao , Wei Wei , Xiaoye Qu , Yu Cheng

Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Sashuai Zhou , Qiang Zhou , Junpeng Ma , Yue Cao , Ruofan Hu , Ziang Zhang , Xiaoda Yang , Zhibin Wang , Jun Song , Cheng Yu , Bo Zheng , Zhou Zhao

Despite the promising progress of recent autoregressive models in text-to-image (T2I) generation, their ability to handle multi-attribute and ambiguous prompts remains limited. To address these limitations, existing works have applied…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Yaqi Li , Peng Chen , Mingyang Han , Pi Bu , Haoxiang Shi , Runzhou Zhao , Yang Yao , Xuan Zhang , Jun Song , Bo Zheng

Self-rewarding have emerged recently as a powerful tool in the field of Natural Language Processing (NLP), allowing language models to generate high-quality relevant responses by providing their own rewards during training. This innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Safouane El Ghazouali , Arnaud Gucciardi , Umberto Michelucci

Current mainstream methods of aligning diffusion models with human preferences typically employ VLM-based reward models. However, these reward models, pre-trained for semantic alignment, struggle to capture the essential perceptual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jaxon Zhang , Binxin Yang , Hubery Yin , Chen Li , Jing Lyu

Recent progress in text-to-image generation has greatly advanced visual fidelity and creativity, but it has also imposed higher demands on prompt complexity-particularly in encoding intricate spatial relationships. In such cases, achieving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Zhenyu Tang , Chaoran Feng , Yufan Deng , Jie Wu , Xiaojie Li , Rui Wang , Yunpeng Chen , Daquan Zhou

Text-to-image (T2I) generation has made significant advances in recent years, but challenges still remain in the generation of perceptual artifacts, misalignment with complex prompts, and safety. The prevailing approach to address these…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xiaoying Xing , Avinab Saha , Junfeng He , Susan Hao , Paul Vicol , Moonkyung Ryu , Gang Li , Sahil Singla , Sarah Young , Yinxiao Li , Feng Yang , Deepak Ramachandran

Reward modeling in large language models is susceptible to reward hacking, causing models to latch onto superficial features such as the tendency to generate lists or unnecessarily long responses. In reinforcement learning from human…

Computation and Language · Computer Science 2025-02-19 Taneesh Gupta , Shivam Shandilya , Xuchao Zhang , Rahul Madhavan , Supriyo Ghosh , Chetan Bansal , Huaxiu Yao , Saravan Rajmohan

Recent advancements in the text-rendering capabilities of image generation models have made the end-to-end creation of graphic design content, such as posters, increasingly feasible. However, existing reward models fall short of accurately…

Reinforcement learning (RL) has emerged as a promising paradigm for enhancing image editing and text-to-image (T2I) generation. However, current reward models, which act as critics during RL, often suffer from hallucinations and assign…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Xiangyu Zhao , Peiyuan Zhang , Junming Lin , Tianhao Liang , Yuchen Duan , Shengyuan Ding , Changyao Tian , Yuhang Zang , Junchi Yan , Xue Yang

Reinforcement learning (RL) has recently emerged as a promising approach for aligning text-to-image generative models with human preferences. A key challenge, however, lies in designing effective and interpretable rewards. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xuelu Feng , Yunsheng Li , Ziyu Wan , Zixuan Gao , Junsong Yuan , Dongdong Chen , Chunming Qiao

Recent advances in text-to-image (T2I) models have achieved impressive quality and consistency. However, this has come at the cost of representation diversity. While automatic evaluation methods exist for benchmarking model diversity, they…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Revant Teotia , Candace Ross , Karen Ullrich , Sumit Chopra , Adriana Romero-Soriano , Melissa Hall , Matthew J. Muckley

Fine-tuning text-to-image diffusion models to maximize rewards has proven effective for enhancing model performance. However, reward fine-tuning methods often suffer from slow convergence due to online sample generation. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Daewon Chae , June Suk Choi , Jinkyu Kim , Kimin Lee

We introduce LLaVA-Reward, an efficient reward model designed to automatically evaluate text-to-image (T2I) generations across multiple perspectives, leveraging pretrained multimodal large language models (MLLMs). Existing MLLM-based…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shijie Zhou , Ruiyi Zhang , Huaisheng Zhu , Branislav Kveton , Yufan Zhou , Jiuxiang Gu , Jian Chen , Changyou Chen

Recent text-guided image editing (TIE) models have achieved remarkable progress, however, many edited results still suffer from artifacts, unintended modifications, and suboptimal aesthetics. Although several benchmarks and evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Honghua Chen , Zitong Xu , Huiyu Duan , Xinyun Zhang , Xiongkuo Min , Guangtao Zhai

Text-to-motion generation, which synthesizes 3D human motions from text inputs, holds immense potential for applications in gaming, film, and robotics. Recently, diffusion-based methods have been shown to generate more diversity and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Wanjiang Weng , Xiaofeng Tan , Junbo Wang , Guo-Sen Xie , Pan Zhou , Hongsong Wang

To enhance the controllability of text-to-image diffusion models, current ControlNet-like models have explored various control signals to dictate image attributes. However, existing methods either handle conditions inefficiently or use a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Qingdong He , Jinlong Peng , Pengcheng Xu , Boyuan Jiang , Xiaobin Hu , Donghao Luo , Yong Liu , Yabiao Wang , Chengjie Wang , Xiangtai Li , Jiangning Zhang
‹ Prev 1 2 3 10 Next ›