English
Related papers

Related papers: Learning Multi-dimensional Human Preference for Te…

200 papers

Text-to-image models produce graphic design at production scale, but their supervision comes from photo-style preference data with a single overall verdict per comparison. Designers evaluate along several distinct axes, including…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Haonan Zhu , Elad Hirsch , Alexandria Minetti , Allison Nulty , Purvanshi Mehta

This paper investigates image inpainting with preference alignment. Instead of introducing a novel method, we go back to basics and revisit fundamental problems in achieving such alignment. We leverage the prominent direct preference…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yutao Shen , Junkun Yuan , Toru Aonishi , Hideki Nakayama , Yue Ma

Preference learning is a widely adopted post-training technique that aligns large language models (LLMs) to human preferences and improves specific downstream task capabilities. In this work we systematically investigate how specific…

Computation and Language · Computer Science 2024-12-23 Joongwon Kim , Anirudh Goyal , Aston Zhang , Bo Xiong , Rui Hou , Melanie Kambadur , Dhruv Mahajan , Hannaneh Hajishirzi , Liang Tan

Image Quality Assessment (IQA) based on human subjective preferences has undergone extensive research in the past decades. However, with the development of communication protocols, the visual data consumption volume of machines has…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Chunyi Li , Yuan Tian , Xiaoyue Ling , Zicheng Zhang , Haodong Duan , Haoning Wu , Ziheng Jia , Xiaohong Liu , Xiongkuo Min , Guo Lu , Weisi Lin , Guangtao Zhai

This work presents an open-source unified benchmarking and evaluation framework for text-to-image generation models, with a particular focus on the impact of metadata augmented prompts. Leveraging the DeepFashion-MultiModal dataset, we…

Graphics · Computer Science 2025-05-09 Kapil Wanaskar , Gaytri Jena , Magdalini Eirinaki

The rapid advancement of text-to-image (T2I) models has increased the need for reliable human preference modeling, a demand further amplified by recent progress in reinforcement learning for preference alignment. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yuxiang Guo , Jiang Liu , Ze Wang , Hao Chen , Ximeng Sun , Yang Zhao , Jialian Wu , Xiaodong Yu , Zicheng Liu , Emad Barsoum

Reward models (RMs) are essential for aligning large language models (LLMs) with human preferences to improve interaction quality. However, the real world is pluralistic, which leads to diversified human preferences with respect to…

Computation and Language · Computer Science 2023-09-18 Pengyu Cheng , Jiawen Xie , Ke Bai , Yong Dai , Nan Du

In recent years, the field of image generation has witnessed significant advancements, particularly in fine-tuning methods that align models with universal human preferences. This paper explores the critical role of preference data in the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Lingfan Zhang , Chen Liu , Chengming Xu , Kai Hu , Donghao Luo , Chengjie Wang , Yanwei Fu , Yuan Yao

Generating high-quality and diverse human images is an important yet challenging task in vision and graphics. However, existing generative models often fall short under the high diversity of clothing shapes and textures. Furthermore, the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Yuming Jiang , Shuai Yang , Haonan Qiu , Wayne Wu , Chen Change Loy , Ziwei Liu

Text-to-image generation has advanced rapidly, yet it still struggles to capture the nuanced user preferences. Existing approaches typically rely on multimodal large language models to infer user preferences, but the derived prompts or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zihao Wang , Yuxiang Wei , Xinpeng Zhou , Tianyu Zhang , Tao Liang , Yalong Bai , Hongzhi Zhang , Wangmeng Zuo

The growing prevalence of high-dimensional data has fostered the development of multidimensional projection (MP) techniques, such as t-SNE, UMAP, and LAMP, for data visualization and exploration. However, conventional MP methods typically…

Graphics · Computer Science 2024-07-24 Maniru Ibrahim

Recent progress in text-to-image (T2I) generative models has led to significant improvements in generating high-quality images aligned with text prompts. However, these models still struggle with prompts involving multiple objects, often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Dongnam Byun , Jungwon Park , Jungmin Ko , Changin Choi , Wonjong Rhee

In this paper, we make the first attempt to align diffusion models for image inpainting with human aesthetic standards via a reinforcement learning framework, significantly improving the quality and visual appeal of inpainted images.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kendong Liu , Zhiyu Zhu , Chuanhao Li , Hui Liu , Huanqiang Zeng , Junhui Hou

Imagine Alice has a specific image $x^\ast$ in her mind, say, the view of the street in which she grew up during her childhood. To generate that exact image, she guides a generative model with multiple rounds of prompting and arrives at an…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Rajalaxmi Rajagopalan , Debottam Dutta , Yu-Lin Wei , Romit Roy Choudhury

The increasing availability of image-text pairs has largely fueled the rapid advancement in vision-language foundation models. However, the vast scale of these datasets inevitably introduces significant variability in data quality, which…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Lei Zhang , Fangxun Shu , Tianyang Liu , Sucheng Ren , Hao Jiang , Cihang Xie

Diffusion models have emerged as a dominant approach for text-to-image generation. Key components such as the human preference alignment and classifier-free guidance play a crucial role in ensuring generation quality. However, their…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Minghao Fu , Guo-Hua Wang , Liangfu Cao , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang

Common image editing tasks typically adopt powerful generative diffusion models as the leading paradigm for real-world content editing. Meanwhile, although reinforcement learning (RL) methods such as Diffusion-DPO and Flow-GRPO have further…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Fan Li , Chonghuinan Wang , Lina Lei , Yuping Qiu , Jiaqi Xu , Jiaxiu Jiang , Xinran Qin , Zhikai Chen , Fenglong Song , Zhixin Wang , Renjing Pei , Wangmeng Zuo

Text-to-image (T2I) generation has greatly enhanced creative expression, yet achieving preference-aligned generation in a real-time and training-free manner remains challenging. Previous methods often rely on static, pre-collected…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yang Li , Songlin Yang , Xiaoxuan Han , Wei Wang , Jing Dong , Yueming Lyu , Ziyu Xue

Large language models (LLMs) have shown remarkable success, but aligning them with human preferences remains a core challenge. As individuals have their own, multi-dimensional preferences, recent studies have explored multi-dimensional…

Machine Learning · Computer Science 2025-06-03 Minhyeon Oh , Seungjoon Lee , Jungseul Ok

Iterative prompt refinement is central to reproducing target images with text to image generative models. Previous studies have incorporated image similarity metrics (ISMs) as additional feedback to human users. Existing ISMs such as LPIPS…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Khoi Trinh , Jay Rothenberger , Scott Seidenberger , Dimitrios Diochnos , Anindya Maiti