English
Related papers

Related papers: Aligning Text-to-Image Models using Human Feedback

200 papers

Recent advancements in text-to-image models, particularly diffusion models, have shown significant promise. However, compositional text-to-image models frequently encounter difficulties in generating high-quality images that accurately…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Song Wen , Guian Fang , Renrui Zhang , Peng Gao , Hao Dong , Dimitris Metaxas

Personalized text-to-image generation aims to create images tailored to user-defined concepts and textual descriptions. Balancing the fidelity of the learned concept with its ability for generation in various contexts presents a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Vera Soboleva , Maksim Nakhodnov , Aibek Alanov

One-step text-to-image generator models offer advantages such as swift inference efficiency, flexible architectures, and state-of-the-art generation performance. In this paper, we study the problem of aligning one-step generator models with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Weijian Luo

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circumvent this problem…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiadong Liang , Wenjie Pei , Feng Lu

Recent advances in text-to-image generation have improved the quality of synthesized images, but evaluations mainly focus on aesthetics or alignment with text prompts. Thus, it remains unclear whether these models can accurately represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hsin-Ping Huang , Xinyi Wang , Yonatan Bitton , Hagai Taitelbaum , Gaurav Singh Tomar , Ming-Wei Chang , Xuhui Jia , Kelvin C. K. Chan , Hexiang Hu , Yu-Chuan Su , Ming-Hsuan Yang

Text-to-image generation models represent the next step of evolution in image synthesis, offering a natural way to achieve flexible yet fine-grained control over the result. One emerging area of research is the fast adaptation of large…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Anton Voronov , Mikhail Khoroshikh , Artem Babenko , Max Ryabinin

State-of-the-art text-to-image models produce visually impressive results but often struggle with precise alignment to text prompts, leading to missing critical elements or unintended blending of distinct concepts. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Paul Grimal , Michaël Soumm , Hervé Le Borgne , Olivier Ferret , Akihiro Sugimoto

Although recent text-to-image generative models have achieved impressive performance, they still often struggle with capturing the compositional complexities of prompts including attribute binding, and spatial relationships between…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Seyed Mohammad Hadi Hosseini , Amir Mohammad Izadi , Ali Abdollahi , Armin Saghafian , Mahdieh Soleymani Baghshah

Text-to-image generation intends to automatically produce a photo-realistic image, conditioned on a textual description. It can be potentially employed in the field of art creation, data augmentation, photo-editing, etc. Although many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Zhenxing Zhang , Lambert Schomaker

Recent years have seen impressive advances in text-to-image generation, with image generative or unified models producing high-quality images from text. Yet these models still struggle with fine-grained color controllability, often failing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Muhammad Atif Butt , Alexandra Gomez-Villa , Tao Wu , Javier Vazquez-Corral , Joost Van De Weijer , Kai Wang

Text-to-image diffusion models have emerged as powerful tools for high-quality image generation and editing. Many existing approaches rely on text prompts as editing guidance. However, these methods are constrained by the need for manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yuanyuan Chang , Yinghua Yao , Tao Qin , Mengmeng Wang , Ivor Tsang , Guang Dai

Customization of text-to-image models enables users to insert new concepts or objects and generate them in unseen settings. Existing methods either rely on comparatively expensive test-time optimization or train encoders on single-image…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Nupur Kumari , Xi Yin , Jun-Yan Zhu , Ishan Misra , Samaneh Azadi

Pre-trained large text-to-image models synthesize impressive images with an appropriate use of text prompts. However, ambiguities inherent in natural language and out-of-distribution effects make it hard to synthesize image styles, that…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Kihyuk Sohn , Nataniel Ruiz , Kimin Lee , Daniel Castro Chin , Irina Blok , Huiwen Chang , Jarred Barber , Lu Jiang , Glenn Entis , Yuanzhen Li , Yuan Hao , Irfan Essa , Michael Rubinstein , Dilip Krishnan

Text-to-Image (T2I) synthesis is a challenging task that requires modeling complex interactions between two modalities ( i.e., text and image). A common framework adopted in recent state-of-the-art approaches to achieving such multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Yeruru Asrar Ahmed , Anurag Mittal

Text-to-image generative models, specifically those based on diffusion models like Imagen and Stable Diffusion, have made substantial advancements. Recently, there has been a surge of interest in the delicate refinement of text prompts.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Wenyi Mo , Tianyu Zhang , Yalong Bai , Bing Su , Ji-Rong Wen , Qing Yang

Environment designers in the entertainment industry create imaginative 2D and 3D scenes for games, films, and television, requiring both fine-grained control of specific details and consistent global coherence. Designers have increasingly…

Human-Computer Interaction · Computer Science 2025-09-03 Wen-Fan Wang , Ting-Ying Lee , Chien-Ting Lu , Che-Wei Hsu , Nil Ponsa Campanyà , Yu Chen , Mike Y. Chen , Bing-Yu Chen

Text-to-image generative models have demonstrated remarkable capabilities in generating high-quality images based on textual prompts. However, crafting prompts that accurately capture the user's creative intent remains challenging. It often…

Human-Computer Interaction · Computer Science 2023-04-20 Stephen Brade , Bryan Wang , Mauricio Sousa , Sageev Oore , Tovi Grossman

Text-to-image generation models have seen considerable advancement, catering to the increasing interest in personalized image creation. Current customization techniques often necessitate users to provide multiple images (typically 3-5) for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Linhao Zhong , Yan Hong , Wentao Chen , Binglin Zhou , Yiyi Zhang , Jianfu Zhang , Liqing Zhang

While recent advancements in generative modeling have significantly improved text-image alignment, some residual misalignment between text and image representations still remains. Some approaches address this issue by fine-tuning models in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Jaa-Yeon Lee , Byunghee Cha , Jeongsol Kim , Jong Chul Ye

Existing text-to-image generation approaches have set high standards for photorealism and text-image correspondence, largely benefiting from web-scale text-image datasets, which can include up to 5~billion pairs. However, text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Minho Park , Jooyeol Yun , Seunghwan Choi , Jaegul Choo