English
Related papers

Related papers: Personalizing Text-to-Image Generation to Individu…

200 papers

Recent advances in text-to-image diffusion models, particularly Stable Diffusion, have enabled the generation of highly detailed and semantically rich images. However, personalizing these models to represent novel subjects based on a few…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Amritanshu Tiwari , Cherish Puniani , Kaustubh Sharma , Ojasva Nema

Text to image generation methods (T2I) are widely popular in generating art and other creative artifacts. While visual hallucinations can be a positive factor in scenarios where creativity is appreciated, such artifacts are poorly suited…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Rodrigo Valerio , Joao Bordalo , Michal Yarom , Yonatan Bitton , Idan Szpektor , Joao Magalhaes

Learning from feedback has been shown to enhance the alignment between text prompts and images in text-to-image diffusion models. However, due to the lack of focus in feedback content, especially regarding the object type and quantity,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Xuexiang Niu , Jinping Tang , Lei Wang , Ge Zhu

Previous work on augmenting large multimodal models (LMMs) for text-to-image (T2I) generation has focused on enriching the input space of in-context learning (ICL). This includes providing a few demonstrations and optimizing image…

Computation and Language · Computer Science 2025-01-14 Yongyu Mu , Hengyu Li , Junxin Wang , Xiaoxuan Zhou , Chenglong Wang , Yingfeng Luo , Qiaozhi He , Tong Xiao , Guocheng Chen , Jingbo Zhu

The default paradigm of post-training text-to-image generators includes post-hoc selection of generated images, and subsequent training with one reward model to align the generator to the reward, typically user preference. This discards…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Nicolas Dufour , Lucas Degeorge , Arijit Ghosh , Vicky Kalogeiton , David Picard

Text-to-Image (T2I) models have recently gained significant attention due to their ability to generate high-quality images and are consequently used in a wide range of applications. However, there are concerns about the gender bias of these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yunbo Lyu , Zhou Yang , Yuqing Niu , Jing Jiang , David Lo

Preference learning from human feedback has the ability to align generative models with the needs of end-users. Human feedback is costly and time-consuming to obtain, which creates demand for data-efficient query selection methods. This…

Machine Learning · Computer Science 2026-02-18 Guy Schacht , Ziyad Sheebaelhamd , Riccardo De Santi , Mojmír Mutný , Andreas Krause

Text-to-image (T2I) models are capable of generating visually impressive images, yet they often fail to accurately capture specific attributes in user prompts, such as the correct number of objects with the specified colors. The diversity…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Kevin David Hayes , Micah Goldblum , Vikash Sehwag , Gowthami Somepalli , Ashwinee Panda , Tom Goldstein

The progress in the generation of synthetic images has made it crucial to assess their quality. While several metrics have been proposed to assess the rendering of images, it is crucial for Text-to-Image (T2I) models, which generate images…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Paul Grimal , Hervé Le Borgne , Olivier Ferret , Julien Tourille

While large text-to-image models are able to synthesize "novel" images, these images are necessarily a reflection of the training data. The problem of data attribution in such models -- which of the images in the training set are most…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Sheng-Yu Wang , Alexei A. Efros , Jun-Yan Zhu , Richard Zhang

Advances in generative models have led to significant interest in image synthesis, demonstrating the ability to generate high-quality images for a diverse range of text prompts. Despite this progress, most studies ignore the presence of…

Artificial Intelligence · Computer Science 2024-07-02 Nila Masrourisaadat , Nazanin Sedaghatkish , Fatemeh Sarshartehrani , Edward A. Fox

Despite their wide-spread success, Text-to-Image models (T2I) still struggle to produce images that are both aesthetically pleasing and faithful to the user's input text. We introduce DreamSync, a model-agnostic training algorithm by design…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Jiao Sun , Deqing Fu , Yushi Hu , Su Wang , Royi Rassin , Da-Cheng Juan , Dana Alon , Charles Herrmann , Sjoerd van Steenkiste , Ranjay Krishna , Cyrus Rashtchian

Recent works have demonstrated that using reinforcement learning (RL) with multiple quality rewards can improve the quality of generated images in text-to-image (T2I) generation. However, manually adjusting reward weights poses challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Seung Hyun Lee , Yinxiao Li , Junjie Ke , Innfarn Yoo , Han Zhang , Jiahui Yu , Qifei Wang , Fei Deng , Glenn Entis , Junfeng He , Gang Li , Sangpil Kim , Irfan Essa , Feng Yang

The ability to understand visual concepts and replicate and compose these concepts from images is a central goal for computer vision. Recent advances in text-to-image (T2I) models have lead to high definition and realistic image quality…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Maitreya Patel , Tejas Gokhale , Chitta Baral , Yezhou Yang

Recent breakthroughs in large multimodal models (LMMs) have significantly advanced both text-to-image (T2I) generation and image-to-text (I2T) interpretation. However, many generated images still suffer from issues related to perceptual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Jiarui Wang , Huiyu Duan , Yu Zhao , Juntong Wang , Guangtao Zhai , Xiongkuo Min

Recent advancements highlight the importance of GRPO-based reinforcement learning methods and benchmarking in enhancing text-to-image (T2I) generation. However, current methods using pointwise reward models (RM) for scoring generated images…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yibin Wang , Zhimin Li , Yuhang Zang , Yujie Zhou , Jiazi Bu , Chunyu Wang , Qinglin Lu , Cheng Jin , Jiaqi Wang

Text-to-image (T2I) models have recently experienced rapid development, achieving astonishing performance in terms of fidelity and textual alignment capabilities. However, given a long paragraph (up to 512 words), these generation models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Weijia Wu , Zhuang Li , Yefei He , Mike Zheng Shou , Chunhua Shen , Lele Cheng , Yan Li , Tingting Gao , Di Zhang

Text-to-image (T2I) customization aims to create images that embody specific visual concepts delineated in textual descriptions. However, existing works still face a main challenge, concept overfitting. To tackle this challenge, we first…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Weili Zeng , Yichao Yan , Qi Zhu , Zhuo Chen , Pengzhi Chu , Weiming Zhao , Xiaokang Yang

Text-to-Image (T2I) generation has made significant advancements with diffusion models, yet challenges persist in handling complex instructions, ensuring fine-grained content control, and maintaining deep semantic consistency. Existing T2I…

Machine Learning · Computer Science 2025-08-08 Xiaoqi Dong , Xiangyu Zhou , Nicholas Evans , Yujia Lin

Progress in Text-to-Image (T2I) models has significantly improved the generation of images from textual descriptions. However, existing evaluation metrics do not adequately assess the models' ability to handle a diverse range of textual…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Jingtao Cao , Zheng Zhang , Hongru Wang , Kam-Fai Wong