English
Related papers

Related papers: ORACLE: Leveraging Mutual Information for Consiste…

200 papers

Text-to-image models such as stable diffusion have opened a plethora of opportunities for generating art. Recent literature has surveyed the use of text-to-image models for enhancing the work of many creative artists. Many e-commerce…

Human-Computer Interaction · Computer Science 2024-03-12 Shanu Vashishtha , Abhinav Prakash , Lalitesh Morishetti , Kaushiki Nag , Yokila Arora , Sushant Kumar , Kannan Achan

Recent advances in diffusion models have demonstrated impressive capability in generating high-quality images for simple prompts. However, when confronted with complex prompts involving multiple objects and hierarchical structures, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Hongji Yang , Yucheng Zhou , Wencheng Han , Runzhou Tao , Zhongying Qiu , Jianfei Yang , Jianbing Shen

Reinforcement learning (RL) has improved guided image generation with diffusion models by directly optimizing rewards that capture image quality, aesthetics, and instruction following capabilities. However, the resulting generative policies…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Owen Oertell , Jonathan D. Chang , Yiyi Zhang , Kianté Brantley , Wen Sun

Large-scale text-to-image diffusion models have achieved great success in synthesizing high-quality and diverse images given target text prompts. Despite the revolutionary image generation ability, current state-of-the-art models still…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

The current state-of-the-art Diffusion model has demonstrated excellent results in generating images. However, the images are monotonous and are mostly the result of the distribution of images of people in the training set, making it…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Tianyu Chen

Diffusion models have exhibited substantial success in text-to-image generation. However, they often encounter challenges when dealing with complex and dense prompts involving multiple objects, attribute binding, and long descriptions. In…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Mushui Liu , Yuhang Ma , Yang Zhen , Jun Dan , Yunlong Yu , Zeng Zhao , Zhipeng Hu , Bai Liu , Changjie Fan

Diffusion models have achieved remarkable advancements in text-to-image generation. However, existing models still have many difficulties when faced with multiple-object compositional generation. In this paper, we propose RealCompo, a new…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xinchen Zhang , Ling Yang , Yaqi Cai , Zhaochen Yu , Kai-Ni Wang , Jiake Xie , Ye Tian , Minkai Xu , Yong Tang , Yujiu Yang , Bin Cui

Text-to-image diffusion models have demonstrated tremendous success in synthesizing visually stunning images given textual instructions. Despite remarkable progress in creating high-fidelity visuals, text-to-image models can still struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Taewook Kim , Ze Wang , Zhengyuan Yang , Jiang Wang , Lijuan Wang , Zicheng Liu , Qiang Qiu

Text-to-image diffusion models have recently received a lot of interest for their astonishing ability to produce high-fidelity images from text only. However, achieving one-shot generation that aligns with the user's intent is nearly…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Manuel Brack , Felix Friedrich , Dominik Hintersdorf , Lukas Struppek , Patrick Schramowski , Kristian Kersting

Recent advances in text-to-image diffusion models, particularly Stable Diffusion, have enabled the generation of highly detailed and semantically rich images. However, personalizing these models to represent novel subjects based on a few…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Amritanshu Tiwari , Cherish Puniani , Kaustubh Sharma , Ojasva Nema

Text-to-image diffusion models have demonstrated remarkable capabilities in generating artistic content by learning from billions of images, including popular artworks. However, the fundamental question of how these models internally…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Alfio Ferrara , Sergio Picascia , Elisabetta Rocchetti

The recent advancements in Generative AI have significantly advanced the field of text-to-image generation. The state-of-the-art text-to-image model, Stable Diffusion, is now capable of synthesizing high-quality images with a strong sense…

Human-Computer Interaction · Computer Science 2024-03-08 Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang

In the evolving domain of text-to-image generation, diffusion models have emerged as powerful tools in content creation. Despite their remarkable capability, existing models still face challenges in achieving controlled generation with a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jaeseok Jeong , Junho Kim , Yunjey Choi , Gayoung Lee , Youngjung Uh

There has been a recent explosion of impressive generative models that can produce high quality images (or videos) conditioned on text descriptions. However, all such approaches rely on conditional sentences that contain unambiguous…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Tanzila Rahman , Hsin-Ying Lee , Jian Ren , Sergey Tulyakov , Shweta Mahajan , Leonid Sigal

Novel diffusion models can synthesize photo-realistic images with integrated high-quality text. Surprisingly, we demonstrate through attention activation patching that only less than $1$% of diffusion models' parameters, all contained in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Łukasz Staniszewski , Bartosz Cywiński , Franziska Boenisch , Kamil Deja , Adam Dziedzic

Despite the advances in text-to-image synthesis, particularly with diffusion models, generating visual instructions that require consistent representation and smooth state transitions of objects across sequential steps remains a formidable…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Quynh Phung , Songwei Ge , Jia-Bin Huang

The popularization of Text-to-Image (T2I) diffusion models enables the generation of high-quality images from text descriptions. However, generating diverse customized images with reference visual attributes remains challenging. This work…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Brian Nlong Zhao , Yuhang Xiao , Jiashu Xu , Xinyang Jiang , Yifan Yang , Dongsheng Li , Laurent Itti , Vibhav Vineet , Yunhao Ge

Text-driven person image generation is an emerging and challenging task in cross-modality image generation. Controllable person image generation promotes a wide range of applications such as digital human interaction and virtual try-on.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Kaiduo Zhang , Muyi Sun , Jianxin Sun , Binghao Zhao , Kunbo Zhang , Zhenan Sun , Tieniu Tan

While diffusion models have revolutionized text-to-image generation with their ability to synthesize realistic and diverse scenes, they continue to struggle to generate consistent and legible text within images. This shortcoming is commonly…

Machine Learning · Computer Science 2025-09-16 Tianyu Zhang , Xinyu Wang , Lu Li , Zhenghan Tai , Jijun Chi , Jingrui Tian , Hailin He , Suyuchen Wang

Large-scale text-to-image models that can generate high-quality and diverse images based on textual prompts have shown remarkable success. These models aim ultimately to create complex scenes, and addressing the challenge of multi-subject…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Barak Battash , Amit Rozner , Lior Wolf , Ofir Lindenbaum