English
Related papers

Related papers: Training-free Composite Scene Generation for Layou…

200 papers

Layout-aware text-to-image generation is a task to generate multi-object images that reflect layout conditions in addition to text conditions. The current layout-aware text-to-image diffusion models still have several issues, including…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Takahiro Shirakawa , Seiichi Uchida

Text-conditioned image generation models are a prevalent use of AI image synthesis, yet intuitively controlling output guided by an artist remains challenging. Current methods require multiple images and textual prompts for each object to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Shounak Chatterjee

As pre-trained text-to-image diffusion models have become a useful tool for image synthesis, people want to specify the results in various ways. This paper tackles training-free appearance transfer, which produces an image with the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Sooyeon Go , Kyungmook Choi , Minjung Shin , Youngjung Uh

Text-to-motion generation has recently garnered significant research interest, primarily focusing on generating human motion sequences in blank backgrounds. However, human motions commonly occur within diverse 3D scenes, which has prompted…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Ziyan Guo , Haoxuan Qu , Hossein Rahmani , Dewen Soh , Ping Hu , Qiuhong Ke , Jun Liu

Diffusion-based generative models have significantly advanced text-to-image generation but encounter challenges when processing lengthy and intricate text prompts describing complex scenes with multiple objects. While excelling in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hanan Gani , Shariq Farooq Bhat , Muzammal Naseer , Salman Khan , Peter Wonka

Deep learning-based image generation has seen significant advancements with diffusion models, notably improving the quality of generated images. Despite these developments, generating images with unseen characteristics beneficial for…

We present a training-free style-aligned image generation method that leverages a scale-wise autoregressive model. While large-scale text-to-image (T2I) models, particularly diffusion-based methods, have demonstrated impressive generation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jihun Park , Jongmin Gim , Kyoungmin Lee , Minseok Oh , Minwoo Choi , Jaeyeul Kim , Woo Chool Park , Sunghoon Im

Text-to-image diffusion models have shown impressive capabilities in generating realistic visuals from natural-language prompts, yet they often struggle with accurately binding attributes to corresponding objects, especially in prompts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Do Huu Dat , Nam Hyeonu , Po-Yuan Mao , Tae-Hyun Oh

We develop an approach for text-to-image generation that embraces additional retrieval images, driven by a combination of implicit visual guidance loss and generative objectives. Unlike most existing text-to-image generation methods which…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , John Collomosse

Despite recent advances, diffusion-based text-to-image models still struggle with accurate text rendering. Several studies have proposed fine-tuning or training-free refinement methods for accurate text rendering. However, the critical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Kanghyun Baek , Sangyub Lee , Jin Young Choi , Jaewoo Song , Daemin Park , Jooyoung Choi , Chaehun Shin , Bohyung Han , Sungroh Yoon

Personalized text-to-image generation models enable users to create images that depict their individual possessions in diverse scenes, finding applications in various domains. To achieve the personalization capability, existing methods rely…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yu Zeng , Vishal M. Patel , Haochen Wang , Xun Huang , Ting-Chun Wang , Ming-Yu Liu , Yogesh Balaji

Text-to-image generation is a significant domain in modern computer vision and has achieved substantial improvements through the evolution of generative architectures. Among these, there are diffusion-based models that have demonstrated…

Addressing the limitations of text as a source of accurate layout representation in text-conditional diffusion models, many works incorporate additional signals to condition certain attributes within a generated image. Although successful,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Jonghyun Lee , Hansam Cho , Youngjoon Yoo , Seoung Bum Kim , Yonghyun Jeong

Recent works on diffusion models have demonstrated a strong capability for conditioning image generation, e.g., text-guided image synthesis. Such success inspires many efforts trying to use large-scale pre-trained diffusion models for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Zhixing Zhang , Ligong Han , Arnab Ghosh , Dimitris Metaxas , Jian Ren

Text to Image Synthesis refers to the process of automatic generation of a photo-realistic image starting from a given text and is revolutionizing many real-world applications. In order to perform such process it is necessary to exploit…

Machine Learning · Computer Science 2019-10-10 Marco Menardi , Alex Falcon , Saida S. Mohamed , Lorenzo Seidenari , Giuseppe Serra , Alberto Del Bimbo , Carlo Tasso

Diffusion models are a powerful class of generative models capable of producing high-quality images from pure noise using a simple text prompt. While most methods which introduce additional spatial constraints into the generated images…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Zakaria Patel , Kirill Serkh

With the development of diffusion models, enhancing spatial controllability in text-to-image generation has become a vital challenge. As a representative task for addressing this challenge, layout-to-image generation aims to generate images…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Sida Huang , Siqi Huang , Ping Luo , Hongyuan Zhang

Text-to-image models offer a new level of creative flexibility by allowing users to guide the image generation process through natural language. However, using these models to consistently portray the same subject across diverse prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Yoad Tewel , Omri Kaduri , Rinon Gal , Yoni Kasten , Lior Wolf , Gal Chechik , Yuval Atzmon

Diffusion models have recently achieved remarkable progress in generating realistic images. However, challenges remain in accurately understanding and synthesizing the layout requirements in the textual prompts. To align the generated image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Biao Gong , Siteng Huang , Yutong Feng , Shiwei Zhang , Yuyuan Li , Yu Liu

We introduce a new method to efficiently create text-to-image models from a pre-trained CLIP and StyleGAN. It enables text driven sampling with an existing generative model without any external data or fine-tuning. This is achieved by…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Justin N. M. Pinkney , Chuan Li