English
Related papers

Related papers: Training-Free Layout-to-Image Generation with Marg…

200 papers

We propose a new method for solving imaging inverse problems using text-to-image latent diffusion models as general priors. Existing methods using latent diffusion models for inverse problems typically rely on simple null text prompts,…

Machine Learning · Computer Science 2023-10-03 Hyungjin Chung , Jong Chul Ye , Peyman Milanfar , Mauricio Delbracio

Large-scale text-to-image models that can generate high-quality and diverse images based on textual prompts have shown remarkable success. These models aim ultimately to create complex scenes, and addressing the challenge of multi-subject…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Barak Battash , Amit Rozner , Lior Wolf , Ofir Lindenbaum

Despite recent advancements in text-to-image models, achieving semantically accurate images in text-to-image diffusion models is a persistent challenge. While existing initial latent optimization methods have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Aravindan Sundaram , Ujjayan Pal , Abhimanyu Chauhan , Aishwarya Agarwal , Srikrishna Karanam

Recent approaches such as ControlNet offer users fine-grained spatial control over text-to-image (T2I) diffusion models. However, auxiliary modules have to be trained for each type of spatial condition, model architecture, and checkpoint,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Sicheng Mo , Fangzhou Mu , Kuan Heng Lin , Yanli Liu , Bochen Guan , Yin Li , Bolei Zhou

Text-to-image generation (T2I) refers to the text-guided generation of high-quality images. In the past few years, T2I has attracted widespread attention and numerous works have emerged. In this survey, we comprehensively review 141 works…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Pengfei Yang , Ngai-Man Cheung , Xinda Ma

The popularization of Text-to-Image (T2I) diffusion models enables the generation of high-quality images from text descriptions. However, generating diverse customized images with reference visual attributes remains challenging. This work…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Brian Nlong Zhao , Yuhang Xiao , Jiashu Xu , Xinyang Jiang , Yifan Yang , Dongsheng Li , Laurent Itti , Vibhav Vineet , Yunhao Ge

Text-guided image generation and editing using diffusion models have achieved remarkable advancements. Among these, tuning-free methods have gained attention for their ability to perform edits without extensive model adjustments, offering…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Wenyi Mo , Tianyu Zhang , Yalong Bai , Bing Su , Ji-Rong Wen

Multimodal autoregressive (AR) models, based on next-token prediction and transformer architecture, have demonstrated remarkable capabilities in various multimodal tasks including text-to-image (T2I) generation. Despite their strong…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yi Wu , Shengju Qian , Lingting Zhu , Lei Liu , Wandi Qiao , Ziqiang Li , Lequan Yu , Bin Li

Text-to-image diffusion models exhibit remarkable generative capabilities, but lack precise control over object counts and spatial arrangements. This work introduces a two-stage system to address these compositional limitations. The first…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Jan-Hendrik Koch , Jonas Krumme , Konrad Gadzicki

Diffusion models have revolutionized text-to-image (T2I) synthesis, producing high-quality, photorealistic images. However, they still struggle to properly render the spatial relationships described in text prompts. To address the lack of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Andrea Rigo , Luca Stornaiuolo , Mauro Martino , Bruno Lepri , Nicu Sebe

Diffusion models for Text-to-Image (T2I) conditional generation have recently achieved tremendous success. Yet, aligning these models with user's intentions still involves a laborious trial-and-error process, and this challenging alignment…

Machine Learning · Computer Science 2025-02-12 Chao Wang , Giulio Franzese , Alessandro Finamore , Massimo Gallo , Pietro Michiardi

Image-to-Image translation models can help mitigate various challenges inherent to medical image acquisition. Latent diffusion models (LDMs) leverage efficient learning in compressed latent space and constitute the core of state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Junhyeok Lee , Hyunwoong Kim , Hyungjin Chung , Heeseong Eom , Joon Jang , Chul-Ho Sohn , Kyu Sung Choi

Text-to-image generation is a significant domain in modern computer vision and has achieved substantial improvements through the evolution of generative architectures. Among these, there are diffusion-based models that have demonstrated…

Numerous studies on text-to-image (T2I) generative models have utilized cross-attention maps to boost application performance and interpret model behavior. However, the distinct characteristics of attention maps from different attention…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Jungwon Park , Jungmin Ko , Dongnam Byun , Wonjong Rhee

Text-to-image (T2I) diffusion models have demonstrated impressive performance in generating high-fidelity images, largely enabled by text-guided inference. However, this advantage often comes with a critical drawback: limited diversity, as…

Graphics · Computer Science 2026-03-17 Byungjun Kim , Soobin Um , Jong Chul Ye

Style transfer aims to render a content image with the visual characteristics of a reference style while preserving its underlying semantic layout and structural geometry. While recent diffusion-based models demonstrate strong stylization…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Dongkyung Kang , Jaeyeon Hwang , Junseo Park , Minji Kang , Yeryeong Lee , Beomseok Ko , Hanyoung Roh , Jeongmin Shin , Hyeryung Jang

Recently, pre-trained text-to-image (T2I) models have been extensively adopted for real-world image restoration because of their powerful generative prior. However, controlling these large models for image restoration usually requires a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Junyuan Deng , Xinyi Wu , Yongxing Yang , Congchao Zhu , Song Wang , Zhenyao Wu

Text-to-image (T2I) generative models have recently emerged as a powerful tool, enabling the creation of photo-realistic images and giving rise to a multitude of applications. However, the effective integration of T2I models into…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zhicai Wang , Longhui Wei , Tan Wang , Heyu Chen , Yanbin Hao , Xiang Wang , Xiangnan He , Qi Tian

Recent advancements in text-to-video (T2V) diffusion models have significantly enhanced the visual quality of the generated videos. However, even recent T2V models find it challenging to follow text descriptions accurately, especially when…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Jialu Li , Shoubin Yu , Han Lin , Jaemin Cho , Jaehong Yoon , Mohit Bansal

Magnetic Resonance Imaging (MRI) enables the acquisition of multiple image contrasts, such as T1-weighted (T1w) and T2-weighted (T2w) scans, each offering distinct diagnostic insights. However, acquiring all desired modalities increases…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Andrea Moschetto , Lemuel Puglisi , Alec Sargood , Pierluigi Dell'Acqua , Francesco Guarnera , Sebastiano Battiato , Daniele Ravì