English
Related papers

Related papers: InstanceAssemble: Layout-Aware Image Generation vi…

200 papers

To replicate the success of text-to-image (T2I) generation, recent works employ large-scale video datasets to train a text-to-video (T2V) generator. Despite their promising results, such paradigm is computationally expensive. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Jay Zhangjie Wu , Yixiao Ge , Xintao Wang , Weixian Lei , Yuchao Gu , Yufei Shi , Wynne Hsu , Ying Shan , Xiaohu Qie , Mike Zheng Shou

The advancements in the domain of LLMs in recent years have surprised many, showcasing their remarkable capabilities and diverse applications. Their potential applications in various real-world scenarios have led to significant research on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Sujith Vemishetty , Advitiya Arora , Anupama Sharma

Taking advantage of the many recent advances in deep learning, text-to-image generative models currently have the merit of attracting the general public attention. Two of these models, DALL-E 2 and Imagen, have demonstrated that highly…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Robin Zbinden

Controllable pathology image synthesis requires reliable regulation of spatial layout, tissue morphology, and semantic detail. However, existing text-guided diffusion models offer only coarse global control and lack the ability to enforce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yuntao Shou , Xiangyong Cao , Qian Zhao , Deyu Meng

While autoregressive (AR) models have demonstrated remarkable success in image generation, extending them to layout-conditioned generation remains challenging due to the sparse nature of layout conditions and the risk of feature…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Zirui Zheng , Takashi Isobe , Tong Shen , Xu Jia , Jianbin Zhao , Xiaomin Li , Mengmeng Ge , Baolu Li , Qinghe Wang , Dong Li , Dong Zhou , Yunzhi Zhuge , Huchuan Lu , Emad Barsoum

We present a training-free style-aligned image generation method that leverages a scale-wise autoregressive model. While large-scale text-to-image (T2I) models, particularly diffusion-based methods, have demonstrated impressive generation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jihun Park , Jongmin Gim , Kyoungmin Lee , Minseok Oh , Minwoo Choi , Jaeyeul Kim , Woo Chool Park , Sunghoon Im

Style-conditioned text-to-image (T2I) generation with diffusion models requires both stable character structure and consistent, fine-grained style expression across diverse prompts. Existing approaches either rely on text-only prompting,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jingbang Tang

Text-to-image (T2I) diffusion models are effective at producing semantically aligned images, but their reliance on training data distributions limits their ability to synthesize truly novel, out-of-distribution concepts. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Fu Feng , Yucheng Xie , Xu Yang , Jing Wang , Xin Geng

Text-to-Image (T2I) generation models have advanced rapidly in recent years, but accurately capturing spatial relationships like "above" or "to the right of" poses a persistent challenge. Earlier methods improved spatial relationship…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Jessica Bader , Mateusz Pach , Maria A. Bravo , Serge Belongie , Zeynep Akata

Text-to-image (T2I) generative models have recently emerged as a powerful tool, enabling the creation of photo-realistic images and giving rise to a multitude of applications. However, the effective integration of T2I models into…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zhicai Wang , Longhui Wei , Tan Wang , Heyu Chen , Yanbin Hao , Xiang Wang , Xiangnan He , Qi Tian

Effective image and sentence matching depends on how to well measure their global visual-semantic similarity. Based on the observation that such a global similarity arises from a complex aggregation of multiple local similarities between…

Computer Vision and Pattern Recognition · Computer Science 2017-12-07 Yan Huang , Wei Wang , Liang Wang

Large-scale diffusion-based generative models have led to breakthroughs in text-conditioned high-resolution image synthesis. Starting from random noise, such text-to-image diffusion models gradually synthesize images in an iterative fashion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Yogesh Balaji , Seungjun Nah , Xun Huang , Arash Vahdat , Jiaming Song , Qinsheng Zhang , Karsten Kreis , Miika Aittala , Timo Aila , Samuli Laine , Bryan Catanzaro , Tero Karras , Ming-Yu Liu

Recently, prompt learning has emerged as the state-of-the-art (SOTA) for fair text-to-image (T2I) generation. Specifically, this approach leverages readily available reference images to learn inclusive prompts for each target Sensitive…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Christopher T. H Teo , Milad Abdollahzadeh , Xinda Ma , Ngai-man Cheung

Diffusion models are a powerful class of generative models capable of producing high-quality images from pure noise using a simple text prompt. While most methods which introduce additional spatial constraints into the generated images…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Zakaria Patel , Kirill Serkh

The ability to fine-tune generative models for text-to-image generation tasks is crucial, particularly facing the complexity involved in accurately interpreting and visualizing textual inputs. While LoRA is efficient for language model…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Mohan Zhou , Yalong Bai , Qing Yang , Tiejun Zhao

BEV-based 3D perception has emerged as a focal point of research in end-to-end autonomous driving. However, existing BEV approaches encounter significant challenges due to the large feature space, complicating efficient modeling and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Feng Li , Zhaoyue Wang , Enyuan Zhang , Mohammad Masum Billah , Yunduan Cui , Kun Xu

Text-to-image synthesis models require the ability to generate diverse images while maintaining stability. To overcome this challenge, a number of methods have been proposed, including the collection of prompt-image datasets and the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Keunwoo Park , Jihye Chae , Joong Ho Ahn , Jihoon Kweon

Precise spatial fidelity in Image-to-3D multi-instance generation is critical for downstream real-world applications. Recent work attempts to address this by fine-tuning pre-trained Image-to-3D (I23D) models on multi-instance datasets,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xiao Cai , Lianli Gao , Pengpeng Zeng , Ji Zhang , Heng Tao Shen , Jingkuan Song

Image tokenization plays a critical role in reducing the computational demands of modeling high-resolution images, significantly improving the efficiency of image and multimodal understanding and generation. Recent advances in 1D latent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Ze Wang , Hao Chen , Benran Hu , Jiang Liu , Ximeng Sun , Jialian Wu , Yusheng Su , Xiaodong Yu , Emad Barsoum , Zicheng Liu

Text-to-Image synthesis is the task of generating an image according to a specific text description. Generative Adversarial Networks have been considered the standard method for image synthesis virtually since their introduction. Denoising…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Konstantina Nikolaidou , George Retsinas , Vincent Christlein , Mathias Seuret , Giorgos Sfikas , Elisa Barney Smith , Hamam Mokayed , Marcus Liwicki