English
Related papers

Related papers: Generating Compositional Scenes via Text-to-image …

200 papers

In text-to-image generation tasks, the advancements of diffusion models have facilitated the fidelity of generated results. However, these models encounter challenges when processing text prompts containing multiple entities and attributes.…

Computation and Language · Computer Science 2024-04-23 Yihang Wu , Xiao Cao , Kaixin Li , Zitan Chen , Haonan Wang , Lei Meng , Zhiyong Huang

Generative models have demonstrated remarkable abilities in generating high-fidelity visual content. In this work, we explore how generative models can further be used not only to synthesize visual content but also to understand the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yanbo Wang , Justin Dauwels , Yilun Du

We introduce a novel, training-free system for reconstructing, understanding, and rendering 3D indoor scenes from a sparse set of unposed RGB images. Unlike traditional radiance field approaches that require dense views and per-scene…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jiatong Xia , Lingqiao Liu

Text-to-image (T2I) diffusion models have shown remarkable success in generating high-quality images from text prompts. Recent efforts extend these models to incorporate conditional images (e.g., canny edge) for fine-grained spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Liheng Zhang , Lexi Pang , Hang Ye , Xiaoxuan Ma , Yizhou Wang

Text-to-image diffusion models have recently received a lot of interest for their astonishing ability to produce high-fidelity images from text only. However, achieving one-shot generation that aligns with the user's intent is nearly…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Manuel Brack , Felix Friedrich , Dominik Hintersdorf , Lukas Struppek , Patrick Schramowski , Kristian Kersting

Deep generative models have shown impressive results in generating realistic images of faces. GANs managed to generate high-quality, high-fidelity images when conditioned on semantic masks, but they still lack the ability to diversify their…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Nico Giambi , Giuseppe Lisanti

Recent text-to-image diffusion models are able to learn and synthesize images containing novel, personalized concepts (e.g., their own pets or specific items) with just a few examples for training. This paper tackles two interconnected…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Chun-Hsiao Yeh , Ta-Ying Cheng , He-Yen Hsieh , Chuan-En Lin , Yi Ma , Andrew Markham , Niki Trigoni , H. T. Kung , Yubei Chen

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

3D scene generation is in high demand across various domains, including virtual reality, gaming, and the film industry. Owing to the powerful generative capabilities of text-to-image diffusion models that provide reliable priors, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Haiyang Zhou , Xinhua Cheng , Wangbo Yu , Yonghong Tian , Li Yuan

Recent advancements in text-to-image models, particularly diffusion models, have shown significant promise. However, compositional text-to-image models frequently encounter difficulties in generating high-quality images that accurately…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Song Wen , Guian Fang , Renrui Zhang , Peng Gao , Hao Dong , Dimitris Metaxas

Text-to-image models are powerful tools for image creation. However, the generation process is akin to a dice roll and makes it difficult to achieve a single image that captures everything a user wants. In this paper, we propose a framework…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Sean J. Liu , Nupur Kumari , Ariel Shamir , Jun-Yan Zhu

The advancement of text-to-image synthesis has introduced powerful generative models capable of creating realistic images from textual prompts. However, precise control over image attributes remains challenging, especially at the instance…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Andrey Palaev , Adil Khan , Syed M. Ahsan Kazmi

Text-to-image generation models have seen considerable advancement, catering to the increasing interest in personalized image creation. Current customization techniques often necessitate users to provide multiple images (typically 3-5) for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Linhao Zhong , Yan Hong , Wentao Chen , Binglin Zhou , Yiyi Zhang , Jianfu Zhang , Liqing Zhang

We present a new, fast and flexible pipeline for indoor scene synthesis that is based on deep convolutional generative models. Our method operates on a top-down image-based representation, and inserts objects iteratively into the scene by…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Daniel Ritchie , Kai Wang , Yu-an Lin

Generating high-quality textures for 3D scenes is crucial for applications in interior design, gaming, and augmented/virtual reality (AR/VR). Although recent advancements in 3D generative models have enhanced content creation, significant…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Yunfan Zhang , Zhiwei Xiong , Zhiqi Shen , Guosheng Lin , Hao Wang , Nicolas Vun

Recent advancements in 3D object generation using diffusion models have achieved remarkable success, but generating realistic 3D urban scenes remains challenging. Existing methods relying solely on 3D diffusion models tend to suffer a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Hanlei Guo , Jiahao Shao , Xinya Chen , Xiyang Tan , Sheng Miao , Yujun Shen , Yiyi Liao

Diffusion models are highly regarded for their controllability and the diversity of images they generate. However, class-conditional generation methods based on diffusion models often focus on more common categories. In large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Kun Wang , Donglin Di , Tonghua Su , Lei Fan

Diffusion models have attracted significant attention due to the remarkable ability to create content and generate data for tasks like image classification. However, the usage of diffusion models to generate the high-quality object…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Kai Chen , Enze Xie , Zhe Chen , Yibo Wang , Lanqing Hong , Zhenguo Li , Dit-Yan Yeung

This study investigates human-computer interface generation based on diffusion models to overcome the limitations of traditional template-based design and fixed rule-driven methods. It first analyzes the key challenges of interface…

Human-Computer Interaction · Computer Science 2026-01-13 Rui Liu , Liuqingqing Yang , Runsheng Zhang , Shixiao Wang

Utilizing pre-trained 2D large-scale generative models, recent works are capable of generating high-quality novel views from a single in-the-wild image. However, due to the lack of information from multiple views, these works encounter…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Yunhan Yang , Yukun Huang , Xiaoyang Wu , Yuan-Chen Guo , Song-Hai Zhang , Hengshuang Zhao , Tong He , Xihui Liu