English
Related papers

Related papers: HetScene: Heterogeneity-Aware Diffusion for Dense …

200 papers

Indoor scene synthesis aims to automatically produce plausible, realistic and diverse 3D indoor scenes, especially given arbitrary user requirements. Recently, the promising generalization ability of pre-trained large language models (LLM)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Weilin Sun , Xinran Li , Manyi Li , Kai Xu , Xiangxu Meng , Lei Meng

Our project page: https://scutyklin.github.io/SceneLCM/. Automated generation of complex, interactive indoor scenes tailored to user prompt remains a formidable challenge. While existing methods achieve indoor scene synthesis, they struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yangkai Lin , Jiabao Lei , Kui Jia

The task of transforming a furnished room image into a background-only is extremely challenging since it requires making large changes regarding the scene context while still preserving the overall layout and style. In order to acquire…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Vasileios Gkitsas , Nikolaos Zioulis , Vladimiros Sterzentsenko , Alexandros Doumanoglou , Dimitrios Zarpalas

Audio generation has long been fragmented, with speech, music, and sound effects produced by domain-specific models that fail to jointly generate coherent audio scenes from a single description. The key obstacles are insufficient…

The visual world we sense, interpret and interact everyday is a complex composition of interleaved physical entities. Therefore, it is a very challenging task to generate vivid scenes of similar complexity using computers. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Mehmet Ozgur Turkoglu , William Thong , Luuk Spreeuwers , Berkay Kicanaoglu

A promise of Generative Adversarial Networks (GANs) is to provide cheap photorealistic data for training and validating AI models in autonomous driving. Despite their huge success, their performance on complex images featuring multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 George Eskandar , Youssef Farag , Tarun Yenamandra , Daniel Cremers , Karim Guirguis , Bin Yang

We present GuidedSceneGen, a text-to-3D generation framework that produces metrically accurate, globally consistent, and semantically interpretable indoor scenes. Unlike prior text-driven methods that often suffer from geometric drift or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Stefan Ainetter , Thomas Deixelberger , Edoardo A. Dominici , Philipp Drescher , Konstantinos Vardis , Markus Steinberger

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Beichen Wen , Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Generating realistic 3D indoor scenes from user inputs remains a challenging problem in computer vision and graphics, requiring careful balance of geometric consistency, spatial relationships, and visual realism. While neural generation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Mengqi Zhou , Xipeng Wang , Yuxi Wang , Zhaoxiang Zhang

Scene generation has extensive industrial applications, demanding both high realism and precise control over geometry and appearance. Language-driven retrieval methods compose plausible scenes from a large object database, but overlook…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Zhifei Yang , Guangyao Zhai , Keyang Lu , YuYang Yin , Chao Zhang , Zhen Xiao , Jieyi Long , Nassir Navab , Yikai Wang

Generating higher-resolution human-centric scenes with details and controls remains a challenge for existing text-to-image diffusion models. This challenge stems from limited training image size, text encoder capacity (limited tokens), and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Gwanghyun Kim , Hayeon Kim , Hoigi Seo , Dong Un Kang , Se Young Chun

Text-driven 3D indoor scene generation holds broad applications, ranging from gaming and smart homes to AR/VR applications. Fast and high-fidelity scene generation is paramount for ensuring user-friendly experiences. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yikun Ma , Dandan Zhan , Zhi Jin

We introduce ClutterGen, a physically compliant simulation scene generator capable of producing highly diverse, cluttered, and stable scenes for robot learning. Generating such scenes is challenging as each object must adhere to physical…

Robotics · Computer Science 2024-10-08 Yinsen Jia , Boyuan Chen

In the field of graphic design, automating the integration of design elements into a cohesive multi-layered artwork not only boosts productivity but also paves the way for the democratization of graphic design. One existing practice is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yutao Cheng , Zhao Zhang , Maoke Yang , Hui Nie , Chunyuan Li , Xinglong Wu , Jie Shao

Flow matching and diffusion models have shown impressive results in text-to-image generation, producing photorealistic images through an iterative denoising process. A common strategy to speed up synthesis is to perform early denoising at…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Jyun-Ze Tang , Chih-Fan Hsu , Jeng-Lin Li , Ming-Ching Chang , Wei-Chao Chen

Automatically generating high-quality real world 3D scenes is of enormous interest for applications such as virtual reality and robotics simulation. Towards this goal, we introduce NeuralField-LDM, a generative model capable of synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Seung Wook Kim , Bradley Brown , Kangxue Yin , Karsten Kreis , Katja Schwarz , Daiqing Li , Robin Rombach , Antonio Torralba , Sanja Fidler

Indoor scene generation has attracted significant attention recently as it is crucial for applications of gaming, virtual reality, and interior design. Current indoor scene generation methods can produce reasonable room layouts but often…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Genghao Zhang , Yuxi Wang , Chuanchen Luo , Shibiao Xu , Zhaoxiang Zhang , Man Zhang , Junran Peng

We present DiffInDScene, a novel framework for tackling the problem of high-quality 3D indoor scene generation, which is challenging due to the complexity and diversity of the indoor scene geometry. Although diffusion-based generative…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Xiaoliang Ju , Zhaoyang Huang , Yijin Li , Guofeng Zhang , Yu Qiao , Hongsheng Li

We present SemLayoutDiff, a unified model for synthesizing diverse 3D indoor scenes across multiple room types. The model introduces a scene layout representation combining a top-down semantic map and attributes for each object. Unlike…

Graphics · Computer Science 2025-09-09 Xiaohao Sun , Divyam Goel , Angel X. Chang

While diffusion models have significantly advanced the quality of image generation their capability to accurately and coherently render text within these images remains a substantial challenge. Conventional diffusion-based methods for scene…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qilong Zhangli , Jindong Jiang , Di Liu , Licheng Yu , Xiaoliang Dai , Ankit Ramchandani , Guan Pang , Dimitris N. Metaxas , Praveen Krishnan