English
Related papers

Related papers: StageDesigner: Artistic Stage Generation for Sceno…

200 papers

Creating large-scale interactive 3D environments is essential for the development of Robotics and Embodied AI research. Current methods, including manual design, procedural generation, diffusion-based scene generation, and large language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yian Wang , Xiaowen Qiu , Jiageng Liu , Zhehuan Chen , Jiting Cai , Yufei Wang , Tsun-Hsuan Wang , Zhou Xian , Chuang Gan

Realistic and interactive traffic simulation is essential for training and evaluating autonomous driving systems. However, most existing data-driven simulation methods rely on static initialization or log-replay data, limiting their ability…

Robotics · Computer Science 2026-03-04 Zhenghao Peng , Yuxin Liu , Bolei Zhou

City scene generation has gained significant attention in autonomous driving, smart city development, and traffic simulation. It helps enhance infrastructure planning and monitoring solutions. Existing methods have employed a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Jie Deng , Wenhao Chai , Junsheng Huang , Zhonghan Zhao , Qixuan Huang , Mingyan Gao , Jianshu Guo , Shengyu Hao , Wenhao Hu , Jenq-Neng Hwang , Xi Li , Gaoang Wang

3D scene generation is in high demand across various domains, including virtual reality, gaming, and the film industry. Owing to the powerful generative capabilities of text-to-image diffusion models that provide reliable priors, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Haiyang Zhou , Xinhua Cheng , Wangbo Yu , Yonghong Tian , Li Yuan

We introduce SceneScript, a method that directly produces full scene models as a sequence of structured language commands using an autoregressive, token-based approach. Our proposed scene representation is inspired by recent successes in…

In this paper, we propose RoomPlanner, the first fully automatic 3D room generation framework for painlessly creating realistic indoor scenes with only short text as input. Without any manual layout design or panoramic image guidance, our…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Wenzhuo Sun , Mingjian Liang , Wenxuan Song , Xuelian Cheng , Zongyuan Ge

Recent advancements in 3D diffusion-based semantic scene generation have gained attention. However, existing methods rely on unconditional generation and require multiple resampling steps when editing scenes, which significantly limits…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Haowen Zheng , Yanyan Liang

Text-to-3D generation has achieved remarkable success via large-scale text-to-image diffusion models. Nevertheless, there is no paradigm for scaling up the methodology to urban scale. Urban scenes, characterized by numerous elements,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Fan Lu , Kwan-Yee Lin , Yan Xu , Hongsheng Li , Guang Chen , Changjun Jiang

Synthetic 3D scenes are essential for developing Physical AI and generative models. Existing procedural generation methods often have low output throughput, creating a significant bottleneck in scaling up dataset creation. In this work, we…

Robotics · Computer Science 2025-12-19 Jinghuan Shang , Harsh Patel , Ran Gong , Karl Schmeckpeper

As pretrained text-to-image diffusion models become increasingly powerful, recent efforts have been made to distill knowledge from these text-to-image pretrained models for optimizing a text-guided 3D model. Most of the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Gege Gao , Weiyang Liu , Anpei Chen , Andreas Geiger , Bernhard Schölkopf

We focus on the foundational task of Scene Staging: given a reference scene image and a text condition specifying an actor category to be generated in the scene and its spatial relation to the scene, the goal is to synthesize an output…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Cong Xie , Che Wang , Yan Zhang , Ruiqi Yu , Han Zou , Zheng Pan , Zhenpeng Zhan

Comprehending natural language instructions is a charming property for 3D indoor scene synthesis systems. Existing methods directly model object joint distributions and express object relations implicitly within a scene, thereby hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Chenguo Lin , Yadong Mu

Recent agentic frameworks for 3D scene synthesis have advanced realism and diversity by integrating heterogeneous generation and editing tools. These tools are organized into workflows orchestrated by an off-the-shelf LLM. Current…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Yun He , Kelin Yu , Matthias Zwicker

Authoring 3D scenes is a central task for spatial computing applications. Competing visions for lowering existing barriers are (1) focus on immersive, direct manipulation of 3D content or (2) leverage AI techniques that capture real scenes…

Human-Computer Interaction · Computer Science 2025-12-29 Cyrus Vachha , Yixiao Kang , Zach Dive , Ashwat Chidambaram , Anik Gupta , Eunice Jun , Bjoern Hartmann

Recent text-to-image models have revolutionized image generation, but they still struggle with maintaining concept consistency across generated images. While existing works focus on character consistency, they often overlook the crucial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Quanjian Song , Donghao Zhou , Jingyu Lin , Fei Shen , Jiaze Wang , Xiaowei Hu , Cunjian Chen , Pheng-Ann Heng

Design generation, in its essence, is a step-by-step process where designers progressively refine and enhance their work through careful modifications. Despite this fundamental characteristic, existing approaches mainly treat design…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Faizan Farooq Khan , K J Joseph , Koustava Goswami , Mohamed Elhoseiny , Balaji Vasan Srinivasan

Generating realistic 3D indoor scenes from user inputs remains a challenging problem in computer vision and graphics, requiring careful balance of geometric consistency, spatial relationships, and visual realism. While neural generation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Mengqi Zhou , Xipeng Wang , Yuxi Wang , Zhaoxiang Zhang

We address the task of indoor scene generation by generating a sequence of objects, along with their locations and orientations conditioned on a room layout. Large-scale indoor scene datasets allow us to extract patterns from user-designed…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Xinpeng Wang , Chandan Yeshwanth , Matthias Nießner

Our project page: https://scutyklin.github.io/SceneLCM/. Automated generation of complex, interactive indoor scenes tailored to user prompt remains a formidable challenge. While existing methods achieve indoor scene synthesis, they struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yangkai Lin , Jiabao Lei , Kui Jia

Developing comprehensive explicit world models is crucial for understanding and simulating real-world scenarios. Recently, Procedural Controllable Generation (PCG) has gained significant attention in large-scale scene generation by enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Mengqi Zhou , Yuxi Wang , Jun Hou , Shougao Zhang , Yiwei Li , Chuanchen Luo , Junran Peng , Zhaoxiang Zhang