English
Related papers

Related papers: Imaginarium: Vision-guided High-Quality 3D Scene L…

200 papers

Existing generative approaches for guided image synthesis of multi-object scenes typically rely on 2D controls in the image or text space. As a result, these methods struggle to maintain and respect consistent three-dimensional geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Léopold Maillard , Tom Durand , Adrien Ramanana Rahary , Maks Ovsjanikov

In this work, we introduce CC3D, a conditional generative model that synthesizes complex 3D scenes conditioned on 2D semantic scene layouts, trained using single-view images. Different from most existing 3D GANs that limit their…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Xingguang Yan , Gordon Wetzstein , Leonidas Guibas , Andrea Tagliasacchi

3D content creation has long been a complex and time-consuming process, often requiring specialized skills and resources. While recent advancements have allowed for text-guided 3D object and scene generation, they still fall short of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xingyi Li , Yizheng Wu , Jun Cen , Juewen Peng , Kewei Wang , Ke Xian , Zhe Wang , Zhiguo Cao , Guosheng Lin

Recent advances in text-to-3D scene generation have demonstrated significant potential to transform content creation across multiple industries. Although the research community has made impressive progress in addressing the challenges of…

Recent advancements in object-centric text-to-3D generation have shown impressive results. However, generating complex 3D scenes remains an open challenge due to the intricate relations between objects. Moreover, existing methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yu-Hsiang Huang , Wei Wang , Sheng-Yu Huang , Yu-Chiang Frank Wang

Text-driven 3D scene generation techniques have made rapid progress in recent years. Their success is mainly attributed to using existing generative models to iteratively perform image warping and inpainting to generate 3D scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Frank Zhang , Yibo Zhang , Quan Zheng , Rui Ma , Wei Hua , Hujun Bao , Weiwei Xu , Changqing Zou

Creating scenes for captured motions that achieve realistic human-scene interaction is crucial for 3D animation in movies or video games. As character motion is often captured in a blue-screened studio without real furniture or objects in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Jianan Li , Tao Huang , Qingxu Zhu , Tien-Tsin Wong

3D Content Generation is at the heart of many computer graphics applications, including video gaming, film-making, virtual and augmented reality, etc. This paper proposes a novel deep-learning based approach for automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yongzhi Xu , Yonhon Ng , Yifu Wang , Inkyu Sa , Yunfei Duan , Zhenhong Sun , Yang Li , Pan Ji , Hongdong Li

3D content generation has recently attracted significant research interest, driven by its critical applications in VR/AR and embodied AI. In this work, we tackle the challenging task of synthesizing multiple 3D assets within a single scene…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Yanxu Meng , Haoning Wu , Ya Zhang , Weidi Xie

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Beichen Wen , Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

In this paper, we propose RoomPlanner, the first fully automatic 3D room generation framework for painlessly creating realistic indoor scenes with only short text as input. Without any manual layout design or panoramic image guidance, our…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Wenzhuo Sun , Mingjian Liang , Wenxuan Song , Xuelian Cheng , Zongyuan Ge

Generating realistic building layouts for automatic building design has been studied in both the computer vision and architecture domains. Traditional approaches from the architecture domain, which are based on optimization techniques or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jiachen Liu , Yuan Xue , Haomiao Ni , Rui Yu , Zihan Zhou , Sharon X. Huang

Limited by the computational efficiency and accuracy, generating complex 3D scenes remains a challenging problem for existing generation networks. In this work, we propose DepthGAN, a novel method of generating depth maps with only semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Yidi Li , Yiqun Wang , Zhengda Lu , Jun Xiao

The generation of high-quality 3D environments is crucial for industries such as gaming, virtual reality, and cinema, yet remains resource-intensive due to the reliance on manual processes. This study performs a systematic review of…

Graphics · Computer Science 2025-06-09 Miguel Silva , Alexandre Valle de Carvalho

We present Layout-Your-3D, a framework that allows controllable and compositional 3D generation from text prompts. Existing text-to-3D methods often struggle to generate assets with plausible object interactions or require tedious…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Junwei Zhou , Xueting Li , Lu Qi , Ming-Hsuan Yang

In text-driven 3D scene generation, object layout serves as a crucial intermediate representation that bridges high-level language instructions with detailed geometric output. It not only provides a structural blueprint for ensuring…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yiheng Zhang , Zhuojiang Cai , Mingdao Wang , Meitong Guo , Tianxiao Li , Li Lin , Yuwang Wang

Compositional 3D scene synthesis has diverse applications across a spectrum of industries such as robotics, films, and video games, as it closely mirrors the complexity of real-world multi-object environments. Conventional works typically…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Yao Wei , Martin Renqiang Min , George Vosselman , Li Erran Li , Michael Ying Yang

Recent conditional image synthesis approaches provide high-quality synthesized images. However, it is still challenging to accurately adjust image contents such as the positions and orientations of objects, and synthesized images often have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Jaebong Jeong , Janghun Jo , Jingdong Wang , Sunghyun Cho , Jaesik Park

We present a method for creating 3D indoor scenes with a generative model learned from a collection of semantic-segmented depth images captured from different unknown scenes. Given a room with a specified size, our method automatically…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Ming-Jia Yang , Yu-Xiao Guo , Bin Zhou , Xin Tong

Text-to-3D scene generation holds immense potential for the gaming, film, and architecture sectors. Despite significant progress, existing methods struggle with maintaining high quality, consistency, and editing flexibility. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Haoran Li , Haolin Shi , Wenli Zhang , Wenjun Wu , Yong Liao , Lin Wang , Lik-hang Lee , Pengyuan Zhou