English
Related papers

Related papers: HoloDreamer: Holistic 3D Panoramic World Generatio…

200 papers

3D immersive scene generation is a challenging yet critical task in computer vision and graphics. A desired virtual 3D scene should 1) exhibit omnidirectional view consistency, and 2) allow for free exploration in complex scene hierarchies.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Shuai Yang , Jing Tan , Mengchen Zhang , Tong Wu , Yixuan Li , Gordon Wetzstein , Ziwei Liu , Dahua Lin

Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xiaolin Hong , Hongwei Yi , Fazhi He , Qiong Cao

The generation of immersive and navigable 3D environments is increasingly prevalent with the growing adoption of virtual reality and 3D content. However, recent methods face a fundamental limitation: they cannot produce 3D worlds that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Antoine Schnepf , Karim Kassab , Flavian Vasile , Andrew Comport

Despite having tremendous progress in image-to-3D generation, existing methods still struggle to produce multi-view consistent images with high-resolution textures in detail, especially in the paradigm of 2D diffusion that lacks 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Haibo Yang , Yang Chen , Yingwei Pan , Ting Yao , Zhineng Chen , Chong-Wah Ngo , Tao Mei

3D scene generation plays a crucial role in gaming, artistic creation, virtual reality, and many other domains. However, current 3D scene design still relies heavily on extensive manual effort from creators, and existing automated methods…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Zixuan Bian , Ruohan Ren , Yue Yang , Chris Callison-Burch

Existing dynamic scene generation methods mostly rely on distilling knowledge from pre-trained 3D generative models, which are typically fine-tuned on synthetic object datasets. As a result, the generated scenes are often object-centric and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Heng Yu , Chaoyang Wang , Peiye Zhuang , Willi Menapace , Aliaksandr Siarohin , Junli Cao , Laszlo A Jeni , Sergey Tulyakov , Hsin-Ying Lee

Text-driven 3D scene generation is widely applicable to video gaming, film industry, and metaverse applications that have a large demand for 3D scenes. However, existing text-to-3D generation methods are limited to producing 3D objects with…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jingbo Zhang , Xiaoyu Li , Ziyu Wan , Can Wang , Jing Liao

Recent advancements in 3D generation have leveraged synthetic datasets with ground truth 3D assets and predefined cameras. However, the potential of adopting real-world datasets, which can produce significantly more realistic 3D scenes,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Xinyang Li , Zhangyu Lai , Linning Xu , Yansong Qu , Liujuan Cao , Shengchuan Zhang , Bo Dai , Rongrong Ji

Generating 3D scenes is still a challenging task due to the lack of readily available scene data. Most existing methods only produce partial scenes and provide limited navigational freedom. We introduce a practical and scalable solution…

Graphics · Computer Science 2025-09-26 Zhaoyang Zhang , Yannick Hold-Geoffroy , Miloš Hašan , Ziwen Chen , Fujun Luan , Julie Dorsey , Yiwei Hu

3D scene generation conditioned on text prompts has significantly progressed due to the development of 2D diffusion generation models. However, the textual description of 3D scenes is inherently inaccurate and lacks fine-grained control…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Minglin Chen , Longguang Wang , Sheng Ao , Ye Zhang , Kai Xu , Yulan Guo

3D scene reconstruction is essential for applications in virtual reality, robotics, and autonomous driving, enabling machines to understand and interact with complex environments. Traditional 3D Gaussian Splatting techniques rely on images…

Graphics · Computer Science 2025-03-04 Changlin Song , Jiaqi Wang , Liyun Zhu , He Weng

3D scene generation is a core technology for gaming, film/VFX, and VR/AR. Growing demand for rapid iteration, high-fidelity detail, and accessible content creation has further increased interest in this area. Existing methods broadly follow…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Haozhi Zhu , Miaomiao Zhao , Dingyao Liu , Runze Tian , Yan Zhang , Jie Guo , Fenggen Yu

Text-guided diffusion models have shown superior performance in image/video generation and editing. While few explorations have been performed in 3D scenarios. In this paper, we discuss three fundamental and interesting problems on this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Gang Li , Heliang Zheng , Chaoyue Wang , Chang Li , Changwen Zheng , Dacheng Tao

We introduce VividDream, a method for generating explorable 4D scenes with ambient dynamics from a single input image or text prompt. VividDream first expands an input image into a static 3D point cloud through iterative inpainting and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Yao-Chih Lee , Yi-Ting Chen , Andrew Wang , Ting-Hsuan Liao , Brandon Y. Feng , Jia-Bin Huang

Scene-level 3D generation represents a critical frontier in multimedia and computer graphics, yet existing approaches either suffer from limited object categories or lack editing flexibility for interactive applications. In this paper, we…

Graphics · Computer Science 2025-04-18 Wenqi Dong , Bangbang Yang , Zesong Yang , Yuan Li , Tao Hu , Hujun Bao , Yuewen Ma , Zhaopeng Cui

Generative models for 3D object synthesis have seen significant advancements with the incorporation of prior knowledge distilled from 2D diffusion models. Nevertheless, challenges persist in the form of multi-view geometric inconsistencies…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Lincong Feng , Muyu Wang , Maoyu Wang , Kuo Xu , Xiaoli Liu

Recent advancements in video generation have primarily leveraged diffusion models for short-duration content. However, these approaches often fall short in modeling complex narratives and maintaining character consistency over extended…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Canyu Zhao , Mingyu Liu , Wen Wang , Weihua Chen , Fan Wang , Hao Chen , Bo Zhang , Chunhua Shen

Text-to-3D generation by distilling pretrained large-scale text-to-image diffusion models has shown great promise but still suffers from inconsistent 3D geometric structures (Janus problems) and severe artifacts. The aforementioned problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Baorui Ma , Haoge Deng , Junsheng Zhou , Yu-Shen Liu , Tiejun Huang , Xinlong Wang

In this work, we present SceneDreamer, an unconditional generative model for unbounded 3D scenes, which synthesizes large-scale 3D landscapes from random noise. Our framework is learned from in-the-wild 2D image collections only, without…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Zhaoxi Chen , Guangcong Wang , Ziwei Liu

Despite recent advancements in neural 3D reconstruction, the dependence on dense multi-view captures restricts their broader applicability. Additionally, 3D scene generation is vital for advancing embodied AI and world models, which depend…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yuxin Zhang , Ziyu Lu , Hongbo Duan , Keyu Fan , Pengting Luo , Peiyu Zhuang , Mengyu Yang , Houde Liu