English
Related papers

Related papers: WorldGrow: Generating Infinite 3D World

200 papers

Recent advancements in object-centric text-to-3D generation have shown impressive results. However, generating complex 3D scenes remains an open challenge due to the intricate relations between objects. Moreover, existing methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yu-Hsiang Huang , Wei Wang , Sheng-Yu Huang , Yu-Chiang Frank Wang

Automatically generating a complete 3D scene from a text description, a reference image, or both has significant applications in fields like virtual reality and gaming. However, current methods often generate low-quality textures and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zhexiao Xiong , Zhang Chen , Zhong Li , Yi Xu , Nathan Jacobs

We introduce LivingWorld, an interactive framework for generating 4D worlds with environmental dynamics from a single image. While recent advances in 3D scene generation enable large-scale environment creation, most approaches focus…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Hyeongju Mun , In-Hwan Jin , Sohyeong Kim , Kyeongbo Kong

The generation of immersive and navigable 3D environments is increasingly prevalent with the growing adoption of virtual reality and 3D content. However, recent methods face a fundamental limitation: they cannot produce 3D worlds that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Antoine Schnepf , Karim Kassab , Flavian Vasile , Andrew Comport

Large-scale scene data is essential for training and testing in robot learning. Neural reconstruction methods have promised the capability of reconstructing large physically-grounded outdoor scenes from captured sensor data. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Julian Ost , Andrea Ramazzina , Amogh Joshi , Maximilian Bömer , Mario Bijelic , Felix Heide

We introduce a recipe for generating immersive 3D worlds from a single image by framing the task as an in-context learning problem for 2D inpainting models. This approach requires minimal training and uses existing generative models. Our…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Katja Schwarz , Denys Rozumnyi , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder

Modeling scenes using video generation models has garnered growing research interest in recent years. However, most existing approaches rely on perspective video models that synthesize only limited observations of a scene, leading to issues…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Yuheng Liu , Xin Lin , Xinke Li , Baihan Yang , Chen Wang , Kalyan Sunkavalli , Yannick Hold-Geoffroy , Hao Tan , Kai Zhang , Xiaohui Xie , Zifan Shi , Yiwei Hu

3D scene generation has garnered growing attention in recent years and has made significant progress. Generating 4D cities is more challenging than 3D scenes due to the presence of structurally complex, visually diverse objects like…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

The synthesis of immersive 3D scenes from text is rapidly maturing, driven by novel video generative models and feed-forward 3D reconstruction, with vast potential in AR/VR and world modeling. While panoramic images have proven effective…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Felix Wimbauer , Fabian Manhardt , Michael Oechsle , Nikolai Kalischek , Christian Rupprecht , Daniel Cremers , Federico Tombari

3D world generation is essential for applications such as immersive content creation or autonomous driving simulation. Recent advances in 3D world generation have shown promising results; however, these methods are constrained by grid…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jaeyoung Chung , Suyoung Lee , Jianfeng Xiang , Jiaolong Yang , Kyoung Mu Lee

Modern machine learning models for scene understanding, such as depth estimation and object tracking, rely on large, high-quality datasets that mimic real-world deployment scenarios. To address data scarcity, we propose an end-to-end system…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Sonia Laguna , Alberto Garcia-Garcia , Marie-Julie Rakotosaona , Stylianos Moschoglou , Leonhard Helminger , Sergio Orts-Escolano

Generating realistic 3D indoor scenes from user inputs remains a challenging problem in computer vision and graphics, requiring careful balance of geometric consistency, spatial relationships, and visual realism. While neural generation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Mengqi Zhou , Xipeng Wang , Yuxi Wang , Zhaoxiang Zhang

Recent advances in text-to-3D scene generation have demonstrated significant potential to transform content creation across multiple industries. Although the research community has made impressive progress in addressing the challenges of…

The creation of complex 3D scenes tailored to user specifications has been a tedious and challenging task with traditional 3D modeling tools. Although some pioneering methods have achieved automatic text-to-3D generation, they are generally…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xiuyu Yang , Yunze Man , Jun-Kun Chen , Yu-Xiong Wang

A fundamental challenge in text-to-3D face generation is achieving high-quality geometry. The core difficulty lies in the arbitrary and intricate distribution of vertices in 3D space, making it challenging for existing models to establish…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Junyi Zhang , Yiming Wang , Yunhong Lu , Qichao Wang , Wenzhe Qian , Xiaoyin Xu , David Gu , Min Zhang

In this work, we present a novel method for extensive multi-scale generative terrain modeling. At the core of our model is a cascade of superresolution diffusion models that can be combined to produce consistent images across multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ansh Sharma , Albert Xiao , Praneet Rathi , Rohit Kundu , Albert Zhai , Yuan Shen , Shenlong Wang

Generative models have shown substantial impact across multiple domains, their potential for scene synthesis remains underexplored in robotics. This gap is more evident in drone simulators, where simulation environments still rely heavily…

We are witnessing significant breakthroughs in the technology for generating 3D objects from text. Existing approaches either leverage large text-to-image models to optimize a 3D representation or train 3D generators on object-centric…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Qihang Zhang , Chaoyang Wang , Aliaksandr Siarohin , Peiye Zhuang , Yinghao Xu , Ceyuan Yang , Dahua Lin , Bolei Zhou , Sergey Tulyakov , Hsin-Ying Lee

Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xiaolin Hong , Hongwei Yi , Fazhi He , Qiong Cao

Generating explorable 3D scenes from a single image is a highly challenging problem in 3D vision. Existing methods struggle to support free exploration, often producing severe geometric distortions and noisy artifacts when the viewpoint…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Pengfei Wang , Liyi Chen , Zhiyuan Ma , Yanjun Guo , Guowen Zhang , Lei Zhang