English
Related papers

Related papers: WonderWorld: Interactive 3D Scene Generation from …

200 papers

With the rapid advancement of autonomous driving technology, a lack of data has become a major obstacle to enhancing perception model accuracy. Researchers are now exploring controllable data generation using world models to diversify…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Xinqing Li , Ruiqi Song , Qingyu Xie , Ye Wu , Nanxin Zeng , Yunfeng Ai

Scene flow is a challenging task aimed at jointly estimating the 3D structure and motion of the sensed environment. Although deep learning solutions achieve outstanding performance in terms of accuracy, these approaches divide the whole…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Filippo Aleotti , Matteo Poggi , Fabio Tosi , Stefano Mattoccia

3D scene generation has long been dominated by 2D multi-view or video diffusion models. This is due not only to the lack of scene-level 3D latent representation, but also to the fact that most scene-level 3D visual data exists in the form…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Dongxu Wei , Qi Xu , Zhiqi Li , Hangning Zhou , Cong Qiu , Hailong Qin , Mu Yang , Zhaopeng Cui , Peidong Liu

We introduce 3D4D, an interactive 4D visualization framework that integrates WebGL with Supersplat rendering. It transforms static images and text into coherent 4D scenes through four core modules and employs a foveated rendering strategy…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yunhong He , Zhengqing Yuan , Zhengzhong Tu , Yanfang Ye , Lichao Sun

Limited by the computational efficiency and accuracy, generating complex 3D scenes remains a challenging problem for existing generation networks. In this work, we propose DepthGAN, a novel method of generating depth maps with only semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Yidi Li , Yiqun Wang , Zhengda Lu , Jun Xiao

3D Gaussian Splatting (3DGS) enables the reconstruction of intricate digital 3D assets from multi-view images by leveraging a set of 3D Gaussian primitives for rendering. Its explicit and discrete representation facilitates the seamless…

Graphics · Computer Science 2025-05-13 Xijie Yang , Linning Xu , Lihan Jiang , Dahua Lin , Bo Dai

Recent advances in 3D scene generation produce visually appealing output, but current representations hinder artists' workflows that require modifiable 3D textured mesh scenes for visual effects and game development. Despite significant…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Tobias Sautter , Jan-Niklas Dihlmann , Hendrik P. A. Lensch

Existing 3D-aware image synthesis approaches mainly focus on generating a single canonical object and show limited capacity in composing a complex scene containing a variety of objects. This work presents DisCoScene: a 3Daware generative…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Yinghao Xu , Menglei Chai , Zifan Shi , Sida Peng , Ivan Skorokhodov , Aliaksandr Siarohin , Ceyuan Yang , Yujun Shen , Hsin-Ying Lee , Bolei Zhou , Sergey Tulyakov

Pre-trained flow-based models excel at synthesizing complex scenes yet lack a direct mechanism for disentangling and customizing their underlying concepts from one-shot real-world sources. To demystify this process, we first introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jintao Chen , Aiming Hao , Xiaoqing Chen , Chengyu Bai , Chubin Chen , Yanxun Li , Jiahong Wu , Xiangxiang Chu , Shanghang Zhang

Recent advances in large reconstruction and generative models have significantly improved scene reconstruction and novel view generation. However, due to compute limitations, each inference with these large models is confined to a small…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Shangjin Zhai , Zhichao Ye , Jialin Liu , Weijian Xie , Jiaqi Hu , Zhen Peng , Hua Xue , Danpeng Chen , Xiaomeng Wang , Lei Yang , Nan Wang , Haomin Liu , Guofeng Zhang

The generation of immersive and navigable 3D environments is increasingly prevalent with the growing adoption of virtual reality and 3D content. However, recent methods face a fundamental limitation: they cannot produce 3D worlds that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Antoine Schnepf , Karim Kassab , Flavian Vasile , Andrew Comport

We address the challenge of generating 3D worlds from textual descriptions. We propose SynCity, a training- and optimization-free approach, which leverages the geometric precision of pre-trained 3D generative models and the artistic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Paul Engstler , Aleksandar Shtedritski , Iro Laina , Christian Rupprecht , Andrea Vedaldi

We introduce Text2Immersion, an elegant method for producing high-quality 3D immersive scenes from text prompts. Our proposed pipeline initiates by progressively generating a Gaussian cloud using pre-trained 2D diffusion and depth…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Hao Ouyang , Kathryn Heal , Stephen Lombardi , Tiancheng Sun

Explorable 3D world generation from a single image or text prompt forms a cornerstone of spatial intelligence. Recent works utilize video model to achieve wide-scope and generalizable 3D world generation. However, existing approaches often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Zhongqi Yang , Wenhang Ge , Yuqi Li , Jiaqi Chen , Haoyuan Li , Mengyin An , Fei Kang , Hua Xue , Baixin Xu , Yuyang Yin , Eric Li , Yang Liu , Yikai Wang , Hao-Xiang Guo , Yahui Zhou

Creating flexible 3D scenes from a single image is vital when direct 3D data acquisition is costly or impractical. We introduce NavCrafter, a novel framework that explores 3D scenes from a single image by synthesizing novel-view video…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Hongbo Duan , Peiyu Zhuang , Yi Liu , Zhengyang Zhang , Yuxin Zhang , Pengting Luo , Fangming Liu , Xueqian Wang

Current image-to-3D approaches suffer from high computational costs and lack scalability for high-resolution outputs. In contrast, we introduce a novel framework to directly generate explicit surface geometry and texture using multi-view 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Haoyu Wu , Meher Gitika Karumuri , Chuhang Zou , Seungbae Bang , Yuelong Li , Dimitris Samaras , Sunil Hadap

We present Free4D, a novel tuning-free framework for 4D scene generation from a single image. Existing methods either focus on object-level generation, making scene-level generation infeasible, or rely on large-scale multi-view video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Tianqi Liu , Zihao Huang , Zhaoxi Chen , Guangcong Wang , Shoukang Hu , Liao Shen , Huiqiang Sun , Zhiguo Cao , Wei Li , Ziwei Liu

Despite increasingly realistic image quality, recent 3D image generative models often operate on 3D volumes of fixed extent with limited camera motions. We investigate the task of unconditionally synthesizing unbounded nature scenes,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Lucy Chai , Richard Tucker , Zhengqi Li , Phillip Isola , Noah Snavely

3D Gaussian Splatting (3DGS) delivers high-fidelity real-time rendering but suffers from geometric and photometric degradations under sparse-view constraints. Current generative restoration approaches are often limited by insufficient…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Xinliang Wang , Yifeng Shi , Zhenyu Wu

We target a 3D generative model for general natural scenes that are typically unique and intricate. Lacking the necessary volumes of training data, along with the difficulties of having ad hoc designs in presence of varying scene…

Graphics · Computer Science 2023-04-27 Weiyu Li , Xuelin Chen , Jue Wang , Baoquan Chen