English
Related papers

Related papers: WonderTurbo: Generating Interactive 3D World in 0.…

200 papers

The recent availability and adaptability of text-to-image models has sparked a new era in many related domains that benefit from the learned text priors as well as high-quality and fast generation capabilities, one of which is texture…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Raphael Bensadoun , Yanir Kleiman , Idan Azuri , Omri Harosh , Andrea Vedaldi , Natalia Neverova , Oran Gafni

Recent advances in text-to-3D scene generation have demonstrated significant potential to transform content creation across multiple industries. Although the research community has made impressive progress in addressing the challenges of…

Building on the success of diffusion models in visual generation, flow-based models reemerge as another prominent family of generative models that have achieved competitive or better performance in terms of both visual quality and inference…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Wenliang Zhao , Minglei Shi , Xumin Yu , Jie Zhou , Jiwen Lu

We present 3DScenePrompt, a framework that generates the next video chunk from arbitrary-length input while enabling precise camera control and preserving scene consistency. Unlike methods conditioned on a single image or a short clip, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 JoungBin Lee , Jaewoo Jung , Jisang Han , Takuya Narihira , Kazumi Fukuda , Junyoung Seo , Sunghwan Hong , Yuki Mitsufuji , Seungryong Kim

Generating high-quality textures for 3D scenes is crucial for applications in interior design, gaming, and augmented/virtual reality (AR/VR). Although recent advancements in 3D generative models have enhanced content creation, significant…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Yunfan Zhang , Zhiwei Xiong , Zhiqi Shen , Guosheng Lin , Hao Wang , Nicolas Vun

Current motion-conditioned video generation methods suffer from prohibitive latency (minutes per video) and non-causal processing that prevents real-time interaction. We present MotionStream, enabling sub-second latency with up to 29 FPS…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Joonghyuk Shin , Zhengqi Li , Richard Zhang , Jun-Yan Zhu , Jaesik Park , Eli Shechtman , Xun Huang

We present a latent diffusion model over 3D scenes, that can be trained using only 2D image data. To achieve this, we first design an autoencoder that maps multi-view images to 3D Gaussian splats, and simultaneously builds a compressed…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Paul Henderson , Melonie de Almeida , Daniela Ivanova , Titas Anciukevičius

Text-driven 3D scene generation has seen significant advancements recently. However, most existing methods generate single-view images using generative models and then stitch them together in 3D space. This independent generation for each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Wenrui Li , Fucheng Cai , Yapeng Mi , Zhe Yang , Wangmeng Zuo , Xingtao Wang , Xiaopeng Fan

We introduce a recipe for generating immersive 3D worlds from a single image by framing the task as an in-context learning problem for 2D inpainting models. This approach requires minimal training and uses existing generative models. Our…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Katja Schwarz , Denys Rozumnyi , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder

Advances in 3D reconstruction have enabled high-quality 3D capture, but require a user to collect hundreds to thousands of images to create a 3D scene. We present CAT3D, a method for creating anything in 3D by simulating this real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Ruiqi Gao , Aleksander Holynski , Philipp Henzler , Arthur Brussee , Ricardo Martin-Brualla , Pratul Srinivasan , Jonathan T. Barron , Ben Poole

We present InstantMesh, a feed-forward framework for instant 3D mesh generation from a single image, featuring state-of-the-art generation quality and significant training scalability. By synergizing the strengths of an off-the-shelf…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jiale Xu , Weihao Cheng , Yiming Gao , Xintao Wang , Shenghua Gao , Ying Shan

Open-vocabulary 3D scene understanding enables users to segment novel objects in complex 3D environments through natural language. However, existing approaches remain slow, memory-intensive, and overly complex due to iterative optimization…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Jaehun Bang , Jinhyeok Kim , Minji Kim , Seungheon Jeong , Kyungdon Joo

Single-view indoor scene generation plays a crucial role in a range of real-world applications. However, generating a complete 360{\deg} scene from a single image remains a highly ill-posed and challenging problem. Recent approaches have…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Runmao Yao , Junsheng Zhou , Zhen Dong , Yu-Shen Liu

Previous works leveraging video models for image-to-3D scene generation tend to suffer from geometric distortions and blurry content. In this paper, we renovate the pipeline of image-to-3D scene generation by unlocking the potential of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yuhao Wan , Lijuan Liu , Jingzhi Zhou , Zihan Zhou , Xuying Zhang , Dongbo Zhang , Shaohui Jiao , Qibin Hou , Ming-Ming Cheng

Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shengqu Cai , Duygu Ceylan , Matheus Gadelha , Chun-Hao Paul Huang , Tuanfeng Yang Wang , Gordon Wetzstein

Despite the latest remarkable advances in generative modeling, efficient generation of high-quality 3D assets from textual prompts remains a difficult task. A key challenge lies in data scarcity: the most extensive 3D datasets encompass…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Antoine Mercier , Ramin Nakhli , Mahesh Reddy , Rajeev Yasarla , Hong Cai , Fatih Porikli , Guillaume Berger

Automatic 3D generation has recently attracted widespread attention. Recent methods have greatly accelerated the generation speed, but usually produce less-detailed objects due to limited model capacity or 3D data. Motivated by recent…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Zilong Chen , Yikai Wang , Feng Wang , Zhengyi Wang , Huaping Liu

Synthetic 3D scenes are essential for developing Physical AI and generative models. Existing procedural generation methods often have low output throughput, creating a significant bottleneck in scaling up dataset creation. In this work, we…

Robotics · Computer Science 2025-12-19 Jinghuan Shang , Harsh Patel , Ran Gong , Karl Schmeckpeper

Current video generation models cannot simulate physical consequences of 3D actions like forces and robotic manipulations, as they lack structural understanding of how actions affect 3D scenes. We present RealWonder, the first real-time…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Wei Liu , Ziyu Chen , Zizhang Li , Yue Wang , Hong-Xing Yu , Jiajun Wu

3D scene generation is a core technology for gaming, film/VFX, and VR/AR. Growing demand for rapid iteration, high-fidelity detail, and accessible content creation has further increased interest in this area. Existing methods broadly follow…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Haozhi Zhu , Miaomiao Zhao , Dingyao Liu , Runze Tian , Yan Zhang , Jie Guo , Fenggen Yu