English
Related papers

Related papers: Constructing a 3D Scene from a Single Image

200 papers

We introduce a novel, training-free system for reconstructing, understanding, and rendering 3D indoor scenes from a sparse set of unposed RGB images. Unlike traditional radiance field approaches that require dense views and per-scene…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jiatong Xia , Lingqiao Liu

We introduce \textit{WonderVerse}, a simple but effective framework for generating extendable 3D scenes. Unlike existing methods that rely on iterative depth estimation and image inpainting, often leading to geometric distortions and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Hao Feng , Zhi Zuo , Jia-Hui Pan , Ka-Hei Hui , Qi Dou , Jingyu Hu , Zhengzhe Liu

The task of generating natural images from 3D scenes has been a long standing goal in computer graphics. On the other hand, recent developments in deep neural networks allow for trainable models that can produce natural-looking images with…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Hassan Abu Alhaija , Siva Karthik Mustikovela , Andreas Geiger , Carsten Rother

3D assets are essential in the digital age. While automatic 3D generation, such as image-to-3d, has made significant strides in recent years, it often struggles to achieve fast, detailed, and high-fidelity generation simultaneously. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Huanning Dong , Yinuo Huang , Fan Li , Ping Kuang

Synthetic 3D scenes are essential for developing Physical AI and generative models. Existing procedural generation methods often have low output throughput, creating a significant bottleneck in scaling up dataset creation. In this work, we…

Robotics · Computer Science 2025-12-19 Jinghuan Shang , Harsh Patel , Ran Gong , Karl Schmeckpeper

The reconstruction of immersive and realistic 3D scenes holds significant practical importance in various fields of computer vision and computer graphics. Typically, immersive and realistic scenes should be free from obstructions by dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zilong Huang , Jun He , Junyan Ye , Lihan Jiang , Weijia Li , Yiping Chen , Ting Han

We introduce 3inGAN, an unconditional 3D generative model trained from 2D images of a single self-similar 3D scene. Such a model can be used to produce 3D "remixes" of a given scene, by mapping spatial latent codes into a 3D volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Animesh Karnewar , Oliver Wang , Tobias Ritschel , Niloy Mitra

Generating realistic 3D indoor scenes from user inputs remains a challenging problem in computer vision and graphics, requiring careful balance of geometric consistency, spatial relationships, and visual realism. While neural generation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Mengqi Zhou , Xipeng Wang , Yuxi Wang , Zhaoxiang Zhang

Synthesizing interactive 3D scenes from text is essential for gaming, virtual reality, and embodied AI. However, existing methods face several challenges. Learning-based approaches depend on small-scale indoor datasets, limiting the scene…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Lu Ling , Chen-Hsuan Lin , Tsung-Yi Lin , Yifan Ding , Yu Zeng , Yichen Sheng , Yunhao Ge , Ming-Yu Liu , Aniket Bera , Zhaoshuo Li

The synthesis of immersive 3D scenes from text is rapidly maturing, driven by novel video generative models and feed-forward 3D reconstruction, with vast potential in AR/VR and world modeling. While panoramic images have proven effective…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Felix Wimbauer , Fabian Manhardt , Michael Oechsle , Nikolai Kalischek , Christian Rupprecht , Daniel Cremers , Federico Tombari

We propose a decoupled 3D scene generation framework called SceneMaker in this work. Due to the lack of sufficient open-set de-occlusion and pose estimation priors, existing methods struggle to simultaneously produce high-quality geometry…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yukai Shi , Weiyu Li , Zihao Wang , Hongyang Li , Xingyu Chen , Ping Tan , Lei Zhang

Developing deep neural networks to generate 3D scenes is a fundamental problem in neural synthesis with immediate applications in architectural CAD, computer graphics, as well as in generating virtual robot training environments. This task…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Haitao Yang , Zaiwei Zhang , Siming Yan , Haibin Huang , Chongyang Ma , Yi Zheng , Chandrajit Bajaj , Qixing Huang

Synthesizing consistent and photorealistic 3D scenes is an open problem in computer vision. Video diffusion models generate impressive videos but cannot directly synthesize 3D representations, i.e., lack 3D consistency in the generated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Katja Schwarz , Norman Mueller , Peter Kontschieder

Unbounded 3D world generation is emerging as a foundational task for scene modeling in computer vision, graphics, and robotics. In this work, we present WorldFlow3D, a novel method capable of generating unbounded 3D worlds. Building upon a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Amogh Joshi , Julian Ost , Felix Heide

We introduce PAT3D, the first physics-augmented text-to-3D scene generation framework that integrates vision-language models with physics-based simulation to produce physically plausible, simulation-ready, and intersection-free 3D scenes.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Guying Lin , Kemeng Huang , Michael Liu , Ruihan Gao , Hanke Chen , Lyuhao Chen , Beijia Lu , Taku Komura , Yuan Liu , Jun-Yan Zhu , Minchen Li

We present Match-and-Fuse - a zero-shot, training-free method for consistent controlled generation of unstructured image sets - collections that share a common visual element, yet differ in viewpoint, time of capture, and surrounding…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Kate Feingold , Omri Kaduri , Tali Dekel

In this paper, we propose Scene Splatter, a momentum-based paradigm for video diffusion to generate generic scenes from single image. Existing methods, which employ video generation models to synthesize novel views, suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Shengjun Zhang , Jinzhao Li , Xin Fei , Hao Liu , Yueqi Duan

We present 3DScenePrompt, a framework that generates the next video chunk from arbitrary-length input while enabling precise camera control and preserving scene consistency. Unlike methods conditioned on a single image or a short clip, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 JoungBin Lee , Jaewoo Jung , Jisang Han , Takuya Narihira , Kazumi Fukuda , Junyoung Seo , Sunghwan Hong , Yuki Mitsufuji , Seungryong Kim

Recent conditional image synthesis approaches provide high-quality synthesized images. However, it is still challenging to accurately adjust image contents such as the positions and orientations of objects, and synthesized images often have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Jaebong Jeong , Janghun Jo , Jingdong Wang , Sunghyun Cho , Jaesik Park

The whole is greater than the sum of its parts-even in 3D-text contrastive learning. We introduce SceneForge, a novel framework that enhances contrastive alignment between 3D point clouds and text through structured multi-object scene…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Cristian Sbrolli , Matteo Matteucci