English
Related papers

Related papers: Patch-based 3D Natural Scene Generation from a Sin…

200 papers

Generating high-quality, textured 3D scenes from a single image remains a fundamental challenge in vision and graphics. Recent image-to-3D generators recover reasonable geometry from single views, but their object-centric training limits…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Kaizhi Zheng , Yue Fan , Jing Gu , Zishuo Xu , Xuehai He , Xin Eric Wang

Three-dimensional scene generation is crucial in computer vision, with applications spanning autonomous driving, gaming and the metaverse. Current methods either lack user control or rely on imprecise, non-intuitive conditions. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuheng Liu , Xinke Li , Yuning Zhang , Lu Qi , Xin Li , Wenping Wang , Chongshou Li , Xueting Li , Ming-Hsuan Yang

We present GuidedSceneGen, a text-to-3D generation framework that produces metrically accurate, globally consistent, and semantically interpretable indoor scenes. Unlike prior text-driven methods that often suffer from geometric drift or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Stefan Ainetter , Thomas Deixelberger , Edoardo A. Dominici , Philipp Drescher , Konstantinos Vardis , Markus Steinberger

We introduce SceneDiffuser, a conditional generative model for 3D scene understanding. SceneDiffuser provides a unified model for solving scene-conditioned generation, optimization, and planning. In contrast to prior works, SceneDiffuser is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Siyuan Huang , Zan Wang , Puhao Li , Baoxiong Jia , Tengyu Liu , Yixin Zhu , Wei Liang , Song-Chun Zhu

In this work, we present SceneDreamer, an unconditional generative model for unbounded 3D scenes, which synthesizes large-scale 3D landscapes from random noise. Our framework is learned from in-the-wild 2D image collections only, without…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Zhaoxi Chen , Guangcong Wang , Ziwei Liu

Recent advancements in 3D object generation using diffusion models have achieved remarkable success, but generating realistic 3D urban scenes remains challenging. Existing methods relying solely on 3D diffusion models tend to suffer a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Hanlei Guo , Jiahao Shao , Xinya Chen , Xiyang Tan , Sheng Miao , Yujun Shen , Yiyi Liao

We present 3DScenePrompt, a framework that generates the next video chunk from arbitrary-length input while enabling precise camera control and preserving scene consistency. Unlike methods conditioned on a single image or a short clip, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 JoungBin Lee , Jaewoo Jung , Jisang Han , Takuya Narihira , Kazumi Fukuda , Junyoung Seo , Sunghwan Hong , Yuki Mitsufuji , Seungryong Kim

Scene graphs (SGs) represent objects and their relationships as structured graphs, enabling applications in image generation, robotics, and 3D understanding. Recent work suggests that conditioning image generation on scene graphs improves…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rajalaxmi Rajagopalan , Romit Roy Choudhury

Although recent complex scene conditional generation models generate increasingly appealing scenes, it is very hard to assess which models perform better and why. This is often due to models being trained to fit different data splits, and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Arantxa Casanova , Michal Drozdzal , Adriana Romero-Soriano

Generating high-fidelity 3D indoor scenes remains a significant challenge due to data scarcity and the complexity of modeling intricate spatial relations. Current methods often struggle to scale beyond training distribution to dense scenes…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Xingjian Ran , Shujie Zhang , Weipeng Zhong , Li Luo , Bo Dai

Despite recent advancements in single-domain or single-object image generation, it is still challenging to generate complex scenes containing diverse, multiple objects and their interactions. Scene graphs, composed of nodes as objects and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Sarthak Garg , Helisa Dhamo , Azade Farshad , Sabrina Musatian , Nassir Navab , Federico Tombari

Generating 3D visual scenes is at the forefront of visual generative AI, but current 3D generation techniques struggle with generating scenes with multiple high-resolution objects. Here we introduce Lay-A-Scene, which solves the task of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Ohad Rahamim , Hilit Segev , Idan Achituve , Yuval Atzmon , Yoni Kasten , Gal Chechik

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

Generative models can be used to synthesize 3D objects of high quality and diversity. However, there is typically no control over the properties of the generated object.This paper proposes a novel generative adversarial network (GAN) setup…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Larissa T. Triess , Andre Bühler , David Peter , Fabian B. Flohr , J. Marius Zöllner

Standard approaches for adversarial patch generation lead to noisy conspicuous patterns, which are easily recognizable by humans. Recent research has proposed several approaches to generate naturalistic patches using generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Svetlana Pavlitskaya , Bianca-Marina Codău , J. Marius Zöllner

We present a suite of techniques for jointly optimizing triangle meshes and shading models to match the appearance of reference scenes. This capability has a number of uses, including appearance-preserving simplification of extremely…

Graphics · Computer Science 2021-04-12 Jon Hasselgren , Jacob Munkberg , Jaakko Lehtinen , Miika Aittala , Samuli Laine

We introduce SinGAN, an unconditional generative model that can be learned from a single natural image. Our model is trained to capture the internal distribution of patches within the image, and is then able to generate high quality,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Tamar Rott Shaham , Tali Dekel , Tomer Michaeli

We present GALA3D, generative 3D GAussians with LAyout-guided control, for effective compositional text-to-3D generation. We first utilize large language models (LLMs) to generate the initial layout and introduce a layout-guided 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xiaoyu Zhou , Xingjian Ran , Yajiao Xiong , Jinlin He , Zhiwei Lin , Yongtao Wang , Deqing Sun , Ming-Hsuan Yang

In this paper, we propose VideoFrom3D, a novel framework for synthesizing high-quality 3D scene videos from coarse geometry, a camera trajectory, and a reference image. Our approach streamlines the 3D graphic design workflow, enabling…

Graphics · Computer Science 2025-09-23 Geonung Kim , Janghyeok Han , Sunghyun Cho

Existing generative models for 3D shapes are typically trained on a large 3D dataset, often of a specific object category. In this paper, we investigate the deep generative model that learns from only a single reference 3D shape.…

Graphics · Computer Science 2022-12-19 Rundi Wu , Changxi Zheng