中文
相关论文

相关论文: SynCity: Training-Free Generation of 3D Worlds

200 篇论文

Despite increasingly realistic image quality, recent 3D image generative models often operate on 3D volumes of fixed extent with limited camera motions. We investigate the task of unconditionally synthesizing unbounded nature scenes,…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Lucy Chai , Richard Tucker , Zhengqi Li , Phillip Isola , Noah Snavely

We present GuidedSceneGen, a text-to-3D generation framework that produces metrically accurate, globally consistent, and semantically interpretable indoor scenes. Unlike prior text-driven methods that often suffer from geometric drift or…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Stefan Ainetter , Thomas Deixelberger , Edoardo A. Dominici , Philipp Drescher , Konstantinos Vardis , Markus Steinberger

3D world generation is essential for applications such as immersive content creation or autonomous driving simulation. Recent advances in 3D world generation have shown promising results; however, these methods are constrained by grid…

计算机视觉与模式识别 · 计算机科学 2026-05-04 Jaeyoung Chung , Suyoung Lee , Jianfeng Xiang , Jiaolong Yang , Kyoung Mu Lee

We propose a systematic learning-based approach to the generation of massive quantities of synthetic 3D scenes and arbitrary numbers of photorealistic 2D images thereof, with associated ground truth information, for the purposes of…

计算机视觉与模式识别 · 计算机科学 2018-06-21 Chenfanfu Jiang , Siyuan Qi , Yixin Zhu , Siyuan Huang , Jenny Lin , Lap-Fai Yu , Demetri Terzopoulos , Song-Chun Zhu

The automated generation of interactive 3D cities is a critical challenge with broad applications in autonomous driving, virtual reality, and embodied intelligence. While recent advances in generative models and procedural techniques have…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Zishan Liu , Zecong Tang , RuoCheng Wu , Xinzhe Zheng , Jingyu Hu , Ka-Hei Hui , Haoran Xie , Bo Dai , Zhengzhe Liu

Unbounded 3D world generation is emerging as a foundational task for scene modeling in computer vision, graphics, and robotics. In this work, we present WorldFlow3D, a novel method capable of generating unbounded 3D worlds. Building upon a…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Amogh Joshi , Julian Ost , Felix Heide

We introduce 3inGAN, an unconditional 3D generative model trained from 2D images of a single self-similar 3D scene. Such a model can be used to produce 3D "remixes" of a given scene, by mapping spatial latent codes into a 3D volumetric…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Animesh Karnewar , Oliver Wang , Tobias Ritschel , Niloy Mitra

We propose FlashWorld, a generative model that produces 3D scenes from a single image or text prompt in seconds, 10~100$\times$ faster than previous works while possessing superior rendering quality. Our approach shifts from the…

计算机视觉与模式识别 · 计算机科学 2025-10-16 Xinyang Li , Tengfei Wang , Zixiao Gu , Shengchuan Zhang , Chunchao Guo , Liujuan Cao

3D city generation is a desirable yet challenging task, since humans are more sensitive to structural distortions in urban environments. Additionally, generating 3D cities is more complex than 3D natural scenes since buildings, as objects…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Single image view synthesis allows for the generation of new views of a scene given a single input image. This is challenging, as it requires comprehensively understanding the 3D scene from a single image. As a result, current methods…

计算机视觉与模式识别 · 计算机科学 2020-04-21 Olivia Wiles , Georgia Gkioxari , Richard Szeliski , Justin Johnson

3D scene generation has garnered growing attention in recent years and has made significant progress. Generating 4D cities is more challenging than 3D scenes due to the presence of structurally complex, visually diverse objects like…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Recent advances in generative modeling have substantially enhanced 3D urban generation, enabling applications in digital twins, virtual cities, and large-scale simulations. However, existing methods face two key challenges: (1) the need for…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Yijie Kang , Xinliang Wang , Zhenyu Wu , Yifeng Shi , Hailong Zhu

City scene generation has gained significant attention in autonomous driving, smart city development, and traffic simulation. It helps enhance infrastructure planning and monitoring solutions. Existing methods have employed a two-stage…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Jie Deng , Wenhao Chai , Junsheng Huang , Zhonghan Zhao , Qixuan Huang , Mingyan Gao , Jianshu Guo , Shengyu Hao , Wenhao Hu , Jenq-Neng Hwang , Xi Li , Gaoang Wang

In this work, we present SceneDreamer, an unconditional generative model for unbounded 3D scenes, which synthesizes large-scale 3D landscapes from random noise. Our framework is learned from in-the-wild 2D image collections only, without…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Zhaoxi Chen , Guangcong Wang , Ziwei Liu

Cities, as the essential environment of human life, encompass diverse physical elements such as buildings, roads and vegetation, which continuously interact with dynamic entities like people and vehicles. Crafting realistic, interactive 3D…

计算机视觉与模式识别 · 计算机科学 2024-10-23 Yu Shang , Yuming Lin , Yu Zheng , Hangyu Fan , Jingtao Ding , Jie Feng , Jiansheng Chen , Li Tian , Yong Li

Urban modeling is essential for city planning, scene synthesis, and gaming. Existing image-based methods generate diverse layouts but often lack geometric continuity and scalability, while graph-based methods capture structural relations…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Mengyuan Niu , Xinxin Zhuo , Ruizhe Wang , Yuyue Huang , Junyan Yang , Qiao Wang

The ability to automatically generate large-scale, interactive, and physically realistic 3D environments is crucial for advancing robotic learning and embodied intelligence. However, existing generative approaches often fail to capture the…

计算机视觉与模式识别 · 计算机科学 2026-01-19 ChunTeng Chen , YiChen Hsu , YiWen Liu , WeiFang Sun , TsaiChing Ni , ChunYi Lee , Min Sun , YuanFu Yang

In this work, we introduce CC3D, a conditional generative model that synthesizes complex 3D scenes conditioned on 2D semantic scene layouts, trained using single-view images. Different from most existing 3D GANs that limit their…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Xingguang Yan , Gordon Wetzstein , Leonidas Guibas , Andrea Tagliasacchi

We present Free4D, a novel tuning-free framework for 4D scene generation from a single image. Existing methods either focus on object-level generation, making scene-level generation infeasible, or rely on large-scale multi-view video…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Tianqi Liu , Zihao Huang , Zhaoxi Chen , Guangcong Wang , Shoukang Hu , Liao Shen , Huiqiang Sun , Zhiguo Cao , Wei Li , Ziwei Liu

The strong performance of large vision-language models (VLMs) trained with reinforcement learning (RL) has motivated similar approaches for fine-tuning vision-language-action (VLA) models in robotics. Many recent works fine-tune VLAs…

机器人学 · 计算机科学 2026-03-31 Andrew Choi , Xinjie Wang , Zhizhong Su , Wei Xu