中文
相关论文

相关论文: From Part to Whole: 3D Generative World Model with…

200 篇论文

We tackle the challenge of generating the infinitely extendable 3D world -- large, continuous environments with coherent geometry and realistic appearance. Existing methods face key challenges: 2D-lifting approaches suffer from geometric…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Sikuang Li , Chen Yang , Jiemin Fang , Taoran Yi , Jia Lu , Jiazhong Cen , Lingxi Xie , Wei Shen , Qi Tian

Segmenting 3D objects into parts is a long-standing challenge in computer vision. To overcome taxonomy constraints and generalize to unseen 3D objects, recent works turn to open-world part segmentation. These approaches typically transfer…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Zhe Zhu , Le Wan , Rui Xu , Yiheng Zhang , Honghua Chen , Zhiyang Dou , Cheng Lin , Yuan Liu , Mingqiang Wei

In this paper, we propose Extend3D, a training-free pipeline for 3D scene generation from a single image, built upon an object-centric 3D generative model. To overcome the limitations of fixed-size latent spaces in object-centric models for…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Seungwoo Yoon , Jinmo Kim , Jaesik Park

Accurately reconstructing complex full multi-object scenes from sparse observations remains a core challenge in computer vision and a key step toward scalable and reliable simulation for robotics. In this work, we introduce RecGen, a…

Generative modeling of 3D shapes has become an important problem due to its relevance to many applications across Computer Vision, Graphics, and VR. In this paper we build upon recently introduced 3D mesh-convolutional Variational…

机器学习 · 计算机科学 2019-06-11 Jake Levinson , Avneesh Sud , Ameesh Makadia

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, most existing approaches…

计算机视觉与模式识别 · 计算机科学 2019-08-28 Paul Henderson , Vittorio Ferrari

We present a method to learn the 3D surface of objects directly from a collection of images. Previous work achieved this capability by exploiting additional manual annotation, such as object pose, 3D surface templates, temporal continuity…

计算机视觉与模式识别 · 计算机科学 2018-11-28 Attila Szabó , Paolo Favaro

Generative Adversarial Networks (GANs) have emerged as a significant player in generative modeling by mapping lower-dimensional random noise to higher-dimensional spaces. These networks have been used to generate high-resolution images and…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Satya Pratheek Tata , Subhankar Mishra

Current generative frameworks use end-to-end learning and generate images by sampling from uniform noise distribution. However, these approaches ignore the most basic principle of image formation: images are product of: (a) Structure: the…

计算机视觉与模式识别 · 计算机科学 2016-07-27 Xiaolong Wang , Abhinav Gupta

Generative models have achieved success in producing semantically plausible 2D images, but it remains challenging in 3D generation due to the absence of spatial geometry constraints. Typically, existing methods utilize geometric features as…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Haonan Wang , Hanyu Zhou , Haoyue Liu , Tao Gu , Luxin Yan

With the remarkable recent progress on learning deep generative models, it becomes increasingly interesting to develop models for controllable image synthesis from reconfigurable inputs. This paper focuses on a recent emerged task,…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Wei Sun , Tianfu Wu

Generative models have proven effective at modeling 3D shapes and their statistical variations. In this paper we investigate their application to point clouds, a 3D shape representation widely used in computer vision for which, however,…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Roman Klokov , Edmond Boyer , Jakob Verbeek

In this paper, we propose a novel 3D-RecGAN approach, which reconstructs the complete 3D structure of a given object from a single arbitrary depth view using generative adversarial networks. Unlike the existing work which typically requires…

计算机视觉与模式识别 · 计算机科学 2017-08-29 Bo Yang , Hongkai Wen , Sen Wang , Ronald Clark , Andrew Markham , Niki Trigoni

Recent generative AI models have achieved remarkable breakthroughs in language and visual understanding. However, although these models can generate realistic visual content, their spatial scale remains confined to bounded environments,…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Jinqi Cao , Zhiping Yu , Baihong Lin , Chenyang Liu , Zhenwei Shi , Zhengxia Zou

3D asset generation plays a pivotal role in fields such as gaming and virtual reality, enabling the rapid synthesis of high-fidelity 3D objects from a single or multiple images. Building on this capability, enabling style-controllable…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Yiran Qiao , Yiren Lu , Yunlai Zhou , Disheng Liu , Linlin Hou , Rui Yang , Yu Yin , Jing Ma

Significant progress has recently been made in creative applications of large pre-trained models for downstream tasks in 3D vision, such as text-to-shape generation. This motivates our investigation of how these pre-trained models can be…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Aditya Sanghi , Pradeep Kumar Jayaraman , Arianna Rampini , Joseph Lambourne , Hooman Shayani , Evan Atherton , Saeid Asgari Taghanaki

We introduce a recipe for generating immersive 3D worlds from a single image by framing the task as an in-context learning problem for 2D inpainting models. This approach requires minimal training and uses existing generative models. Our…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Katja Schwarz , Denys Rozumnyi , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder

Recent advances in large models have significantly advanced image-to-3D reconstruction. However, the generated models are often fused into a single piece, limiting their applicability in downstream tasks. This paper focuses on 3D garment…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Xuan Li , Chang Yu , Wenxin Du , Ying Jiang , Tianyi Xie , Yunuo Chen , Yin Yang , Chenfanfu Jiang

Modeling the 3D world from sensor data for simulation is a scalable way of developing testing and validation environments for robotic learning problems such as autonomous driving. However, manually creating or re-creating real-world-like…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Bokui Shen , Xinchen Yan , Charles R. Qi , Mahyar Najibi , Boyang Deng , Leonidas Guibas , Yin Zhou , Dragomir Anguelov

Recent 3D human generative models have achieved remarkable progress by learning 3D-aware GANs from 2D images. However, existing 3D human generative methods model humans in a compact 1D latent space, ignoring the articulated structure and…

计算机视觉与模式识别 · 计算机科学 2024-07-03 Tao Hu , Fangzhou Hong , Ziwei Liu