English
Related papers

Related papers: From Part to Whole: 3D Generative World Model with…

200 papers

Significant strides have been made toward designing better generative models in recent years. Despite this progress, however, state-of-the-art approaches are still largely unable to capture complex global structure in data. For example,…

Machine Learning · Computer Science 2019-01-25 Halley Young , Osbert Bastani , Mayur Naik

3D vision systems are fundamentally constrained by their reliance on visual overlap: reconstruction methods require it for geometric alignment, while generative models use it to enforce multi-view consistency. This limitation is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Grzegorz Wilczynski , Mikołaj Zielinski , Bartosz Świrta , Dominik Belter , Przemysław Spurek

As several industries are moving towards modeling massive 3D virtual worlds, the need for content creation tools that can scale in terms of the quantity, quality, and diversity of 3D content is becoming evident. In our work, we aim to train…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Jun Gao , Tianchang Shen , Zian Wang , Wenzheng Chen , Kangxue Yin , Daiqing Li , Or Litany , Zan Gojcic , Sanja Fidler

We introduce a novel neural network architecture for encoding and synthesis of 3D shapes, particularly their structures. Our key insight is that 3D shapes are effectively characterized by their hierarchical organization of parts, which…

Graphics · Computer Science 2017-05-16 Jun Li , Kai Xu , Siddhartha Chaudhuri , Ersin Yumer , Hao Zhang , Leonidas Guibas

3D assets are essential in the digital age. While automatic 3D generation, such as image-to-3d, has made significant strides in recent years, it often struggles to achieve fast, detailed, and high-fidelity generation simultaneously. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Huanning Dong , Yinuo Huang , Fan Li , Ping Kuang

Most existing 3D assembly methods treat the problem as pure pose estimation, rearranging observed parts via rigid transformations. In contrast, human assembly naturally couples structural reasoning with holistic shape inference. Inspired by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zeyu Jiang , Sihang Li , Siqi Tan , Chenyang Xu , Juexiao Zhang , Julia Galway-Witham , Xue Wang , Scott A. Williams , Radu Iovita , Chen Feng , Jing Zhang

Generative models for 3D shapes represented by hierarchies of parts can generate realistic and diverse sets of outputs. However, existing models suffer from the key practical limitation of modelling shapes holistically and thus cannot…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Dominic Roberts , Ara Danielyan , Hang Chu , Mani Golparvar-Fard , David Forsyth

Object-centric representations promise a key property for few-shot learning: Rather than treating a scene as a single unit, a model can decompose it into individual object-level parts that can be matched and compared across different…

Machine Learning · Computer Science 2026-05-19 Phu-Quy Nguyen-Lam , Phu-Hoa Pham , Dao Sy Duy Minh , Chi-Nguyen Tran , Huynh Trung Kiet , Long Tran-Thanh

In the early design stage of Japanese detached houses, the lack of a unified design representation among clients, sales representatives, and designers leads to design drift and inefficient feedback. Usually, sketches handed off by sales…

Graphics · Computer Science 2026-03-18 Zhengyang Wang , Nuttapong Rochanavibhata , Yuxiao Ren , Xusheng Du , Ye Zhang , Haoran Xie

Representing 3D shape is a fundamental problem in artificial intelligence, which has numerous applications within computer vision and graphics. One avenue that has recently begun to be explored is the use of latent representations of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tristan Aumentado-Armstrong , Stavros Tsogkas , Allan Jepson , Sven Dickinson

Deep generative models have been recently extended to synthesizing 3D digital humans. However, previous approaches treat clothed humans as a single chunk of geometry without considering the compositionality of clothing and accessories. As a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Taeksoo Kim , Shunsuke Saito , Hanbyul Joo

3D object detection has been widely studied due to its potential applicability to many promising areas such as robotics and augmented reality. Yet, the sparse nature of the 3D data poses unique challenges to this task. Most notably, the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 JunYoung Gwak , Christopher Choy , Silvio Savarese

We propose the Variational Shape Learner (VSL), a generative model that learns the underlying structure of voxelized 3D shapes in an unsupervised fashion. Through the use of skip-connections, our model can successfully learn and infer a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Shikun Liu , C. Lee Giles , Alexander G. Ororbia

One image to editable dynamic 3D model and video generation is novel direction and change in the research area of single image to 3D representation or 3D reconstruction of image. Gaussian Splatting has demonstrated its advantages in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Jinwei Lin

This paper introduces a 3D shape generative model based on deep neural networks. A new image-like (i.e., tensor) data representation for genus-zero 3D shapes is devised. It is based on the observation that complicated shapes can be well…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Heli Ben-Hamu , Haggai Maron , Itay Kezurer , Gal Avineri , Yaron Lipman

Despite recent advancements in neural 3D reconstruction, the dependence on dense multi-view captures restricts their broader applicability. Additionally, 3D scene generation is vital for advancing embodied AI and world models, which depend…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yuxin Zhang , Ziyu Lu , Hongbo Duan , Keyu Fan , Pengting Luo , Peiyu Zhuang , Mengyu Yang , Houde Liu

The accelerating advancement of generative models has introduced new challenges for detecting AI-generated images, especially in real-world scenarios where novel generation techniques emerge rapidly. Existing learning paradigms are likely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Qinghui He , Haifeng Zhang , Xiuli Bi , Bo Liu , Chi-Man Pun , Bin Xiao

Conventional methods of 3D object generative modeling learn volumetric predictions using deep networks with 3D convolutional operations, which are direct analogies to classical 2D ones. However, these methods are computationally wasteful in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Chen-Hsuan Lin , Chen Kong , Simon Lucey

Autonomous part assembly is a challenging yet crucial task in 3D computer vision and robotics. Analogous to buying an IKEA furniture, given a set of 3D parts that can assemble a single shape, an intelligent agent needs to perceive the 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Jialei Huang , Guanqi Zhan , Qingnan Fan , Kaichun Mo , Lin Shao , Baoquan Chen , Leonidas Guibas , Hao Dong

Generative models aim to learn the distribution of observed data by generating new instances. With the advent of neural networks, deep generative models, including variational autoencoders (VAEs), generative adversarial networks (GANs), and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zifan Shi , Sida Peng , Yinghao Xu , Andreas Geiger , Yiyi Liao , Yujun Shen