中文
相关论文

相关论文: From Part to Whole: 3D Generative World Model with…

200 篇论文

Significant strides have been made toward designing better generative models in recent years. Despite this progress, however, state-of-the-art approaches are still largely unable to capture complex global structure in data. For example,…

机器学习 · 计算机科学 2019-01-25 Halley Young , Osbert Bastani , Mayur Naik

3D vision systems are fundamentally constrained by their reliance on visual overlap: reconstruction methods require it for geometric alignment, while generative models use it to enforce multi-view consistency. This limitation is…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Grzegorz Wilczynski , Mikołaj Zielinski , Bartosz Świrta , Dominik Belter , Przemysław Spurek

As several industries are moving towards modeling massive 3D virtual worlds, the need for content creation tools that can scale in terms of the quantity, quality, and diversity of 3D content is becoming evident. In our work, we aim to train…

计算机视觉与模式识别 · 计算机科学 2022-09-23 Jun Gao , Tianchang Shen , Zian Wang , Wenzheng Chen , Kangxue Yin , Daiqing Li , Or Litany , Zan Gojcic , Sanja Fidler

We introduce a novel neural network architecture for encoding and synthesis of 3D shapes, particularly their structures. Our key insight is that 3D shapes are effectively characterized by their hierarchical organization of parts, which…

图形学 · 计算机科学 2017-05-16 Jun Li , Kai Xu , Siddhartha Chaudhuri , Ersin Yumer , Hao Zhang , Leonidas Guibas

3D assets are essential in the digital age. While automatic 3D generation, such as image-to-3d, has made significant strides in recent years, it often struggles to achieve fast, detailed, and high-fidelity generation simultaneously. In this…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Huanning Dong , Yinuo Huang , Fan Li , Ping Kuang

Most existing 3D assembly methods treat the problem as pure pose estimation, rearranging observed parts via rigid transformations. In contrast, human assembly naturally couples structural reasoning with holistic shape inference. Inspired by…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Zeyu Jiang , Sihang Li , Siqi Tan , Chenyang Xu , Juexiao Zhang , Julia Galway-Witham , Xue Wang , Scott A. Williams , Radu Iovita , Chen Feng , Jing Zhang

Generative models for 3D shapes represented by hierarchies of parts can generate realistic and diverse sets of outputs. However, existing models suffer from the key practical limitation of modelling shapes holistically and thus cannot…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Dominic Roberts , Ara Danielyan , Hang Chu , Mani Golparvar-Fard , David Forsyth

Object-centric representations promise a key property for few-shot learning: Rather than treating a scene as a single unit, a model can decompose it into individual object-level parts that can be matched and compared across different…

In the early design stage of Japanese detached houses, the lack of a unified design representation among clients, sales representatives, and designers leads to design drift and inefficient feedback. Usually, sketches handed off by sales…

图形学 · 计算机科学 2026-03-18 Zhengyang Wang , Nuttapong Rochanavibhata , Yuxiao Ren , Xusheng Du , Ye Zhang , Haoran Xie

Representing 3D shape is a fundamental problem in artificial intelligence, which has numerous applications within computer vision and graphics. One avenue that has recently begun to be explored is the use of latent representations of…

计算机视觉与模式识别 · 计算机科学 2019-08-20 Tristan Aumentado-Armstrong , Stavros Tsogkas , Allan Jepson , Sven Dickinson

Deep generative models have been recently extended to synthesizing 3D digital humans. However, previous approaches treat clothed humans as a single chunk of geometry without considering the compositionality of clothing and accessories. As a…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Taeksoo Kim , Shunsuke Saito , Hanbyul Joo

3D object detection has been widely studied due to its potential applicability to many promising areas such as robotics and augmented reality. Yet, the sparse nature of the 3D data poses unique challenges to this task. Most notably, the…

计算机视觉与模式识别 · 计算机科学 2020-06-23 JunYoung Gwak , Christopher Choy , Silvio Savarese

We propose the Variational Shape Learner (VSL), a generative model that learns the underlying structure of voxelized 3D shapes in an unsupervised fashion. Through the use of skip-connections, our model can successfully learn and infer a…

计算机视觉与模式识别 · 计算机科学 2018-08-07 Shikun Liu , C. Lee Giles , Alexander G. Ororbia

One image to editable dynamic 3D model and video generation is novel direction and change in the research area of single image to 3D representation or 3D reconstruction of image. Gaussian Splatting has demonstrated its advantages in…

计算机视觉与模式识别 · 计算机科学 2024-05-13 Jinwei Lin

This paper introduces a 3D shape generative model based on deep neural networks. A new image-like (i.e., tensor) data representation for genus-zero 3D shapes is devised. It is based on the observation that complicated shapes can be well…

计算机视觉与模式识别 · 计算机科学 2019-03-05 Heli Ben-Hamu , Haggai Maron , Itay Kezurer , Gal Avineri , Yaron Lipman

Despite recent advancements in neural 3D reconstruction, the dependence on dense multi-view captures restricts their broader applicability. Additionally, 3D scene generation is vital for advancing embodied AI and world models, which depend…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Yuxin Zhang , Ziyu Lu , Hongbo Duan , Keyu Fan , Pengting Luo , Peiyu Zhuang , Mengyu Yang , Houde Liu

The accelerating advancement of generative models has introduced new challenges for detecting AI-generated images, especially in real-world scenarios where novel generation techniques emerge rapidly. Existing learning paradigms are likely…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Qinghui He , Haifeng Zhang , Xiuli Bi , Bo Liu , Chi-Man Pun , Bin Xiao

Conventional methods of 3D object generative modeling learn volumetric predictions using deep networks with 3D convolutional operations, which are direct analogies to classical 2D ones. However, these methods are computationally wasteful in…

计算机视觉与模式识别 · 计算机科学 2017-06-22 Chen-Hsuan Lin , Chen Kong , Simon Lucey

Autonomous part assembly is a challenging yet crucial task in 3D computer vision and robotics. Analogous to buying an IKEA furniture, given a set of 3D parts that can assemble a single shape, an intelligent agent needs to perceive the 3D…

计算机视觉与模式识别 · 计算机科学 2020-12-24 Jialei Huang , Guanqi Zhan , Qingnan Fan , Kaichun Mo , Lin Shao , Baoquan Chen , Leonidas Guibas , Hao Dong

Generative models aim to learn the distribution of observed data by generating new instances. With the advent of neural networks, deep generative models, including variational autoencoders (VAEs), generative adversarial networks (GANs), and…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Zifan Shi , Sida Peng , Yinghao Xu , Andreas Geiger , Yiyi Liao , Yujun Shen