English
Related papers

Related papers: FullFormer: Generating Shapes Inside Shapes

200 papers

The advancement of generative radiance fields has pushed the boundary of 3D-aware image synthesis. Motivated by the observation that a 3D object should look realistic from multiple viewpoints, these methods introduce a multi-view constraint…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Xingang Pan , Xudong Xu , Chen Change Loy , Christian Theobalt , Bo Dai

We present a significant breakthrough in 3D shape generation by scaling it to unprecedented dimensions. Through the adaptation of the Auto-Regressive model and the utilization of large language models, we have developed a remarkable model…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yu Wang , Xuelin Qian , Jingyang Huo , Tiejun Huang , Bo Zhao , Yanwei Fu

This paper introduces a 3D shape generative model based on deep neural networks. A new image-like (i.e., tensor) data representation for genus-zero 3D shapes is devised. It is based on the observation that complicated shapes can be well…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Heli Ben-Hamu , Haggai Maron , Itay Kezurer , Gal Avineri , Yaron Lipman

Shape priors learned from data are commonly used to reconstruct 3D objects from partial or noisy data. Yet no such shape priors are available for indoor scenes, since typical 3D autoencoders cannot handle their scale, complexity, or…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Chiyu Max Jiang , Avneesh Sud , Ameesh Makadia , Jingwei Huang , Matthias Nießner , Thomas Funkhouser

We introduce 3DShape2VecSet, a novel shape representation for neural fields designed for generative diffusion models. Our shape representation can encode 3D shapes given as surface models or point clouds, and represents them as neural…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Biao Zhang , Jiapeng Tang , Matthias Niessner , Peter Wonka

Many robotic tasks involving some form of 3D visual perception greatly benefit from a complete knowledge of the working environment. However, robots often have to tackle unstructured environments and their onboard visual sensors can only…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Andrea Rosasco , Stefano Berti , Fabrizio Bottarel , Michele Colledanchise , Lorenzo Natale

With the capacity of modeling long-range dependencies in sequential data, transformers have shown remarkable performances in a variety of generative tasks such as image, audio, and text generation. Yet, taming them in generating less…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 An-Chieh Cheng , Xueting Li , Sifei Liu , Min Sun , Ming-Hsuan Yang

Conventional methods of 3D object generative modeling learn volumetric predictions using deep networks with 3D convolutional operations, which are direct analogies to classical 2D ones. However, these methods are computationally wasteful in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Chen-Hsuan Lin , Chen Kong , Simon Lucey

3D shape models are naturally parameterized using vertices and faces, \ie, composed of polygons forming a surface. However, current 3D learning paradigms for predictive and generative tasks using convolutional neural networks focus on a…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Ayan Sinha , Asim Unmesh , Qixing Huang , Karthik Ramani

Previous approaches to generate shapes in a 3D setting train a GAN on the latent space of an autoencoder (AE). Even though this produces convincing results, it has two major shortcomings. As the GAN is limited to reproduce the dataset the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Moritz Ibing , Isaak Lim , Leif Kobbelt

We present ShapeCrafter, a neural network for recursive text-conditioned 3D shape generation. Existing methods to generate text-conditioned 3D shapes consume an entire text prompt to generate a 3D shape in a single step. However, humans…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Rao Fu , Xiao Zhan , Yiwen Chen , Daniel Ritchie , Srinath Sridhar

We introduce GEM3D -- a new deep, topology-aware generative model of 3D shapes. The key ingredient of our method is a neural skeleton-based representation encoding information on both shape topology and geometry. Through a denoising…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Dmitry Petrov , Pradyumn Goyal , Vikas Thamizharasan , Vladimir G. Kim , Matheus Gadelha , Melinos Averkiou , Siddhartha Chaudhuri , Evangelos Kalogerakis

Dense point cloud generation from a sparse or incomplete point cloud is a crucial and challenging problem in 3D computer vision and computer graphics. So far, the existing methods are either computationally too expensive, suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Abol Basher , Jani Boutellier

The demand for efficient 3D model generation techniques has grown exponentially, as manual creation of 3D models is time-consuming and requires specialized expertise. While generative models have shown potential in creating 3D textured…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Fanghua Yu , Xintao Wang , Zheyuan Li , Yan-Pei Cao , Ying Shan , Chao Dong

Recent years have seen an explosion of work and interest in text-to-3D shape generation. Much of the progress is driven by advances in 3D representations, large-scale pretraining and representation learning for text and image data enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Han-Hung Lee , Manolis Savva , Angel X. Chang

Generative models have proven effective at modeling 3D shapes and their statistical variations. In this paper we investigate their application to point clouds, a 3D shape representation widely used in computer vision for which, however,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Roman Klokov , Edmond Boyer , Jakob Verbeek

Existing 3D surface representation approaches are unable to accurately classify pixels and their orientation lying on the boundary of an object. Thus resulting in coarse representations which usually require post-processing steps to extract…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Mateusz Michalkiewicz , Jhony K. Pontes , Dominic Jack , Mahsa Baktashmotlagh , Anders Eriksson

3D data that contains rich geometry information of objects and scenes is valuable for understanding 3D physical world. With the recent emergence of large-scale 3D datasets, it becomes increasingly crucial to have a powerful 3D generative…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Jianwen Xie , Zilong Zheng , Ruiqi Gao , Wenguan Wang , Song-Chun Zhu , Ying Nian Wu

We present a cascaded diffusion model based on a part-level implicit 3D representation. Our model achieves state-of-the-art generation quality and also enables part-level shape editing and manipulation without any additional training in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Juil Koo , Seungwoo Yoo , Minh Hieu Nguyen , Minhyuk Sung

We introduce a new generative model that combines latent diffusion with persistent homology to create 3D shapes with high diversity, with a special emphasis on their topological characteristics. Our method involves representing 3D shapes as…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jiangbei Hu , Ben Fei , Baixin Xu , Fei Hou , Weidong Yang , Shengfa Wang , Na Lei , Chen Qian , Ying He