English
Related papers

Related papers: Generative VoxelNet: Learning Energy-Based Models …

200 papers

We study the problem of 3D object generation. We propose a novel framework, namely 3D Generative Adversarial Network (3D-GAN), which generates 3D objects from a probabilistic space by leveraging recent advances in volumetric convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-01-05 Jiajun Wu , Chengkai Zhang , Tianfan Xue , William T. Freeman , Joshua B. Tenenbaum

We introduce a method for learning to generate the surface of 3D shapes. Our approach represents a 3D shape as a collection of parametric surface elements and, in contrast to methods generating voxel grids or point clouds, naturally infers…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Thibault Groueix , Matthew Fisher , Vladimir G. Kim , Bryan C. Russell , Mathieu Aubry

Deep generative models of 3D shapes have received a great deal of research interest. Yet, almost all of them generate discrete shape representations, such as voxels, point clouds, and polygon meshes. We present the first 3D generative model…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Rundi Wu , Chang Xiao , Changxi Zheng

We propose a new procedure to guide training of a data-driven shape generative model using a structure-aware loss function. Complex 3D shapes often can be summarized using a coarsely defined structure which is consistent and robust across…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Elena Balashova , Vivek Singh , Jiangping Wang , Brian Teixeira , Terrence Chen , Thomas Funkhouser

Data-driven generative 3D face models are used to compactly encode facial shape data into meaningful parametric representations. A desirable property of these models is their ability to effectively decouple natural sources of variation, in…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Victoria Fernandez Abrevaya , Adnane Boukhayma , Stefanie Wuhrer , Edmond Boyer

3D open-world classification is a challenging yet essential task in dynamic and unstructured real-world scenarios, requiring both open-category and open-pose recognition. To address these challenges, recent wisdom often takes sophisticated…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Xinzhe Xia , Weiguang Zhao , Yuyao Yan , Guanyu Yang , Rui Zhang , Kaizhu Huang , Xi Yang

Significant progress has recently been made in creative applications of large pre-trained models for downstream tasks in 3D vision, such as text-to-shape generation. This motivates our investigation of how these pre-trained models can be…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Aditya Sanghi , Pradeep Kumar Jayaraman , Arianna Rampini , Joseph Lambourne , Hooman Shayani , Evan Atherton , Saeid Asgari Taghanaki

We investigate the problem of training generative models on a very sparse collection of 3D models. We use geometrically motivated energies to augment and thus boost a sparse collection of example (training) models. We analyze the Hessian of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Sanjeev Muralikrishnan , Siddhartha Chaudhuri , Noam Aigerman , Vladimir Kim , Matthew Fisher , Niloy Mitra

Deep generative models have shown success in generating 3D shapes with different representations. In this work, we propose Neural Volumetric Mesh Generator(NVMG) which can generate novel and high-quality volumetric meshes. Unlike the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Yan Zheng , Lemeng Wu , Xingchao Liu , Zhen Chen , Qiang Liu , Qixing Huang

Generative modeling of 3D shapes has become an important problem due to its relevance to many applications across Computer Vision, Graphics, and VR. In this paper we build upon recently introduced 3D mesh-convolutional Variational…

Machine Learning · Computer Science 2019-06-11 Jake Levinson , Avneesh Sud , Ameesh Makadia

A main challenge in mechanical design is to efficiently explore the design space while satisfying engineering constraints. This work explores the use of 3D generative models to explore the design space in the context of vehicle development,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Hayata Morita , Kohei Shintani , Chenyang Yuan , Frank Permenter

3D generative modeling is accelerating as the technology allowing the capture of geometric data is developing. However, the acquired data is often inconsistent, resulting in unregistered meshes or point clouds. Many generative learning…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Thomas Besnier , Sylvain Arguillère , Emery Pierson , Mohamed Daoudi

Video sequences contain rich dynamic patterns, such as dynamic texture patterns that exhibit stationarity in the temporal domain, and action patterns that are non-stationary in either spatial or temporal domain. We show that an energy-based…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Jianwen Xie , Song-Chun Zhu , Ying Nian Wu

We consider the task of generating realistic 3D shapes, which is useful for a variety of applications such as automatic scene generation and physical simulation. Compared to other 3D representations like voxels and point clouds, meshes are…

Graphics · Computer Science 2023-04-18 Zhen Liu , Yao Feng , Michael J. Black , Derek Nowrouzezahrai , Liam Paull , Weiyang Liu

Synthetic images rendered by graphics engines are a promising source for training deep networks. However, it is challenging to ensure that they can help train a network to perform well on real images, because a graphics-based generation…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Dawei Yang , Jia Deng

Polygon meshes are an efficient representation of 3D geometry, and are of central importance in computer graphics, robotics and games development. Existing learning-based approaches have avoided the challenges of working with 3D meshes,…

Graphics · Computer Science 2020-02-26 Charlie Nash , Yaroslav Ganin , S. M. Ali Eslami , Peter W. Battaglia

Existing generative models for 3D shapes can synthesize high-fidelity and visually plausible shapes. For certain classes of shapes that have undergone an engineering design process, the realism of the shape is tightly coupled with the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yingxuan You , Chen Zhao , Hantao Zhang , Ming Xu , Pascal Fua

The reconstruction of 3D microstructures from 2D slices is considered to hold significant value in predicting the spatial structure and physical properties of materials.The dimensional extension from 2D to 3D is viewed as a highly…

Machine Learning · Computer Science 2024-02-27 Yilin Zheng , Zhigong Song

3D shape models are naturally parameterized using vertices and faces, \ie, composed of polygons forming a surface. However, current 3D learning paradigms for predictive and generative tasks using convolutional neural networks focus on a…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Ayan Sinha , Asim Unmesh , Qixing Huang , Karthik Ramani

Directly learning to model 4D content, including shape, color, and motion, is challenging. Existing methods rely on pose priors for motion control, resulting in limited motion diversity and continuity in details. To address this, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Qitong Yang , Mingtao Feng , Zijie Wu , Shijie Sun , Weisheng Dong , Yaonan Wang , Ajmal Mian