English
Related papers

Related papers: Learning to Infer and Execute 3D Shape Programs

200 papers

The goal of this paper is to learn dense 3D shape correspondence for topology-varying objects in an unsupervised manner. Conventional implicit functions estimate the occupancy of a 3D point given a shape latent code. Instead, our novel…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Feng Liu , Xiaoming Liu

We propose a novel technique for producing high-quality 3D models that match a given target object image or scan. Our method is based on retrieving an existing shape from a database of 3D models and then deforming its parts to match the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Mikaela Angelina Uy , Vladimir G. Kim , Minhyuk Sung , Noam Aigerman , Siddhartha Chaudhuri , Leonidas Guibas

We propose a data-driven method for recovering miss-ing parts of 3D shapes. Our method is based on a new deep learning architecture consisting of two sub-networks: a global structure inference network and a local geometry refinement…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Xiaoguang Han , Zhen Li , Haibin Huang , Evangelos Kalogerakis , Yizhou Yu

We introduce a novel neural network architecture for encoding and synthesis of 3D shapes, particularly their structures. Our key insight is that 3D shapes are effectively characterized by their hierarchical organization of parts, which…

Graphics · Computer Science 2017-05-16 Jun Li , Kai Xu , Siddhartha Chaudhuri , Ersin Yumer , Hao Zhang , Leonidas Guibas

Humans rely on their visual and tactile senses to develop a comprehensive 3D understanding of their physical environment. Recently, there has been a growing interest in exploring and manipulating objects using data-driven approaches that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Mauro Comi , Yijiong Lin , Alex Church , Alessio Tonioni , Laurence Aitchison , Nathan F. Lepora

The objective of this paper is to learn dense 3D shape correspondence for topology-varying generic objects in an unsupervised manner. Conventional implicit functions estimate the occupancy of a 3D point given a shape latent code. Instead,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Feng Liu , Xiaoming Liu

Recent progress in human shape learning, shows that neural implicit models are effective in generating 3D human surfaces from limited number of views, and even from a single RGB image. However, existing monocular approaches still struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Marco Pesavento , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Ziyan Wang , Chun-Han Yao , Marco Volino , Edmond Boyer , Adrian Hilton , Tony Tung

We present a neural architecture that takes as input a 2D or 3D shape and outputs a program that generates the shape. The instructions in our program are based on constructive solid geometry principles, i.e., a set of boolean operations on…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Gopal Sharma , Rishabh Goyal , Difan Liu , Evangelos Kalogerakis , Subhransu Maji

When interacting in a three dimensional world, humans must estimate 3D structure from visual inputs projected down to two dimensional retinal images. It has been shown that humans use the persistence of object shape over motion-induced…

Neurons and Cognition · Quantitative Biology 2023-04-03 Marissa Connor , Bruno Olshausen , Christopher Rozell

Learning 3D shape representation with dense correspondence for deformable objects is a fundamental problem in computer vision. Existing approaches often need additional annotations of specific semantic domain, e.g., skeleton poses for human…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Baowen Zhang , Jiahe Li , Xiaoming Deng , Yinda Zhang , Cuixia Ma , Hongan Wang

We present Neural Kernel Fields: a novel method for reconstructing implicit 3D shapes based on a learned kernel ridge regression. Our technique achieves state-of-the-art results when reconstructing 3D objects and large scenes from sparse…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Francis Williams , Zan Gojcic , Sameh Khamis , Denis Zorin , Joan Bruna , Sanja Fidler , Or Litany

We present 3DP3, a framework for inverse graphics that uses inference in a structured generative model of objects, scenes, and images. 3DP3 uses (i) voxel models to represent the 3D shape of objects, (ii) hierarchical scene graphs to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Nishad Gothoskar , Marco Cusumano-Towner , Ben Zinberg , Matin Ghavamizadeh , Falk Pollok , Austin Garrett , Joshua B. Tenenbaum , Dan Gutfreund , Vikash K. Mansinghka

Human bodies exhibit various shapes for different identities or poses, but the body shape has certain similarities in structure and thus can be embedded in a low-dimensional space. This paper presents an autoencoder-like network…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Boyi Jiang , Juyong Zhang , Jianfei Cai , Jianmin Zheng

Neural implicit representation has attracted attention in 3D reconstruction through various success cases. For further applications such as scene understanding or editing, several works have shown progress towards object compositional…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Taekbeom Lee , Youngseok Jang , H. Jin Kim

Reconstructing high-quality 3D objects from sparse, partial observations from a single view is of crucial importance for various applications in computer vision, robotics, and graphics. While recent neural implicit modeling methods show…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Shivam Duggal , Zihao Wang , Wei-Chiu Ma , Sivabalan Manivasagam , Justin Liang , Shenlong Wang , Raquel Urtasun

We propose PyTorchGeoNodes, a differentiable module for reconstructing 3D objects and their parameters from images using interpretable shape programs. Unlike traditional CAD model retrieval, shape programs allow reasoning about semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Sinisa Stekovic , Arslan Artykov , Stefan Ainetter , Mattia D'Urso , Friedrich Fraundorfer

Current methods for 3D object reconstruction from a set of planar cross-sections still struggle to capture detailed topology or require a considerable number of cross-sections. In this paper, we present, to the best of our knowledge the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Azimkhon Ostonov

Parametric 3D models have enabled a wide variety of tasks in computer graphics and vision, such as modeling human bodies, faces, and hands. However, the construction of these parametric models is often tedious, as it requires heavy manual…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Pablo Palafox , Aljaž Božič , Justus Thies , Matthias Nießner , Angela Dai

High-quality 3D reconstruction of pulmonary segments plays a crucial role in segmentectomy and surgical planning for the treatment of lung cancer. Due to the resolution requirement of the target reconstruction, conventional deep…

Graphics · Computer Science 2025-12-16 Kangxian Xie , Yufei Zhu , Kaiming Kuang , Li Zhang , Hongwei Bran Li , Mingchen Gao , Jiancheng Yang

We present a simple yet effective general-purpose framework for modeling 3D shapes by leveraging recent advances in 2D image generation using CNNs. Using just a single depth image of the object, we can output a dense multi-view depth map…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Kamal Gupta , Susmija Jabbireddy , Ketul Shah , Abhinav Shrivastava , Matthias Zwicker