English
Related papers

Related papers: Learning to Reconstruct Shapes from Unseen Classes

200 papers

We present a new approach to 3D object representation where a neural network encodes the geometry of an object directly into the weights and biases of a second 'mapping' network. This mapping network can be used to reconstruct an object by…

Machine Learning · Computer Science 2020-04-07 Eric Mitchell , Selim Engin , Volkan Isler , Daniel D Lee

We present a method for the accurate 3D reconstruction of partly-symmetric objects. We build on the strengths of recent advances in neural reconstruction and rendering such as Neural Radiance Fields (NeRF). A major shortcoming of such…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Eldar Insafutdinov , Dylan Campbell , João F. Henriques , Andrea Vedaldi

Transfer learning is fundamental for addressing problems in settings with little training data. While several transfer learning approaches have been proposed in 3D, unfortunately, these solutions typically operate on an entire 3D object or…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Souhaib Attaiki , Lei Li , Maks Ovsjanikov

State-of-the-art learning-based monocular 3D reconstruction methods learn priors over object categories on the training set, and as a result struggle to achieve reasonable generalization to object categories unseen during training. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Miguel Angel Bautista , Walter Talbott , Shuangfei Zhai , Nitish Srivastava , Joshua M Susskind

The field of self-supervised 3D representation learning has emerged as a promising solution to alleviate the challenge presented by the scarcity of extensive, well-annotated datasets. However, it continues to be hindered by the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yunsong Wang , Na Zhao , Gim Hee Lee

The 3D reconstruction of objects is a prerequisite for many highly relevant applications of computer vision such as mobile robotics or autonomous driving. To deal with the inverse problem of reconstructing 3D objects from their 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Max Coenen , Franz Rottensteiner

Partial-view 3D recognition -- reconstructing 3D geometry and identifying object instances from a few sparse RGB images -- is an exceptionally challenging yet practically essential task, particularly in cluttered, occluded real-world…

Robotics · Computer Science 2025-07-09 Young Hun Kim , Seungyeon Kim , Yonghyeon Lee , Frank Chongwoo Park

We present ANISE, a method that reconstructs a 3D~shape from partial observations (images or sparse point clouds) using a part-aware neural implicit shape representation. The shape is formulated as an assembly of neural implicit functions,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Dmitry Petrov , Matheus Gadelha , Radomir Mech , Evangelos Kalogerakis

We present a simple yet powerful neural network that implicitly represents and renders 3D objects and scenes only from 2D observations. The network models 3D geometries as a general radiance field, which takes a set of 2D images with camera…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Alex Trevithick , Bo Yang

This paper presents a fully automatic framework for extracting editable 3D objects directly from a single photograph. Unlike previous methods which recover either depth maps, point clouds, or mesh surfaces, we aim to recover 3D objects with…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Xin Chen , Yuwei Li , Xi Luo , Tianjia Shao , Jingyi Yu , Kun Zhou , Youyi Zheng

Object reconstruction from a single image -- in the wild -- is a problem where we can make progress and get meaningful results today. This is the main message of this paper, which introduces an automated pipeline with pixels as inputs and…

Computer Vision and Pattern Recognition · Computer Science 2015-05-08 Abhishek Kar , Shubham Tulsiani , João Carreira , Jitendra Malik

In this paper, we present a new perspective towards image-based shape generation. Most existing deep learning based shape reconstruction methods employ a single-view deterministic model which is sometimes insufficient to determine a single…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Yi Wei , Shaohui Liu , Wang Zhao , Jiwen Lu , Jie Zhou

We propose a method for constructing generative models of 3D objects from a single 3D mesh and improving them through unsupervised low-shot learning from 2D images. Our method produces a 3D morphable model that represents shape and albedo…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Skylar Sutherland , Bernhard Egger , Joshua Tenenbaum

Understanding 3D scenes from a single image is fundamental to a wide variety of tasks, such as for robotics, motion planning, or augmented reality. Existing works in 3D perception from a single RGB image tend to focus on geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Manuel Dahnert , Ji Hou , Matthias Nießner , Angela Dai

3D shape generation is a challenging problem due to the high-dimensional output space and complex part configurations of real-world objects. As a result, existing algorithms experience difficulties in accurate generative modeling of 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Salman H. Khan , Yulan Guo , Munawar Hayat , Nick Barnes

In this paper, we present an end-to-end learning framework for detailed 3D face reconstruction from a single image. Our approach uses a 3DMM-based coarse model and a displacement map in UV-space to represent a 3D face. Unlike previous work…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Yajing Chen , Fanzi Wu , Zeyu Wang , Yibing Song , Yonggen Ling , Linchao Bao

Advances in deep learning techniques have allowed recent work to reconstruct the shape of a single object given only one RBG image as input. Building on common encoder-decoder architectures for this task, we propose three extensions: (1)…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Stefan Popov , Pablo Bauszat , Vittorio Ferrari

Humans can easily infer the underlying 3D geometry and texture of an object only from a single 2D image. Current computer vision methods can do this, too, but suffer from view generalization problems - the models inferred tend to make poor…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Anand Bhattad , Aysegul Dundar , Guilin Liu , Andrew Tao , Bryan Catanzaro

In this work, we tackle the task of learning 3D human Gaussians from a single image, focusing on recovering detailed appearance and geometry including unobserved regions. We introduce a single-view generalizable Human Gaussian Model (HGM),…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Jinnan Chen , Chen Li , Jianfeng Zhang , Lingting Zhu , Buzhen Huang , Hanlin Chen , Gim Hee Lee

Single-image 3D generation lies at the core of vision-to-graphics models in the real world. However, it remains a fundamental challenge to achieve reliable generalization across diverse semantic categories and highly variable structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Bi'an Du , Daizong Liu , Pufan Li , Wei Hu