English
Related papers

Related papers: Self-supervised 3D Shape and Viewpoint Estimation …

200 papers

Prior works for reconstructing hand-held objects from a single image train models on images paired with 3D shapes. Such data is challenging to gather in the real world at scale. Consequently, these approaches do not generalize well when…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Aditya Prakash , Matthew Chang , Matthew Jin , Ruisen Tu , Saurabh Gupta

This paper targets on learning-based novel view synthesis from a single or limited 2D images without the pose supervision. In the viewer-centered coordinates, we construct an end-to-end trainable conditional variational framework to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Xiaofeng Liu , Tong Che , Yiqun Lu , Chao Yang , Site Li , Jane You

Estimating the parameters of a model describing a set of observations using a neural network is in general solved in a supervised way. In cases when we do not have access to the model's true parameters this approach can not be applied.…

Astrophysics of Galaxies · Physics 2020-09-30 Miguel A. Aragon-Calvo

Recent advancements in deep learning opened new opportunities for learning a high-quality 3D model from a single 2D image given sufficient training on large-scale data sets. However, the significant imbalance between available amount of…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Lingjing Wang , Yi Fang

3D geometry is a very informative cue when interacting with and navigating an environment. This writing proposes a new approach to 3D reconstruction and scene understanding, which implicitly learns 3D geometry from depth maps pairing a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Dario Rethage , Federico Tombari , Felix Achilles , Nassir Navab

We present a convolutional network capable of inferring a 3D representation of a previously unseen object given a single image of this object. Concretely, the network can predict an RGB image and a depth map of the object as seen from an…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Maxim Tatarchenko , Alexey Dosovitskiy , Thomas Brox

We study end-to-end learning strategies for 3D shape inference from images, in particular from a single image. Several approaches in this direction have been investigated that explore different shape representations and suitable learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Roman Klokov , Jakob Verbeek , Edmond Boyer

We present a learning framework that learns to recover the 3D shape, pose and texture from a single image, trained on an image collection without any ground truth 3D shape, multi-view, camera viewpoints or keypoint supervision. We approach…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Shubham Goel , Angjoo Kanazawa , Jitendra Malik

We present a framework to translate between 2D image views and 3D object shapes. Recent progress in deep learning enabled us to learn structure-aware representations from a scene. However, the existing literature assumes that pairs of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Berk Kaya , Radu Timofte

We address the problem of 3D shape completion from sparse and noisy point clouds, a fundamental problem in computer vision and robotics. Recent approaches are either data-driven or learning-based: Data-driven approaches rely on a shape…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 David Stutz , Andreas Geiger

We present a self-supervised learning algorithm for 3D human pose estimation of a single person based on a multiple-view camera system and 2D body pose estimates for each view. To train our model, represented by a deep neural network, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Arij Bouazizi , Julian Wiederer , Ulrich Kressel , Vasileios Belagiannis

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Paul Henderson , Vittorio Ferrari

A key goal of computer vision is to recover the underlying 3D structure from 2D observations of the world. In this paper we learn strong deep generative models of 3D structures, and recover these structures from 3D and 2D images via…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Danilo Jimenez Rezende , S. M. Ali Eslami , Shakir Mohamed , Peter Battaglia , Max Jaderberg , Nicolas Heess

The problem of single-view 3D shape completion or reconstruction is challenging, because among the many possible shapes that explain an observation, most are implausible and do not correspond to natural objects. Recent research in the field…

Computer Vision and Pattern Recognition · Computer Science 2018-09-14 Jiajun Wu , Chengkai Zhang , Xiuming Zhang , Zhoutong Zhang , William T. Freeman , Joshua B. Tenenbaum

The success of supervised learning requires large-scale ground truth labels which are very expensive, time-consuming, or may need special skills to annotate. To address this issue, many self- or un-supervised methods are developed. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Longlong Jing , Yucheng Chen , Ling Zhang , Mingyi He , Yingli Tian

Our goal in this work is to generate realistic videos given just one initial frame as input. Existing unsupervised approaches to this task do not consider the fact that a video typically shows a 3D environment, and that this should remain…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Paul Henderson , Christoph H. Lampert , Bernd Bickel

Most current single image camera calibration methods rely on specific image features or user input, and cannot be applied to natural images captured in uncontrolled settings. We propose directly inferring camera calibration parameters from…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Yannick Hold-Geoffroy , Kalyan Sunkavalli , Jonathan Eisenmann , Matt Fisher , Emiliano Gambaretto , Sunil Hadap , Jean-François Lalonde

Understanding the 3D world is a fundamental problem in computer vision. However, learning a good representation of 3D objects is still an open problem due to the high dimensionality of the data and many factors of variation involved. In…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Xinchen Yan , Jimei Yang , Ersin Yumer , Yijie Guo , Honglak Lee

Accurately predicting the 3D shape of any arbitrary object in any pose from a single image is a key goal of computer vision research. This is challenging as it requires a model to learn a representation that can infer both the visible and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Anh Thai , Stefan Stojanov , Vijay Upadhya , James M. Rehg

In this paper we present a novel unsupervised representation learning approach for 3D shapes, which is an important research challenge as it avoids the manual effort required for collecting supervised data. Our method trains an RNN-based…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Zhizhong Han , Mingyang Shang , Yu-Shen Liu , Matthias Zwicker