English
Related papers

Related papers: Learning single-image 3D reconstruction by generat…

200 papers

Contemporary monocular 6D pose estimation methods can only cope with a handful of object instances. This naturally hampers possible applications as, for instance, robots seamlessly integrated in everyday processes necessarily require the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Fabian Manhardt , Gu Wang , Benjamin Busam , Manuel Nickel , Sven Meier , Luca Minciullo , Xiangyang Ji , Nassir Navab

We propose a method for self-supervised image representation learning under the guidance of 3D geometric consistency. Our intuition is that 3D geometric consistency priors such as smooth regions and surface discontinuities may imply…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Nenglun Chen , Lei Chu , Hao Pan , Yan Lu , Wenping Wang

In this paper, we revisit the long-standing problem of automatic reconstruction of 3D objects from single line drawings. Previous optimization-based methods can generate compact and accurate 3D models, but their success rates depend heavily…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Jia Zheng , Yifan Zhu , Kehan Wang , Qiang Zou , Zihan Zhou

We demonstrate the use of shape-from-shading (SfS) to improve both the quality and the robustness of 3D reconstruction of dynamic objects captured by a single camera. Unlike previous approaches that made use of SfS as a post-processing…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Qi Liu-Yin , Rui Yu , Lourdes Agapito , Andrew Fitzgibbon , Chris Russell

Convolutional networks for single-view object reconstruction have shown impressive performance and have become a popular subject of research. All existing techniques are united by the idea of having an encoder-decoder network that performs…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Maxim Tatarchenko , Stephan R. Richter , René Ranftl , Zhuwen Li , Vladlen Koltun , Thomas Brox

We study 3D shape modeling from a single image and make contributions to it in three aspects. First, we present Pix3D, a large-scale benchmark of diverse image-shape pairs with pixel-level 2D-3D alignment. Pix3D has wide applications in…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Xingyuan Sun , Jiajun Wu , Xiuming Zhang , Zhoutong Zhang , Chengkai Zhang , Tianfan Xue , Joshua B. Tenenbaum , William T. Freeman

Accurately reconstructing complex full multi-object scenes from sparse observations remains a core challenge in computer vision and a key step toward scalable and reliable simulation for robotics. In this work, we introduce RecGen, a…

In this work, we address the challenging task of 3D object recognition without the reliance on real-world 3D labeled data. Our goal is to predict the 3D shape, size, and 6D pose of objects within a single RGB-D image, operating at the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Mayank Lunayach , Sergey Zakharov , Dian Chen , Rares Ambrus , Zsolt Kira , Muhammad Zubair Irshad

We present a novel face reconstruction method capable of reconstructing detailed face geometry, spatially varying face reflectance from a single monocular image. We build our work upon the recent advances of DNN-based auto-encoders with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Abdallah Dib , Junghyun Ahn , Cedric Thebault , Philippe-Henri Gosselin , Louis Chevallier

A fundamental problem in computer vision is that of inferring the intrinsic, 3D structure of the world from flat, 2D images of that world. Traditional methods for recovering scene properties such as shape, reflectance, or illumination rely…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Jonathan T. Barron , Jitendra Malik

Recently, learning-based approaches for 3D reconstruction from 2D images have gained popularity due to its modern applications, e.g., 3D printers, autonomous robots, self-driving cars, virtual reality, and augmented reality. The computer…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Andrey Salvi , Nathan Gavenski , Eduardo Pooch , Felipe Tasoniero , Rodrigo Barros

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dario Pavllo , David Joseph Tan , Marie-Julie Rakotosaona , Federico Tombari

We propose a novel framework to reconstruct super-resolution human shape from a single low-resolution input image. The approach overcomes limitations of existing approaches that reconstruct 3D human shape from a single image, which require…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Marco Pesavento , Marco Volino , Adrian Hilton

We present ShapeClipper, a novel method that reconstructs 3D object shapes from real-world single-view RGB images. Instead of relying on laborious 3D, multi-view or camera pose annotation, ShapeClipper learns shape reconstruction from a set…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Zixuan Huang , Varun Jampani , Anh Thai , Yuanzhen Li , Stefan Stojanov , James M. Rehg

Intrinsic decomposition from a single image is a highly challenging task, due to its inherent ambiguity and the scarcity of training data. In contrast to traditional fully supervised learning approaches, in this paper we propose learning…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Michael Janner , Jiajun Wu , Tejas D. Kulkarni , Ilker Yildirim , Joshua B. Tenenbaum

We propose a novel approach to jointly perform 3D shape retrieval and pose estimation from monocular images.In order to make the method robust to real-world image variations, e.g. complex textures and backgrounds, we learn an embedding…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Kyaw Zaw Lin , Weipeng Xu , Qianru Sun , Christian Theobalt , Tat-Seng Chua

We propose a method to detect and reconstruct multiple 3D objects from a single RGB image. The key idea is to optimize for detection, alignment and shape jointly over all objects in the RGB image, while focusing on realistic and physically…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Francis Engelmann , Konstantinos Rematas , Bastian Leibe , Vittorio Ferrari

The problem of single-view 3D shape completion or reconstruction is challenging, because among the many possible shapes that explain an observation, most are implausible and do not correspond to natural objects. Recent research in the field…

Computer Vision and Pattern Recognition · Computer Science 2018-09-14 Jiajun Wu , Chengkai Zhang , Xiuming Zhang , Zhoutong Zhang , William T. Freeman , Joshua B. Tenenbaum

We propose a combined generative and contrastive neural architecture for learning latent representations of 3D volumetric shapes. The architecture uses two encoder branches for voxel grids and multi-view images from the same underlying…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Chengzhi Wu , Julius Pfrommer , Mingyuan Zhou , Jürgen Beyerer

This paper proposes a deep neural network structure that exploits edge information in addressing representative low-level vision tasks such as layer separation and image filtering. Unlike most other deep learning strategies applied in this…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Qingnan Fan , Jiaolong Yang , Gang Hua , Baoquan Chen , David Wipf