English
Related papers

Related papers: Learning single-image 3D reconstruction by generat…

200 papers

Reconstructing high-fidelity 3D facial texture from a single image is a quite challenging task due to the lack of complete face information and the domain gap between the 3D face and 2D image. Further, obtaining re-renderable 3D faces has…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Mingxin Yang , Jianwei Guo , Zhanglin Cheng , Xiaopeng Zhang , Dong-Ming Yan

Existing works on single-image 3D reconstruction mainly focus on shape recovery. In this work, we study a new problem, that is, simultaneously recovering 3D shape and surface color from a single image, namely "colorful 3D reconstruction".…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Yongbin Sun , Ziwei Liu , Yue Wang , Sanjay E. Sarma

3D geometry is a very informative cue when interacting with and navigating an environment. This writing proposes a new approach to 3D reconstruction and scene understanding, which implicitly learns 3D geometry from depth maps pairing a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Dario Rethage , Federico Tombari , Felix Achilles , Nassir Navab

While recent learning based methods have been observed to be superior for several vision-related applications, their potential in generating artistic effects has not been explored much. One such interesting application is Shadow Art - a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Kaustubh Sadekar , Ashish Tiwari , Shanmuganathan Raman

Recent research has shown that controllable image generation based on pre-trained GANs can benefit a wide range of computer vision tasks. However, less attention has been devoted to 3D vision tasks. In light of this, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Feng Liu , Xiaoming Liu

We propose an approach to 3D reconstruction via inverse procedural modeling and investigate two variants of this approach. The first option consists in the fitting set of input parameters using a genetic algorithm. We demonstrate the…

Graphics · Computer Science 2023-10-23 Albert Garifullin , Nikolay Maiorov , Vladimir Frolov

Single-view 3D shape retrieval is a challenging task that is increasingly important with the growth of available 3D data. Prior work that has studied this task has not focused on evaluating how realistic occlusions impact performance, and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Qirui Wu , Daniel Ritchie , Manolis Savva , Angel X. Chang

We present a learning framework that learns to recover the 3D shape, pose and texture from a single image, trained on an image collection without any ground truth 3D shape, multi-view, camera viewpoints or keypoint supervision. We approach…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Shubham Goel , Angjoo Kanazawa , Jitendra Malik

3D object reconstruction is a fundamental task of many robotics and AI problems. With the aid of deep convolutional neural networks (CNNs), 3D object reconstruction has witnessed a significant progress in recent years. However, possibly due…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Hanqing Wang , Jiaolong Yang , Wei Liang , Xin Tong

3D reconstruction from a single RGB image is a challenging problem in computer vision. Previous methods are usually solely data-driven, which lead to inaccurate 3D shape recovery and limited generalization capability. In this work, we focus…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Yichao Zhou , Shichen Liu , Yi Ma

3D reconstruction from single view images is an ill-posed problem. Inferring the hidden regions from self-occluded images is both challenging and ambiguous. We propose a two-pronged approach to address these issues. To better incorporate…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Priyanka Mandikal , K L Navaneet , Mayank Agarwal , R. Venkatesh Babu

We present an approach for reconstructing vehicles from a single (RGB) image, in the context of autonomous driving. Though the problem appears to be ill-posed, we demonstrate that prior knowledge about how 3D shapes of vehicles project to…

Computer Vision and Pattern Recognition · Computer Science 2016-09-30 J. Krishna Murthy , G. V. Sai Krishna , Falak Chhaya , K. Madhava Krishna

In this paper we present, to the best of our knowledge, the first method to learn a generative model of 3D shapes from natural images in a fully unsupervised way. For example, we do not use any ground truth 3D or 2D annotations, stereo…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Attila Szabó , Givi Meishvili , Paolo Favaro

The advancement of generative radiance fields has pushed the boundary of 3D-aware image synthesis. Motivated by the observation that a 3D object should look realistic from multiple viewpoints, these methods introduce a multi-view constraint…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Xingang Pan , Xudong Xu , Chen Change Loy , Christian Theobalt , Bo Dai

In this paper, we present a new perspective towards image-based shape generation. Most existing deep learning based shape reconstruction methods employ a single-view deterministic model which is sometimes insufficient to determine a single…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Yi Wei , Shaohui Liu , Wang Zhao , Jiwen Lu , Jie Zhou

There is some ambiguity in the 3D shape of an object when the number of observed views is small. Because of this ambiguity, although a 3D object reconstructor can be trained using a single view or a few views per object, reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Hiroharu Kato , Tatsuya Harada

Single particle reconstruction has recently emerged in 3D fluorescence microscopy as a powerful technique to improve the axial resolution and the degree of fluorescent labeling. It is based on the reconstruction of an average volume of a…

Image and Video Processing · Electrical Eng. & Systems 2023-01-24 Thibaut Eloy , Etienne Baudrier , Marine Laporte , Virginie Hamel , Paul Guichard , Denis Fortun

Existing methods for single-view 3D object reconstruction directly learn to transform image features into 3D representations. However, these methods are vulnerable to images containing noisy backgrounds and heavy occlusions because the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Shuo Yang , Min Xu , Haozhe Xie , Stuart Perry , Jiahao Xia

Generative reconstruction methods compute the 3D configuration (such as pose and/or geometry) of a shape by optimizing the overlap of the projected 3D shape model with images. Proper handling of occlusions is a big challenge, since the…

Computer Vision and Pattern Recognition · Computer Science 2016-02-12 Helge Rhodin , Nadia Robertini , Christian Richardt , Hans-Peter Seidel , Christian Theobalt

3D face reconstruction from a single image is a challenging problem, especially under partial occlusions and extreme poses. This is because the uncertainty of the estimated 2D landmarks will affect the quality of face reconstruction. In…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Kun Li , Jing Yang , Nianhong Jiao , Jinsong Zhang , Yu-Kun Lai