English
Related papers

Related papers: Structure from Duplicates: Neural Inverse Graphics…

200 papers

We demonstrate the use of shape-from-shading (SfS) to improve both the quality and the robustness of 3D reconstruction of dynamic objects captured by a single camera. Unlike previous approaches that made use of SfS as a post-processing…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Qi Liu-Yin , Rui Yu , Lourdes Agapito , Andrew Fitzgibbon , Chris Russell

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dario Pavllo , David Joseph Tan , Marie-Julie Rakotosaona , Federico Tombari

We investigate the problem of learning to generate 3D parametric surface representations for novel object instances, as seen from one or more views. Previous work on learning shape reconstruction from multiple views uses discrete…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Jiahui Lei , Srinath Sridhar , Paul Guerrero , Minhyuk Sung , Niloy Mitra , Leonidas J. Guibas

While Structure from Motion (SfM) achieves great success in 3D reconstruction, it still meets challenges on large scale scenes. In this work, large scale SfM is deemed as a graph problem, and we tackle it in a divide-and-conquer manner.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Yu Chen , Shuhan Shen , Yisong Chen , Guoping Wang

The task of unsupervised image-to-image translation has seen substantial advancements in recent years through the use of deep neural networks. Typically, the proposed solutions learn the characterizing distribution of two large, unpaired…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Sagie Benaim , Ron Mokady , Amit Bermano , Daniel Cohen-Or , Lior Wolf

In this paper a semi-supervised deep framework is proposed for the problem of 3D shape inverse rendering from a single 2D input image. The main structure of proposed framework consists of unsupervised pre-trained components which…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Shima Kamyab , S. Zohreh Azimifar

Single-shot wide-angle diffraction imaging is a widely used method to investigate the structure of non-crystallizing objects such as nanoclusters, large proteins or even viruses. Its main advantage is that information about the…

Data Analysis, Statistics and Probability · Physics 2021-06-02 Thomas Stielow , Stefan Scheel

Given a single image of a general object such as a chair, could we also restore its articulated 3D shape similar to human modeling, so as to animate its plausible articulations and diverse motions? This is an interesting new question that…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Ji Yang , Xinxin Zuo , Sen Wang , Zhenbo Yu , Xingyu Li , Bingbing Ni , Minglun Gong , Li Cheng

Structure-from-Motion (SfM) aims to recover 3D scene structures and camera poses based on the correspondences between input images, and thus the ambiguity caused by duplicate structures (i.e., different structures with strong visual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Lei Wang , Linlin Ge , Shan Luo , Zihan Yan , Zhaopeng Cui , Jieqing Feng

Shape-from-Template (SfT) methods estimate 3D surface deformations from a single monocular RGB camera while assuming a 3D state known in advance (a template). This is an important yet challenging problem due to the under-constrained nature…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Navami Kairanda , Edith Tretschk , Mohamed Elgharib , Christian Theobalt , Vladislav Golyanik

Object-oriented maps are important for scene understanding since they jointly capture geometry and semantics, allow individual instantiation and meaningful reasoning about objects. We introduce FroDO, a method for accurate 3D reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Kejie Li , Martin Rünz , Meng Tang , Lingni Ma , Chen Kong , Tanner Schmidt , Ian Reid , Lourdes Agapito , Julian Straub , Steven Lovegrove , Richard Newcombe

We propose to recover 3D shape structures from single RGB images, where structure refers to shape parts represented by cuboids and part relations encompassing connectivity and symmetry. Given a single 2D image with an object depicted, our…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Chengjie Niu , Jun Li , Kai Xu

We present a method to learn single-view reconstruction of the 3D shape, pose, and texture of objects from categorized natural images in a self-supervised manner. Since this is a severely ill-posed problem, carefully designing a training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Hiroharu Kato , Tatsuya Harada

Reconstructing object geometry and material from multiple views typically requires optimization. Differentiable path tracing is an appealing framework as it can reproduce complex appearance effects. However, it is difficult to use due to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Purvi Goel , Loudon Cohen , James Guesman , Vikas Thamizharasan , James Tompkin , Daniel Ritchie

A key goal of computer vision is to recover the underlying 3D structure from 2D observations of the world. In this paper we learn strong deep generative models of 3D structures, and recover these structures from 3D and 2D images via…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Danilo Jimenez Rezende , S. M. Ali Eslami , Shakir Mohamed , Peter Battaglia , Max Jaderberg , Nicolas Heess

We propose an approach to 3D reconstruction via inverse procedural modeling and investigate two variants of this approach. The first option consists in the fitting set of input parameters using a genetic algorithm. We demonstrate the…

Graphics · Computer Science 2023-10-23 Albert Garifullin , Nikolay Maiorov , Vladimir Frolov

Texture, highlights, and shading are some of many visual cues that allow humans to perceive material appearance in single pictures. Yet, recovering spatially-varying bi-directional reflectance distribution functions (SVBRDFs) from a single…

Graphics · Computer Science 2018-10-24 Valentin Deschaintre , Miika Aittala , Fredo Durand , George Drettakis , Adrien Bousseau

In this work, we present an automated workflow to bring human figures, one of the most frequently appearing entities on pictorial maps, to the third dimension. Our workflow is based on training data and neural networks for single-view 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Raimund Schnürer , A. Cengiz Öztireli , Magnus Heitzler , René Sieber , Lorenz Hurni

We consider the problem of reconstructing a full 360{\deg} photographic model of an object from a single image of it. We do so by fitting a neural radiance field to the image, but find this problem to be severely ill-posed. We thus take an…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Luke Melas-Kyriazi , Christian Rupprecht , Iro Laina , Andrea Vedaldi

3D object understanding and generation methods produce impressive results, yet they often overlook a pervasive source of information in real-world scenes: repeated objects. We introduce the task of lookalike object detection in indoor…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Chandan Yeshwanth , Angela Dai