English
Related papers

Related papers: Toward 3D Object Reconstruction from Stereo Images

200 papers

We present a framework to translate between 2D image views and 3D object shapes. Recent progress in deep learning enabled us to learn structure-aware representations from a scene. However, the existing literature assumes that pairs of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Berk Kaya , Radu Timofte

This paper proposes a new method for simultaneous 3D reconstruction and semantic segmentation of indoor scenes. Unlike existing methods that require recording a video using a color camera and/or a depth camera, our method only needs a small…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Jingyu Yang , Ji Xu , Kun Li , Yu-Kun Lai , Huanjing Yue , Jianzhi Lu , Hao Wu , Yebin Liu

Recovering the 3D shape of transparent objects using a small number of unconstrained natural images is an ill-posed problem. Complex light paths induced by refraction and reflection have prevented both traditional and deep multiview stereo…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Zhengqin Li , Yu-Ying Yeh , Manmohan Chandraker

Recovering textured 3D models of non-rigid human body shapes is challenging due to self-occlusions caused by complex body poses and shapes, clothing obstructions, lack of surface texture, background clutter, sparse set of cameras with…

Computer Vision and Pattern Recognition · Computer Science 2018-09-19 Abbhinav Venkat , Sai Sagar Jinka , Avinash Sharma

We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object from a sparse set of only six images captured by wide-baseline cameras under collocated point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Sai Bi , Zexiang Xu , Kalyan Sunkavalli , David Kriegman , Ravi Ramamoorthi

We propose Differentiable Stereopsis, a multi-view stereo approach that reconstructs shape and texture from few input views and noisy cameras. We pair traditional stereopsis and modern differentiable rendering to build an end-to-end model…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Shubham Goel , Georgia Gkioxari , Jitendra Malik

We present a learnt system for multi-view stereopsis. In contrast to recent learning based methods for 3D reconstruction, we leverage the underlying 3D geometry of the problem through feature projection and unprojection along viewing rays.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Abhishek Kar , Christian Häne , Jitendra Malik

Photometric stereo, a problem of recovering 3D surface normals using images of an object captured under different lightings, has been of great interest and importance in computer vision research. Despite the success of existing traditional…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Ashish Tiwari , Shanmuganathan Raman

Object detection in 3D with stereo cameras is an important problem in computer vision, and is particularly crucial in low-cost autonomous mobile robots without LiDARs. Nowadays, most of the best-performing frameworks for stereo 3D object…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Yuxuan Liu , Lujia Wang , Ming Liu

Inspired by the recent success of methods that employ shape priors to achieve robust 3D reconstructions, we propose a novel recurrent neural network architecture that we call the 3D Recurrent Reconstruction Neural Network (3D-R2N2). The…

Computer Vision and Pattern Recognition · Computer Science 2016-04-05 Christopher B. Choy , Danfei Xu , JunYoung Gwak , Kevin Chen , Silvio Savarese

In this paper a semi-supervised deep framework is proposed for the problem of 3D shape inverse rendering from a single 2D input image. The main structure of proposed framework consists of unsupervised pre-trained components which…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Shima Kamyab , S. Zohreh Azimifar

We investigate the problem of learning category-specific 3D shape reconstruction from a variable number of RGB views of previously unobserved object instances. Most approaches for multiview shape reconstruction operate on sparse shape…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Srinath Sridhar , Davis Rempe , Julien Valentin , Sofien Bouaziz , Leonidas J. Guibas

We introduce a differential visual similarity metric to train deep neural networks for 3D reconstruction, aimed at improving reconstruction quality. The metric compares two 3D shapes by measuring distances between multi-view images…

Graphics · Computer Science 2020-04-02 Jiongchao Jin , Akshay Gadi Patil , Zhang Xiong , Hao Zhang

This paper presents DeepShadow, a one-shot method for recovering the depth map and surface normals from photometric stereo shadow maps. Previous works that try to recover the surface normals from photometric stereo images treat cast shadows…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Asaf Karnieli , Ohad Fried , Yacov Hel-Or

We present a method to reconstruct the three-dimensional trajectory of a moving instance of a known object category using stereo video data. We track the two-dimensional shape of objects on pixel level exploiting instance-aware semantic…

Computer Vision and Pattern Recognition · Computer Science 2018-08-29 Sebastian Bullinger , Christoph Bodensteiner , Michael Arens , Rainer Stiefelhagen

The objective of this paper is 3D shape understanding from single and multiple images. To this end, we introduce a new deep-learning architecture and loss function, SilNet, that can handle multiple views in an order-agnostic manner. The…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Olivia Wiles , Andrew Zisserman

Estimating the 3D shape of an object from a single or multiple images has gained popularity thanks to the recent breakthroughs powered by deep learning. Most approaches regress the full object shape in a canonical pose, possibly…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Riccardo Spezialetti , David Joseph Tan , Alessio Tonioni , Keisuke Tateno , Federico Tombari

Depth from defocus (DfD) and stereo matching are two most studied passive depth sensing schemes. The techniques are essentially complementary: DfD can robustly handle repetitive textures that are problematic for stereo matching whereas…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Zhang Chen , Xinqing Guo , Siyuan Li , Xuan Cao , Jingyi Yu

This paper introduces a novel deep framework for dense 3D reconstruction from multiple image frames, leveraging a sparse set of depth measurements gathered jointly with image acquisition. Given a deep multi-view stereo network, our…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Matteo Poggi , Andrea Conti , Stefano Mattoccia

3D dense reconstruction refers to the process of obtaining the complete shape and texture features of 3D objects from 2D planar images. 3D reconstruction is an important and extensively studied problem, but it is far from being solved. This…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Yangming Li