English
Related papers

Related papers: Virtual View Networks for Object Reconstruction

200 papers

Accurately predicting the 3D shape of any arbitrary object in any pose from a single image is a key goal of computer vision research. This is challenging as it requires a model to learn a representation that can infer both the visible and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Anh Thai , Stefan Stojanov , Vijay Upadhya , James M. Rehg

Taking an image of an object is at its core a lossy process. The rich information about the three-dimensional structure of the world is flattened to an image plane and decisions such as viewpoint and camera parameters are final and not…

Computer Vision and Pattern Recognition · Computer Science 2016-08-16 Konstantinos Rematas , Chuong Nguyen , Tobias Ritschel , Mario Fritz , Tinne Tuytelaars

This paper studies the problem of 3D volumetric reconstruction from two views of a scene with an unknown camera. While seemingly easy for humans, this problem poses many challenges for computers since it requires simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Shengyi Qian , Linyi Jin , David F. Fouhey

We investigate the problem of learning to generate 3D parametric surface representations for novel object instances, as seen from one or more views. Previous work on learning shape reconstruction from multiple views uses discrete…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Jiahui Lei , Srinath Sridhar , Paul Guerrero , Minhyuk Sung , Niloy Mitra , Leonidas J. Guibas

Estimating the 3D shape of an object from a single or multiple images has gained popularity thanks to the recent breakthroughs powered by deep learning. Most approaches regress the full object shape in a canonical pose, possibly…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Riccardo Spezialetti , David Joseph Tan , Alessio Tonioni , Keisuke Tateno , Federico Tombari

Reconstructing the detailed geometric structure of a face from a given image is a key to many computer vision and graphics applications, such as motion capture and reenactment. The reconstruction task is challenging as human faces vary…

Computer Vision and Pattern Recognition · Computer Science 2017-04-07 Elad Richardson , Matan Sela , Roy Or-El , Ron Kimmel

Inferring 3D structure of a generic object from a 2D image is a long-standing objective of computer vision. Conventional approaches either learn completely from CAD-generated synthetic data, which have difficulty in inference from real…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Feng Liu , Luan Tran , Xiaoming Liu

Recovering the spatial layout of the cameras and the geometry of the scene from extreme-view images is a longstanding challenge in computer vision. Prevailing 3D reconstruction algorithms often adopt the image matching paradigm and presume…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Wei-Chiu Ma , Anqi Joyce Yang , Shenlong Wang , Raquel Urtasun , Antonio Torralba

Inspired by the recent advance of image-based object reconstruction using deep learning, we present an active reconstruction model using a guided view planner. We aim to reconstruct a 3D model using images observed from a planned sequence…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Xin Yang , Yuanbo Wang , Yaru Wang , Baocai Yin , Qiang Zhang , Xiaopeng Wei , Hongbo Fu

We present a novel framework for mesh reconstruction from unstructured point clouds by taking advantage of the learned visibility of the 3D points in the virtual views and traditional graph-cut based mesh generation. Specifically, we first…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Shuang Song , Zhaopeng Cui , Rongjun Qin

Inspired by the recent success of methods that employ shape priors to achieve robust 3D reconstructions, we propose a novel recurrent neural network architecture that we call the 3D Recurrent Reconstruction Neural Network (3D-R2N2). The…

Computer Vision and Pattern Recognition · Computer Science 2016-04-05 Christopher B. Choy , Danfei Xu , JunYoung Gwak , Kevin Chen , Silvio Savarese

Recent volumetric 3D reconstruction methods can produce very accurate results, with plausible geometry even for unobserved surfaces. However, they face an undesirable trade-off when it comes to multi-view fusion. They can fuse all available…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Noah Stier , Alexander Rich , Pradeep Sen , Tobias Höllerer

When created faithfully from real-world data, Digital 3D representations of objects can be useful for human or computer-assisted analysis. Such models can also serve for generating training data for machine learning approaches in settings…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 David Nakath , Xiangyu Weng , Mengkun She , Kevin Köser

This paper proposes a unified vision-based manipulation framework using image contours of deformable/rigid objects. Instead of using human-defined cues, the robot automatically learns the features from processed vision data. Our method…

Robotics · Computer Science 2021-05-06 Jihong Zhu , David Navarro-Alarcon , Robin Passama , Andrea Cherubini

Most state-of-the-art deep geometric learning single-view reconstruction approaches rely on encoder-decoder architectures that output either shape parametrizations or implicit representations. However, these representations rarely preserve…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Benoit Guillard , Edoardo Remelli , Pascal Fua

3D shape reconstruction from a single image is a highly ill-posed problem. Modern deep learning based systems try to solve this problem by learning an end-to-end mapping from image to shape via a deep network. In this paper, we aim to solve…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Kejie Li , Ravi Garg , Ming Cai , Ian Reid

Object reconstruction is an important task in many fields of application as it allows to generate digital representations of our physical world used as base for analysis, planning, construction, visualization or other aims. A reconstruction…

We present Virtual Elastic Objects (VEOs): virtual objects that not only look like their real-world counterparts but also behave like them, even when subject to novel interactions. Achieving this presents multiple challenges: not only do…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Hsiao-yu Chen , Edgar Tretschk , Tuur Stuyck , Petr Kadlecek , Ladislav Kavan , Etienne Vouga , Christoph Lassner

Advances in deep learning techniques have allowed recent work to reconstruct the shape of a single object given only one RBG image as input. Building on common encoder-decoder architectures for this task, we propose three extensions: (1)…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Stefan Popov , Pablo Bauszat , Vittorio Ferrari

Single-view 3D object reconstruction is a fundamental and challenging computer vision task that aims at recovering 3D shapes from single-view RGB images. Most existing deep learning based reconstruction methods are trained and evaluated on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xianghui Yang , Guosheng Lin , Luping Zhou