English
Related papers

Related papers: Implicit Mesh Reconstruction from Unannotated Imag…

200 papers

We present 3DP3, a framework for inverse graphics that uses inference in a structured generative model of objects, scenes, and images. 3DP3 uses (i) voxel models to represent the 3D shape of objects, (ii) hierarchical scene graphs to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Nishad Gothoskar , Marco Cusumano-Towner , Ben Zinberg , Matin Ghavamizadeh , Falk Pollok , Austin Garrett , Joshua B. Tenenbaum , Dan Gutfreund , Vikash K. Mansinghka

We address the task of 6D pose estimation of known rigid objects from single input images in scenarios where the objects are partly occluded. Recent RGB-D-based methods are robust to moderate degrees of occlusion. For RGB inputs, no…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Omid Hosseini Jafari , Siva Karthik Mustikovela , Karl Pertsch , Eric Brachmann , Carsten Rother

The question of representation of 3D geometry is of vital importance when it comes to leveraging the recent advances in the field of machine learning for geometry processing tasks. For common unstructured surface meshes state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Isaak Lim , Alexander Dielen , Marcel Campen , Leif Kobbelt

This paper presents a "learning to learn" approach to figure-ground image segmentation. By exploring webly-abundant images of specific visual effects, our method can effectively learn the visual-effect internal representations in an…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Ding-Jie Chen , Jui-Ting Chien , Hwann-Tzong Chen , Tyng-Luh Liu

The 3D localisation of an object and the estimation of its properties, such as shape and dimensions, are challenging under varying degrees of transparency and lighting conditions. In this paper, we propose a method for jointly localising…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Alessio Xompero , Ricardo Sanchez-Matilla , Apostolos Modas , Pascal Frossard , Andrea Cavallaro

We present an approach for the reconstruction of textured 3D meshes of human heads from one or few views. Since such few-shot reconstruction is underconstrained, it requires prior knowledge which is hard to impose on traditional 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Egor Burkov , Ruslan Rakhimov , Aleksandr Safin , Evgeny Burnaev , Victor Lempitsky

Our work aims to reconstruct hand-held objects given a single RGB image. In contrast to prior works that typically assume known 3D templates and reduce the problem to 3D pose estimation, our work reconstructs generic hand-held object…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Yufei Ye , Abhinav Gupta , Shubham Tulsiani

Estimating 3D human texture from a single image is essential in graphics and vision. It requires learning a mapping function from input images of humans with diverse poses into the parametric (UV) space and reasonably hallucinating…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Said Fahri Altindis , Adil Meric , Yusuf Dalva , Ugur Gudukbay , Aysegul Dundar

Real-world 3D data may contain intricate details defined by salient surface gaps. Automated reconstruction of these open surfaces (e.g., non-watertight meshes) is a challenging problem for environment synthesis in mixed reality…

Computer Vision and Pattern Recognition · Computer Science 2023-01-20 Mohammad Samiul Arshad , William J. Beksi

One challenge that remains open in 3D deep learning is how to efficiently represent 3D data to feed deep networks. Recent works have relied on volumetric or point cloud representations, but such approaches suffer from a number of issues…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Jhony K. Pontes , Chen Kong , Sridha Sridharan , Simon Lucey , Anders Eriksson , Clinton Fookes

Contemporary monocular 6D pose estimation methods can only cope with a handful of object instances. This naturally hampers possible applications as, for instance, robots seamlessly integrated in everyday processes necessarily require the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Fabian Manhardt , Gu Wang , Benjamin Busam , Manuel Nickel , Sven Meier , Luca Minciullo , Xiangyang Ji , Nassir Navab

We present a method for estimating neural scenes representations of objects given only a single image. The core of our method is the estimation of a geometric scaffold for the object and its use as a guide for the reconstruction of the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Konstantinos Rematas , Ricardo Martin-Brualla , Vittorio Ferrari

In this paper we present a novel unsupervised representation learning approach for 3D shapes, which is an important research challenge as it avoids the manual effort required for collecting supervised data. Our method trains an RNN-based…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Zhizhong Han , Mingyang Shang , Yu-Shen Liu , Matthias Zwicker

One major goal of vision is to infer physical models of objects, surfaces, and their layout from sensors. In this paper, we aim to interpret indoor scenes from one RGBD image. Our representation encodes the layout of orthogonal walls and…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Chuhang Zou , Ruiqi Guo , Zhizhong Li , Derek Hoiem

We address the problem of learning accurate 3D shape and camera pose from a collection of unlabeled category-specific images. We train a convolutional network to predict both the shape and the pose from a single image by minimizing the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Eldar Insafutdinov , Alexey Dosovitskiy

This paper presents an approach to estimating the continuous 6-DoF pose of an object from a single RGB image. The approach combines semantic keypoints predicted by a convolutional network (convnet) with a deformable shape model. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Karl Schmeckpeper , Philip R. Osteen , Yufu Wang , Georgios Pavlakos , Kenneth Chaney , Wyatt Jordan , Xiaowei Zhou , Konstantinos G. Derpanis , Kostas Daniilidis

Implicit neural representations have emerged as a powerful tool in learning 3D geometry, offering unparalleled advantages over conventional representations like mesh-based methods. A common type of INR implicitly encodes a shape's boundary…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Shen Fan , Przemyslaw Musialski

This paper presents a novel yet intuitive approach to unsupervised feature learning. Inspired by the human visual system, we explore whether low-level motion-based grouping cues can be used to learn an effective visual representation.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Deepak Pathak , Ross Girshick , Piotr Dollár , Trevor Darrell , Bharath Hariharan

Representing scenes at the granularity of objects is a prerequisite for scene understanding and decision making. We propose PriSMONet, a novel approach based on Prior Shape knowledge for learning Multi-Object 3D scene decomposition and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Cathrin Elich , Martin R. Oswald , Marc Pollefeys , Joerg Stueckler

To what extent are two images picturing the same 3D surfaces? Even when this is a known scene, the answer typically requires an expensive search across scale space, with matching and geometric verification of large sets of local features.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Anita Rau , Guillermo Garcia-Hernando , Danail Stoyanov , Gabriel J. Brostow , Daniyar Turmukhambetov