English
Related papers

Related papers: Self-supervised Learning of 3D Objects from Natura…

200 papers

Recent years have seen the development of mature solutions for reconstructing deformable surfaces from a single image, provided that they are relatively well-textured. By contrast, recovering the 3D shape of texture-less surfaces remains an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Jan Bednařík , Pascal Fua , Mathieu Salzmann

Recent advancements in deep learning opened new opportunities for learning a high-quality 3D model from a single 2D image given sufficient training on large-scale data sets. However, the significant imbalance between available amount of…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Lingjing Wang , Yi Fang

In this paper, we present an end-to-end learning framework for detailed 3D face reconstruction from a single image. Our approach uses a 3DMM-based coarse model and a displacement map in UV-space to represent a 3D face. Unlike previous work…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Yajing Chen , Fanzi Wu , Zeyu Wang , Yibing Song , Yonggen Ling , Linchao Bao

This work explores how to use self-supervised learning on videos to learn a class-specific image embedding that encodes pose and shape information. At train time, two frames of the same video of an object class (e.g. human upper body) are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Olivia Wiles , A. Sophia Koepke , Andrew Zisserman

Progress in self-supervised learning has brought strong general image representation learning methods. Yet so far, it has mostly focused on image-level learning. In turn, tasks such as unsupervised image segmentation have not benefited from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Adrian Ziegler , Yuki M. Asano

Training deep neural networks to estimate the viewpoint of objects requires large labeled training datasets. However, manually labeling viewpoints is notoriously hard, error-prone, and time-consuming. On the other hand, it is relatively…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Siva Karthik Mustikovela , Varun Jampani , Shalini De Mello , Sifei Liu , Umar Iqbal , Carsten Rother , Jan Kautz

We present a technique for a complete 3D reconstruction of small objects moving in front of a textured background. It is a particular variation of multibody structure from motion, which specializes to two objects only. The scene is captured…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Petr Hruby , Tomas Pajdla

Single-view 3D shape reconstruction is an important but challenging problem, mainly for two reasons. First, as shape annotation is very expensive to acquire, current methods rely on synthetic data, in which ground-truth 3D annotation is…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Pedro O. Pinheiro , Negar Rostamzadeh , Sungjin Ahn

In this paper, we revisit the long-standing problem of automatic reconstruction of 3D objects from single line drawings. Previous optimization-based methods can generate compact and accurate 3D models, but their success rates depend heavily…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Jia Zheng , Yifan Zhu , Kehan Wang , Qiang Zou , Zihan Zhou

Reconstructing a 3D hand from a single-view RGB image is challenging due to various hand configurations and depth ambiguity. To reliably reconstruct a 3D hand from a monocular image, most state-of-the-art methods heavily rely on 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Yujin Chen , Zhigang Tu , Di Kang , Linchao Bao , Ying Zhang , Xuefei Zhe , Ruizhi Chen , Junsong Yuan

We present a framework for learning 3D object shapes and dense cross-object 3D correspondences from just an unaligned category-specific image collection. The 3D shapes are generated implicitly as deformations to a category-specific signed…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Shivam Duggal , Deepak Pathak

Dense 3D object reconstruction from a single image has recently witnessed remarkable advances, but supervising neural networks with ground-truth 3D shapes is impractical due to the laborious process of creating paired image-shape datasets.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Chen-Hsuan Lin , Chaoyang Wang , Simon Lucey

Current state-of-the-art solutions for motion capture from a single camera are optimization driven: they optimize the parameters of a 3D human model so that its re-projection matches measurements in the video (e.g. person segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Hsiao-Yu Fish Tung , Hsiao-Wei Tung , Ersin Yumer , Katerina Fragkiadaki

Learning 3D shape representation with dense correspondence for deformable objects is a fundamental problem in computer vision. Existing approaches often need additional annotations of specific semantic domain, e.g., skeleton poses for human…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Baowen Zhang , Jiahe Li , Xiaoming Deng , Yinda Zhang , Cuixia Ma , Hongan Wang

We introduce the first completely unsupervised correspondence learning approach for deformable 3D shapes. Key to our model is the understanding that natural deformations (such as changes in pose) approximately preserve the metric structure…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Oshri Halimi , Or Litany , Emanuele Rodolà , Alex Bronstein , Ron Kimmel

We propose a method for 3D object reconstruction and 6D-pose estimation from 2D images that uses knowledge about object shape as the primary key. In the proposed pipeline, recognition and labeling of objects in 2D images deliver 2D segment…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Marcell Wolnitza , Osman Kaya , Tomas Kulvicius , Florentin Wörgötter , Babette Dellen

In this work, we address the challenging task of 3D object recognition without the reliance on real-world 3D labeled data. Our goal is to predict the 3D shape, size, and 6D pose of objects within a single RGB-D image, operating at the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Mayank Lunayach , Sergey Zakharov , Dian Chen , Rares Ambrus , Zsolt Kira , Muhammad Zubair Irshad

Humans are good at recomposing novel objects, i.e. they can identify commonalities between unknown objects from general structure to finer detail, an ability difficult to replicate by machines. We propose a framework, ISCO, to recompose an…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Stephan Alaniz , Massimiliano Mancini , Zeynep Akata

The default strategy for training single-view Large Reconstruction Models (LRMs) follows the fully supervised route using large-scale datasets of synthetic 3D assets or multi-view captures. Although these resources simplify the training…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Hanwen Jiang , Qixing Huang , Georgios Pavlakos

We present ShapeClipper, a novel method that reconstructs 3D object shapes from real-world single-view RGB images. Instead of relying on laborious 3D, multi-view or camera pose annotation, ShapeClipper learns shape reconstruction from a set…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Zixuan Huang , Varun Jampani , Anh Thai , Yuanzhen Li , Stefan Stojanov , James M. Rehg