English
Related papers

Related papers: Self-supervised Learning of Detailed 3D Face Recon…

200 papers

3D geometry is a very informative cue when interacting with and navigating an environment. This writing proposes a new approach to 3D reconstruction and scene understanding, which implicitly learns 3D geometry from depth maps pairing a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Dario Rethage , Federico Tombari , Felix Achilles , Nassir Navab

We present a learning framework that learns to recover the 3D shape, pose and texture from a single image, trained on an image collection without any ground truth 3D shape, multi-view, camera viewpoints or keypoint supervision. We approach…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Shubham Goel , Angjoo Kanazawa , Jitendra Malik

We propose a method to learn 3D deformable object categories from raw single-view images, without external supervision. The method is based on an autoencoder that factors each input image into depth, albedo, viewpoint and illumination. In…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Shangzhe Wu , Christian Rupprecht , Andrea Vedaldi

We propose a novel framework to reconstruct super-resolution human shape from a single low-resolution input image. The approach overcomes limitations of existing approaches that reconstruct 3D human shape from a single image, which require…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Marco Pesavento , Marco Volino , Adrian Hilton

Feedforward monocular face capture methods seek to reconstruct posed faces from a single image of a person. Current state of the art approaches have the ability to regress parametric 3D face models in real-time across a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Kelian Baert , Shrisha Bharadwaj , Fabien Castan , Benoit Maujean , Marc Christie , Victoria Abrevaya , Adnane Boukhayma

Reconstructing 3D human heads in low-view settings presents technical challenges, mainly due to the pronounced risk of overfitting with limited views and high-frequency signals. To address this, we propose geometry decomposition and adopt a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Baixin Xu , Jiarui Zhang , Kwan-Yee Lin , Chen Qian , Ying He

Existing single view, 3D face reconstruction methods can produce beautifully detailed 3D results, but typically only for near frontal, unobstructed viewpoints. We describe a system designed to provide detailed 3D reconstructions of faces…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Anh Tuan Tran , Tal Hassner , Iacopo Masi , Eran Paz , Yuval Nirkin , Gerard Medioni

Recovering the 3D geometric structure of a face from a single input image is a challenging active research area in computer vision. In this paper, we present a novel method for reconstructing 3D heads from a single or multiple image(s)…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Oussema Bouafif , Bogdan Khomutenko , Mohamed Daoudi

3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implicit surface as a unified representation for 3D reconstruction.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xinyi Yu , Liqin Lu , Jintao Rong , Guangkai Xu , Linlin Ou

We propose a novel learning-based approach for robust 3D shape matching. Our method builds upon deep functional maps and can be trained in a fully unsupervised manner. Previous deep functional map methods mainly focus on predicting…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Dongliang Cao , Paul Roetzer , Florian Bernard

Recovery of a 3D head model including the complete face and hair regions is still a challenging problem in computer vision and graphics. In this paper, we consider this problem using only a few multi-view portrait images as input. Previous…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Xueying Wang , Yudong Guo , Zhongqi Yang , Juyong Zhang

Self-supervised learning has transformed 2D computer vision by enabling models trained on large, unannotated datasets to provide versatile off-the-shelf features that perform similarly to models trained with labels. However, in 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Pedro Hermosilla , Christian Stippel , Leon Sick

A key challenge of learning a visual representation for the 3D high fidelity geometry of dressed humans lies in the limited availability of the ground truth data (e.g., 3D scanned models), which results in the performance degradation of 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Yasamin Jafarian , Hyun Soo Park

3D Morphable Model (3DMM) based methods have achieved great success in recovering 3D face shapes from single-view images. However, the facial textures recovered by such methods lack the fidelity as exhibited in the input images. Recent work…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiangke Lin , Yi Yuan , Tianjia Shao , Kun Zhou

Self-supervised learning is showing great promise for monocular depth estimation, using geometry as the only source of supervision. Depth networks are indeed capable of learning representations that relate visual appearance to 3D properties…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Vitor Guizilini , Rui Hou , Jie Li , Rares Ambrus , Adrien Gaidon

Recent advancements in deep learning opened new opportunities for learning a high-quality 3D model from a single 2D image given sufficient training on large-scale data sets. However, the significant imbalance between available amount of…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Lingjing Wang , Yi Fang

Intrinsic image decomposition, which is an essential task in computer vision, aims to infer the reflectance and shading of the scene. It is challenging since it needs to separate one image into two components. To tackle this, conventional…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yunfei Liu , Yu Li , Shaodi You , Feng Lu

We address the problem of recovering the 3D geometry of a human face from a set of facial images in multiple views. While recent studies have shown impressive progress in 3D Morphable Model (3DMM) based facial reconstruction, the settings…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Fanzi Wu , Linchao Bao , Yajing Chen , Yonggen Ling , Yibing Song , Songnan Li , King Ngi Ngan , Wei Liu

Many methods have been proposed over the years to tackle the task of facial 3D geometry and texture recovery from a single image. Such methods often fail to provide high-fidelity texture without relying on 3D facial scans during training.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Ron Slossberg , Ibrahim Jubran , Ron Kimmel

In this study, we introduce a novel two-stage technique for decomposing and reconstructing facial features from sparse-view images, a task made challenging by the unique geometry and complex skin reflectance of each individual. To…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Daisheng Jin , Jiangbei Hu , Baixin Xu , Yuxin Dai , Chen Qian , Ying He