English
Related papers

Related papers: Extreme 3D Face Reconstruction: Seeing Through Occ…

200 papers

The task of reconstructing detailed 3D human body models from images is interesting but challenging in computer vision due to the high freedom of human bodies. In order to tackle the problem, we propose a coarse-to-fine method to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Zhongguo Li , Magnus Oskarsson , Anders Heyden

This paper proposes a novel model fitting algorithm for 3D facial expression reconstruction from a single image. Face expression reconstruction from a single image is a challenging task in computer vision. Most state-of-the-art methods fit…

Computer Vision and Pattern Recognition · Computer Science 2018-08-20 Fanzi Wu , Songnan Li , Tianhao Zhao , King Ngi Ngan , Lv Sheng

Single-view 3D shape retrieval is a challenging task that is increasingly important with the growth of available 3D data. Prior work that has studied this task has not focused on evaluating how realistic occlusions impact performance, and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Qirui Wu , Daniel Ritchie , Manolis Savva , Angel X. Chang

The three-dimensional reconstruction of scenes from multiple views has made impressive strides in recent years, chiefly by methods correlating isolated feature points, intensities, or curvilinear structure. In the general setting, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-14 Anil Usumezbas , Ricardo Fabbri , Benjamin Kimia

3D face reconstruction from a single image is a challenging problem, especially under partial occlusions and extreme poses. This is because the uncertainty of the estimated 2D landmarks will affect the quality of face reconstruction. In…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Kun Li , Jing Yang , Nianhong Jiao , Jinsong Zhang , Yu-Kun Lai

We present a new end-to-end learning framework to obtain detailed and spatially coherent reconstructions of multiple people from a single image. Existing multi-person methods suffer from two main drawbacks: they are often model-based and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Armin Mustafa , Akin Caliskan , Lourdes Agapito , Adrian Hilton

We address the challenges in estimating 3D human poses from multiple views under occlusion and with limited overlapping views. We approach multi-view, single-person 3D human pose reconstruction as a regression problem and propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Olivier Moliner , Sangxia Huang , Kalle Åström

In recent decades, 3D morphable model (3DMM) has been commonly used in image-based photorealistic 3D face reconstruction. However, face images are often corrupted by serious occlusion by non-face objects including eyeglasses, masks, and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Xiaowei Yuan , In Kyu Park

3D reconstruction is a fundamental problem in computer vision, and the task is especially challenging when the object to reconstruct is partially or fully occluded. We introduce a method that uses the shadows cast by an unobserved object in…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ruoshi Liu , Sachit Menon , Chengzhi Mao , Dennis Park , Simon Stent , Carl Vondrick

We present an unsupervised approach for learning to estimate three dimensional (3D) facial structure from a single image while also predicting 3D viewpoint transformations that match a desired pose and facial geometry. We achieve this by…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Joel Ruben Antony Moniz , Christopher Beckham , Simon Rajotte , Sina Honari , Christopher Pal

We introduce a novel method for updating 3D geospatial models, specifically targeting occlusion removal in large-scale maritime environments. Traditional 3D reconstruction techniques often face problems with dynamic objects, like cars or…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Felix Sattler , Borja Carrillo Perez , Maurice Stephan , Sarah Barnes

Face occlusions, covering either the majority or discriminative parts of the face, can break facial perception and produce a drastic loss of information. Biometric systems such as recent deep face recognition models are not immune to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Joe Mathai , Iacopo Masi , Wael AbdAlmageed

We propose a straightforward method that simultaneously reconstructs the 3D facial structure and provides dense alignment. To achieve this, we design a 2D representation called UV position map which records the 3D shape of a complete face…

Computer Vision and Pattern Recognition · Computer Science 2018-03-22 Yao Feng , Fan Wu , Xiaohu Shao , Yanfeng Wang , Xi Zhou

We present a novel framework to reconstruct complete 3D human shapes from a given target image by leveraging monocular unconstrained images. The objective of this work is to reproduce high-quality details in regions of the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Marco Pesavento , Marco Volino , Adrian Hilton

We present a simple yet effective general-purpose framework for modeling 3D shapes by leveraging recent advances in 2D image generation using CNNs. Using just a single depth image of the object, we can output a dense multi-view depth map…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Kamal Gupta , Susmija Jabbireddy , Ketul Shah , Abhinav Shrivastava , Matthias Zwicker

Facial makeup enriches the beauty of not only real humans but also virtual characters; therefore, makeup for 3D facial models is highly in demand in productions. However, painting directly on 3D faces and capturing real-world makeup are…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Xingchao Yang , Takafumi Taketomi , Yoshihiro Kanamori

3D face reconstruction and face alignment are two fundamental and highly related topics in computer vision. Recently, some works start to use deep learning models to estimate the 3DMM coefficients to reconstruct 3D face geometry. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Zihao Jian , Minshan Xie

Existing methods for 3D face reconstruction from a few casually captured images employ deep learning based models along with a 3D Morphable Model(3DMM) as face geometry prior. Structure From Motion(SFM), followed by Multi-View Stereo (MVS),…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Raja Kumar , Jiahao Luo , Alex Pang , James Davis

Occlusions remain one of the key challenges in 3D body pose estimation from single-camera video sequences. Temporal consistency has been extensively used to mitigate their impact but the existing algorithms in the literature do not…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Soumava Kumar Roy , Ilia Badanin , Sina Honari , Pascal Fua

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Daeyun Shin , Zhile Ren , Erik B. Sudderth , Charless C. Fowlkes