English
Related papers

Related papers: Neural Re-Rendering of Humans from a Single Image

200 papers

Human shape estimation is an important task for video editing, animation and fashion industry. Predicting 3D human body shape from natural images, however, is highly challenging due to factors such as variation in human bodies, clothing and…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Gül Varol , Duygu Ceylan , Bryan Russell , Jimei Yang , Ersin Yumer , Ivan Laptev , Cordelia Schmid

This paper addresses the problem of 3D human pose and shape estimation from a single image. Previous approaches consider a parametric model of the human body, SMPL, and attempt to regress the model parameters that give rise to a mesh…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Nikos Kolotouros , Georgios Pavlakos , Kostas Daniilidis

This paper proposes a new end-to-end neural rendering architecture to transfer appearance and reenact human actors. Our method leverages a carefully designed graph convolutional network (GCN) to model the human body manifold structure,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Thiago L. Gomes , Thiago M. Coutinho , Rafael Azevedo , Renato Martins , Erickson R. Nascimento

Human imitation has become topical recently, driven by GAN's ability to disentangle human pose and body content. However, the latest methods hardly focus on 3D information, and to avoid self-occlusion, a massive amount of input images are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Haoxi Ran , Guangfu Wang , Li Lu

We propose a method to estimate 3D human poses from substantially blurred images. The key idea is to tackle the inverse problem of image deblurring by modeling the forward problem with a 3D human model, a texture map, and a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Yiming Zhao , Denys Rozumnyi , Jie Song , Otmar Hilliges , Marc Pollefeys , Martin R. Oswald

In this paper, we introduce the new task of reconstructing 3D human pose from a single image in which we can see the person and the person's image through a mirror. Compared to general scenarios of 3D pose estimation from a single view, the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Qi Fang , Qing Shuai , Junting Dong , Hujun Bao , Xiaowei Zhou

We present deep neural network methodology to reconstruct the 3d pose and shape of people, given an input RGB image. We rely on a recently introduced, expressivefull body statistical 3d human model, GHUM, trained end-to-end, and learn to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Andrei Zanfir , Eduard Gabriel Bazavan , Mihai Zanfir , William T. Freeman , Rahul Sukthankar , Cristian Sminchisescu

It has been recently shown that neural networks can recover the geometric structure of a face from a single given image. A common denominator of most existing face geometry reconstruction methods is the restriction of the solution space to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-18 Matan Sela , Elad Richardson , Ron Kimmel

We present a new end-to-end learning framework to obtain detailed and spatially coherent reconstructions of multiple people from a single image. Existing multi-person methods suffer from two main drawbacks: they are often model-based and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Armin Mustafa , Akin Caliskan , Lourdes Agapito , Adrian Hilton

We propose LookinGood^{\pi}, a novel neural re-rendering approach that is aimed to (1) improve the rendering quality of the low-quality reconstructed results from human performance capture system in real-time; (2) improve the generalization…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Xiqi Yang , Kewei Yang , Kang Chen , Weidong Zhang , Weiwei Xu

Single-image human relighting aims to relight a target human under new lighting conditions by decomposing the input image into albedo, shape and lighting. Although plausible relighting results can be achieved, previous methods suffer from…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Chaonan Ji , Tao Yu , Kaiwen Guo , Jingxin Liu , Yebin Liu

Recent approaches to jointly reconstruct 3D humans and objects from a single RGB image represent 3D shapes with template-based or coarse models, which fail to capture details of loose clothing on human bodies. In this paper, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ayushi Dutta , Marco Pesavento , Marco Volino , Adrian Hilton , Armin Mustafa

It is challenging to directly estimate the human geometry from a single image due to the high diversity and complexity of body shapes with the various clothing styles. Most of model-based approaches are limited to predict the shape and pose…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Lixiang Lin , Jianke Zhu

Reconstructing the detailed geometric structure of a face from a given image is a key to many computer vision and graphics applications, such as motion capture and reenactment. The reconstruction task is challenging as human faces vary…

Computer Vision and Pattern Recognition · Computer Science 2017-04-07 Elad Richardson , Matan Sela , Roy Or-El , Ron Kimmel

This paper tackles the problem of estimating 3D body shape of clothed humans from single polarized 2D images, i.e. polarization images. Polarization images are known to be able to capture polarized reflected lights that preserve rich…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Shihao Zou , Xinxin Zuo , Yiming Qian , Sen Wang , Chi Xu , Minglun Gong , Li Cheng

The task of reconstructing detailed 3D human body models from images is interesting but challenging in computer vision due to the high freedom of human bodies. In order to tackle the problem, we propose a coarse-to-fine method to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Zhongguo Li , Magnus Oskarsson , Anders Heyden

4D reconstruction of human-object interaction is critical for immersive VR/AR experience and human activity understanding. Recent advances still fail to recover fine geometry and texture results from sparse RGB inputs, especially under…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Guoxing Sun , Xin Chen , Yizhang Chen , Anqi Pang , Pei Lin , Yuheng Jiang , Lan Xu , Jingya Wang , Jingyi Yu

3D Human Body Reconstruction from a monocular image is an important problem in computer vision with applications in virtual and augmented reality platforms, animation industry, en-commerce domain, etc. While several of the existing works…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Abbhinav Venkat , Chaitanya Patel , Yudhik Agrawal , Avinash Sharma

This work addresses the problem of estimating the full body 3D human pose and shape from a single color image. This is a task where iterative optimization-based solutions have typically prevailed, while Convolutional Networks (ConvNets)…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Georgios Pavlakos , Luyang Zhu , Xiaowei Zhou , Kostas Daniilidis

In this paper, we present an end-to-end learning framework for detailed 3D face reconstruction from a single image. Our approach uses a 3DMM-based coarse model and a displacement map in UV-space to represent a 3D face. Unlike previous work…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Yajing Chen , Fanzi Wu , Zeyu Wang , Yibing Song , Yonggen Ling , Linchao Bao