English
Related papers

Related papers: Neural Re-Rendering of Humans from a Single Image

200 papers

We propose a scalable neural network framework to reconstruct the 3D mesh of a human body from multi-view images, in the subspace of the SMPL model. Use of multi-view images can significantly reduce the projection ambiguity of the problem,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Junbang Liang , Ming C. Lin

This work addresses the problem of model-based human pose estimation. Recent approaches have made significant progress towards regressing the parameters of parametric human body models directly from images. Because of the absence of images…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Georgios Pavlakos , Nikos Kolotouros , Kostas Daniilidis

Person re identification is a challenging retrieval task that requires matching a person's acquired image across non overlapping camera views. In this paper we propose an effective approach that incorporates both the fine and coarse pose…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 M. Saquib Sarfraz , Arne Schumann , Andreas Eberle , Rainer Stiefelhagen

Realistic reconstruction of 3D clothing from an image has wide applications, such as avatar creation and virtual try-on. This paper presents a novel framework that reconstructs the texture map for 3D garments from a single image with pose.…

Graphics · Computer Science 2023-10-27 Hyun-Song Kwon , Sung-Hee Lee

In this paper, we present a learning-based approach for recovering the 3D geometry of human head from a single portrait image. Our method is learned in an unsupervised manner without any ground-truth 3D data. We represent the head geometry…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Sicheng Xu , Jiaolong Yang , Dong Chen , Fang Wen , Yu Deng , Yunde Jia , Xin Tong

3D representation and reconstruction of human bodies have been studied for a long time in computer vision. Traditional methods rely mostly on parametric statistical linear models, limiting the space of possible bodies to linear…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Sandro Lombardi , Bangbang Yang , Tianxing Fan , Hujun Bao , Guofeng Zhang , Marc Pollefeys , Zhaopeng Cui

3D content creation is referred to as one of the most fundamental tasks of computer graphics. And many 3D modeling algorithms from 2D images or curves have been developed over the past several decades. Designers are allowed to align some…

Graphics · Computer Science 2018-06-25 Zhongping Ji , Xiao Qi , Yigang Wang , Gang Xu , Peng Du , Qing Wu

We present a novel paradigm of building an animatable 3D human representation from a monocular video input, such that it can be rendered in any unseen poses and views. Our method is based on a dynamic Neural Radiance Field (NeRF) rigged by…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Gusi Te , Xiu Li , Xiao Li , Jinglu Wang , Wei Hu , Yan Lu

An emerging problem in computer vision is the reconstruction of 3D shape and pose of an object from a single image. Hitherto, the problem has been addressed through the application of canonical deep learning methods to regress from the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Rui Zhu , Hamed Kiani Galoogahi , Chaoyang Wang , Simon Lucey

We present a learning-based model to infer the personalized 3D shape of people from a few frames (1-8) of a monocular video in which the person is moving, in less than 10 seconds with a reconstruction accuracy of 5mm. Our model learns to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Thiemo Alldieck , Marcus Magnor , Bharat Lal Bhatnagar , Christian Theobalt , Gerard Pons-Moll

We address the problem of reposing an image of a human into any desired novel pose. This conditional image-generation task requires reasoning about the 3D structure of the human, including self-occluded body parts. Most prior works are…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Markus Knoche , István Sárándi , Bastian Leibe

In this work, we present an automated workflow to bring human figures, one of the most frequently appearing entities on pictorial maps, to the third dimension. Our workflow is based on training data and neural networks for single-view 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Raimund Schnürer , A. Cengiz Öztireli , Magnus Heitzler , René Sieber , Lorenz Hurni

We present an algorithm for re-rendering a person from a single image under arbitrary poses. Existing methods often have difficulties in hallucinating occluded contents photo-realistically while preserving the identity and fine details in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Badour AlBahar , Jingwan Lu , Jimei Yang , Zhixin Shu , Eli Shechtman , Jia-Bin Huang

We propose a neural rendering-based system that creates head avatars from a single photograph. Our approach models a person's appearance by decomposing it into two layers. The first layer is a pose-dependent coarse image that is synthesized…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Egor Zakharov , Aleksei Ivakhnenko , Aliaksandra Shysheya , Victor Lempitsky

We present a novel method for reconstructing clothed humans from a sparse set of, e.g., 1 to 6 RGB images. Despite impressive results from recent works employing deep implicit representation, we revisit the volumetric approach and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Sicong Tang , Guangyuan Wang , Qing Ran , Lingzhi Li , Li Shen , Ping Tan

We present a novel framework to reconstruct complete 3D human shapes from a given target image by leveraging monocular unconstrained images. The objective of this work is to reproduce high-quality details in regions of the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Marco Pesavento , Marco Volino , Adrian Hilton

We propose a new method for learning a generalized animatable neural human representation from a sparse set of multi-view imagery of multiple persons. The learned representation can be used to synthesize novel view images of an arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Yiming Wang , Qingzhe Gao , Libin Liu , Lingjie Liu , Christian Theobalt , Baoquan Chen

Inferring 3D human pose from 2D images is a challenging and long-standing problem in the field of computer vision with many applications including motion capture, virtual reality, surveillance or gait analysis for sports and medicine. We…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Luca Schmidtke , Benjamin Hou , Athanasios Vlontzos , Bernhard Kainz

Our work focuses on the development of a learnable neural representation of human pose for advanced AI assisted animation tooling. Specifically, we tackle the problem of constructing a full static human pose based on sparse and variable…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Boris N. Oreshkin , Florent Bocquelet , Félix G. Harvey , Bay Raitt , Dominic Laflamme

3D human shape and pose estimation from monocular images has been an active area of research in computer vision, having a substantial impact on the development of new applications, from activity recognition to creating virtual avatars.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Xiangyu Xu , Hao Chen , Francesc Moreno-Noguer , Laszlo A. Jeni , Fernando De la Torre