English
Related papers

Related papers: Creating and Reenacting Controllable 3D Humans wit…

200 papers

We present a novel learning-based framework for face reenactment. The proposed method, known as ReenactGAN, is capable of transferring facial movements and expressions from monocular video input of an arbitrary person to a target person.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Wayne Wu , Yunxuan Zhang , Cheng Li , Chen Qian , Chen Change Loy

Unsupervised generation of 3D-aware clothed humans with various appearances and controllable geometries is important for creating virtual human avatars and other AR/VR applications. Existing methods are either limited to rigid object…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

A lot of work has been done towards reconstructing the 3D facial structure from single images by capitalizing on the power of Deep Convolutional Neural Networks (DCNNs). In the recent works, the texture features either correspond to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Baris Gecer , Stylianos Ploumpis , Irene Kotsia , Stefanos Zafeiriou

We propose a new method for learning a generalized animatable neural human representation from a sparse set of multi-view imagery of multiple persons. The learned representation can be used to synthesize novel view images of an arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Yiming Wang , Qingzhe Gao , Libin Liu , Lingjie Liu , Christian Theobalt , Baoquan Chen

Recognizing human actions in untrimmed videos is an important challenging task. An effective 3D motion representation and a powerful learning model are two key factors influencing recognition performance. In this paper we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Huy-Hieu Pham , Louahdi Khoudour , Alain Crouzil , Pablo Zegers , Sergio A. Velastin

3D textured face reconstruction from sketches applicable in many scenarios such as animation, 3D avatars, artistic design, missing people search, etc., is a highly promising but underdeveloped research topic. On the one hand, the stylistic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Zidu Wang , Xiangyu Zhu , Jiang Yu , Tianshuo Zhang , Zhen Lei

We propose CrossHuman, a novel method that learns cross-guidance from parametric human model and multi-frame RGB images to achieve high-quality 3D human reconstruction. To recover geometry details and texture even in invisible regions, we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Liliang Chen , Jiaqi Li , Han Huang , Yandong Guo

This paper addresses the challenge of reconstructing an animatable human model from a multi-view video. Some recent works have proposed to decompose a non-rigidly deforming scene into a canonical neural radiance field and a set of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Sida Peng , Zhen Xu , Junting Dong , Qianqian Wang , Shangzhan Zhang , Qing Shuai , Hujun Bao , Xiaowei Zhou

We present a novel approach that enables photo-realistic re-animation of portrait videos using only an input video. In contrast to existing approaches that are restricted to manipulations of facial expressions only, we are the first to…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Hyeongwoo Kim , Pablo Garrido , Ayush Tewari , Weipeng Xu , Justus Thies , Matthias Nießner , Patrick Pérez , Christian Richardt , Michael Zollhöfer , Christian Theobalt

This paper describes how to obtain accurate 3D body models and texture of arbitrary people from a single, monocular video in which a person is moving. Based on a parametric body model, we present a robust processing pipeline achieving 3D…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Thiemo Alldieck , Marcus Magnor , Weipeng Xu , Christian Theobalt , Gerard Pons-Moll

In the past few years, a lot of work has been done towards reconstructing the 3D facial structure from single images by capitalizing on the power of Deep Convolutional Neural Networks (DCNNs). In the most recent works, differentiable…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Baris Gecer , Stylianos Ploumpis , Irene Kotsia , Stefanos Zafeiriou

We present a new pose transfer method for synthesizing a human animation from a single image of a person controlled by a sequence of body poses. Existing pose transfer methods exhibit significant visual artifacts when applying to a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Jae Shin Yoon , Lingjie Liu , Vladislav Golyanik , Kripasindhu Sarkar , Hyun Soo Park , Christian Theobalt

Human motion prediction is a challenging task due to the stochasticity and aperiodicity of future poses. Recently, graph convolutional network has been proven to be very effective to learn dynamic relations among pose joints, which is…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Lingwei Dang , Yongwei Nie , Chengjiang Long , Qing Zhang , Guiqing Li

Human imitation has become topical recently, driven by GAN's ability to disentangle human pose and body content. However, the latest methods hardly focus on 3D information, and to avoid self-occlusion, a massive amount of input images are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Haoxi Ran , Guangfu Wang , Li Lu

Geometry- and appearance-controlled full-body human image generation is an interesting but challenging task. Existing solutions are either unconditional or dependent on coarse conditions (e.g., pose, text), thus lacking explicit geometry…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Linzi Qu , Jiaxiang Shang , Hui Ye , Xiaoguang Han , Hongbo Fu

Generating high-quality and diverse human images is an important yet challenging task in vision and graphics. However, existing generative models often fall short under the high diversity of clothing shapes and textures. Furthermore, the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Yuming Jiang , Shuai Yang , Haonan Qiu , Wayne Wu , Chen Change Loy , Ziwei Liu

Holistic 3D human-scene reconstruction is a crucial and emerging research area in robot perception. A key challenge in holistic 3D human-scene reconstruction is to generate a physically plausible 3D scene from a single monocular RGB image.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Sandika Biswas , Kejie Li , Biplab Banerjee , Subhasis Chaudhuri , Hamid Rezatofighi

The task of reconstructing detailed 3D human body models from images is interesting but challenging in computer vision due to the high freedom of human bodies. In order to tackle the problem, we propose a coarse-to-fine method to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Zhongguo Li , Magnus Oskarsson , Anders Heyden

In recent advances of deep generative models, face reenactment -manipulating and controlling human face, including their head movement-has drawn much attention for its wide range of applicability. Despite its strong expressiveness, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Takuya Yashima , Takuya Narihira , Tamaki Kojima

Reconstructing the detailed geometric structure of a face from a given image is a key to many computer vision and graphics applications, such as motion capture and reenactment. The reconstruction task is challenging as human faces vary…

Computer Vision and Pattern Recognition · Computer Science 2017-04-07 Elad Richardson , Matan Sela , Roy Or-El , Ron Kimmel