English
Related papers

Related papers: Mesh Guided One-shot Face Reenactment using Graph …

200 papers

Video-driven neural face reenactment aims to synthesize realistic facial images that successfully preserve the identity and appearance of a source face, while transferring the target head pose and facial expressions. Existing GAN-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Stella Bounareli , Christos Tzelepis , Vasileios Argyriou , Ioannis Patras , Georgios Tzimiropoulos

Over the past years, a substantial amount of work has been done on the problem of facial reenactment, with the solutions coming mainly from the graphics community. Head reenactment is an even more challenging task, which aims at…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Michail Christos Doukas , Mohammad Rami Koujan , Viktoriia Sharmanska , Stefanos Zafeiriou

We present a 3D-aware one-shot head reenactment method based on a fully volumetric neural disentanglement framework for source appearance and driver expressions. Our method is real-time and produces high-fidelity and view-consistent output,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Phong Tran , Egor Zakharov , Long-Nhat Ho , Anh Tuan Tran , Liwen Hu , Hao Li

We present a novel method for recovering the absolute pose and shape of a human in a pre-scanned scene given a single image. Unlike previous methods that perform sceneaware mesh optimization, we propose to first estimate absolute position…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Zehong Shen , Zhi Cen , Sida Peng , Qing Shuai , Hujun Bao , Xiaowei Zhou

In this paper, we address the problem of reconstructing an object's surface from a single image using generative networks. First, we represent a 3D surface with an aggregation of dense point clouds from multiple views. Each point cloud is…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Jinglu Wang , Bo Sun , Yan Lu

This paper proposes a new end-to-end neural rendering architecture to transfer appearance and reenact human actors. Our method leverages a carefully designed graph convolutional network (GCN) to model the human body manifold structure,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Thiago L. Gomes , Thiago M. Coutinho , Rafael Azevedo , Renato Martins , Erickson R. Nascimento

In this paper, we aim to reconstruct a full 3D human shape from a single image. Previous vertex-level and parameter regression approaches reconstruct 3D human shape based on a pre-defined adjacency matrix to encode positive relations…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Shihao Zhou , Mengxi Jiang , Shanshan Cai , Yunqi Lei

This paper addresses the problem of 3D human pose and shape estimation from a single image. Previous approaches consider a parametric model of the human body, SMPL, and attempt to regress the model parameters that give rise to a mesh…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Nikos Kolotouros , Georgios Pavlakos , Kostas Daniilidis

Reconstructing multi-human body mesh from a single monocular image is an important but challenging computer vision problem. In addition to the individual body mesh models, we need to estimate relative 3D positions among subjects to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Chenyan Wu , Yandong Li , Xianfeng Tang , James Wang

3D Morphable Model (3DMM) based methods have achieved great success in recovering 3D face shapes from single-view images. However, the facial textures recovered by such methods lack the fidelity as exhibited in the input images. Recent work…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiangke Lin , Yi Yuan , Tianjia Shao , Kun Zhou

In this paper, we present GCN-Denoiser, a novel feature-preserving mesh denoising method based on graph convolutional networks (GCNs). Unlike previous learning-based mesh denoising methods that exploit hand-crafted or voxel-based…

Graphics · Computer Science 2023-08-16 Yuefan Shen , Hongbo Fu , Zhongshuo Du , Xiang Chen , Evgeny Burnaev , Denis Zorin , Kun Zhou , Youyi Zheng

Learned 3D representations of human faces are useful for computer vision problems such as 3D face tracking and reconstruction from images, as well as graphics applications such as character generation and animation. Traditional models learn…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Anurag Ranjan , Timo Bolkart , Soubhik Sanyal , Michael J. Black

We propose an image-based, facial reenactment system that replaces the face of an actor in an existing target video with the face of a user from a source video, while preserving the original target performance. Our system is fully automatic…

Computer Vision and Pattern Recognition · Computer Science 2016-02-09 Pablo Garrido , Levi Valgaerts , Ole Rehmsen , Thorsten Thormaehlen , Patrick Perez , Christian Theobalt

Recovering the 3D geometric structure of a face from a single input image is a challenging active research area in computer vision. In this paper, we present a novel method for reconstructing 3D heads from a single or multiple image(s)…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Oussema Bouafif , Bogdan Khomutenko , Mohamed Daoudi

The task of motion transfer between a source dancer and a target person is a special case of the pose transfer problem, in which the target person changes their pose in accordance with the motions of the dancer. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Oran Gafni , Oron Ashual , Lior Wolf

The task of face reenactment is to transfer the head motion and facial expressions from a driving video to the appearance of a source image, which may be of a different person (cross-reenactment). Most existing methods are CNN-based and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Andre Rochow , Max Schwarz , Sven Behnke

Monocular 3D face reconstruction plays a crucial role in avatar generation, with significant demand in web-related applications such as generating virtual financial advisors in FinTech. Current reconstruction methods predominantly rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Haoxin Xu , Zezheng Zhao , Yuxin Cao , Chunyu Chen , Hao Ge , Ziyao Liu

One-shot face recognition measures the ability to identify persons with only seeing them at one glance, and is a hallmark of human visual intelligence. It is challenging for conventional machine learning approaches to mimic this way, since…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Zhengming Ding , Yandong Guo , Lei Zhang , Yun Fu

In this paper, we propose a novel machine learning architecture for facial reenactment. In particular, contrary to the model-based approaches or recent frame-based methods that use Deep Convolutional Neural Networks (DCNNs) to generate…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Mohammad Rami Koujan , Michail Christos Doukas , Anastasios Roussos , Stefanos Zafeiriou

With the powerfulness of convolution neural networks (CNN), CNN based face reconstruction has recently shown promising performance in reconstructing detailed face shape from 2D face images. The success of CNN-based methods relies on a large…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 Yudong Guo , Juyong Zhang , Jianfei Cai , Boyi Jiang , Jianmin Zheng