English
Related papers

Related papers: Mesh Guided One-shot Face Reenactment using Graph …

200 papers

In recent advances of deep generative models, face reenactment -manipulating and controlling human face, including their head movement-has drawn much attention for its wide range of applicability. Despite its strong expressiveness, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Takuya Yashima , Takuya Narihira , Tamaki Kojima

Mesh denoising is a critical technology in geometry processing that aims to recover high-fidelity 3D mesh models of objects from their noise-corrupted versions. In this work, we propose a learning-based normal filtering scheme for mesh…

Graphics · Computer Science 2019-11-15 Wenbo Zhao , Xianming Liu , Yongsen Zhao , Xiaopeng Fan , Debin Zhao

This paper proposes an encoder-decoder network to disentangle shape features during 3D face reconstruction from single 2D images, such that the tasks of reconstructing accurate 3D face shapes and learning discriminative shape features for…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Feng Liu , Ronghang Zhu , Dan Zeng , Qijun Zhao , Xiaoming Liu

Most of the recent deep learning-based 3D human pose and mesh estimation methods regress the pose and shape parameters of human mesh models, such as SMPL and MANO, from an input image. The first weakness of these methods is an appearance…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Hongsuk Choi , Gyeongsik Moon , Kyoung Mu Lee

Facial motion retargeting is an important problem in both computer graphics and vision, which involves capturing the performance of a human face and transferring it to another 3D character. Learning 3D morphable model (3DMM) parameters from…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Bindita Chaudhuri , Noranart Vesdapunt , Baoyuan Wang

We present a self-supervised learning approach to learning monocular 3D face reconstruction with a pose guidance network (PGN). First, we unveil the bottleneck of pose estimation in prior parametric 3D face learning methods, and propose to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Pengpeng Liu , Xintong Han , Michael Lyu , Irwin King , Jia Xu

Reconstructing the 3D mesh of a general object from a single image is now possible thanks to the latest advances of deep learning technologies. However, due to the nontrivial difficulty of generating a feasible mesh structure, the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Junyi Pan , Xiaoguang Han , Weikai Chen , Jiapeng Tang , Kui Jia

We present a new multi-stream 3D mesh reconstruction network (MSMR-Net) for hand pose estimation from a single RGB image. Our model consists of an image encoder followed by a mesh-convolution decoder composed of connected graph convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Uri Wollner , Guy Ben-Yosef

We address the problem of recovering the 3D geometry of a human face from a set of facial images in multiple views. While recent studies have shown impressive progress in 3D Morphable Model (3DMM) based facial reconstruction, the settings…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Fanzi Wu , Linchao Bao , Yajing Chen , Yonggen Ling , Yibing Song , Songnan Li , King Ngi Ngan , Wei Liu

In this study, we propose a method for video face reenactment that integrates a 3D face parametric model into a latent diffusion framework, aiming to improve shape consistency and motion control in existing video-based face generation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Mengting Wei , Yante Li , Tuomas Varanka , Yan Jiang , Guoying Zhao

We propose a method for reconstructing 3D shapes from 2D sketches in the form of line drawings. Our method takes as input a single sketch, or multiple sketches, and outputs a dense point cloud representing a 3D reconstruction of the input…

Computer Vision and Pattern Recognition · Computer Science 2017-10-02 Zhaoliang Lun , Matheus Gadelha , Evangelos Kalogerakis , Subhransu Maji , Rui Wang

Realistic speech-driven 3D facial animation is a challenging problem due to the complex relationship between speech and face. In this paper, we propose a deep architecture, called Geometry-guided Dense Perspective Network (GDPnet), to…

Graphics · Computer Science 2020-08-25 Jingying Liu , Binyuan Hui , Kun Li , Yunke Liu , Yu-Kun Lai , Yuxiang Zhang , Yebin Liu , Jingyu Yang

In this paper, we propose a novel multi-level aggregation network to regress the coordinates of the vertices of a 3D face from a single 2D image in an end-to-end manner. This is achieved by seamlessly combining standard convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Yanda Meng , Xu Chen , Dongxu Gao , Yitian Zhao , Xiaoyun Yang , Yihong Qiao , Xiaowei Huang , Yalin Zheng

One challenge that remains open in 3D deep learning is how to efficiently represent 3D data to feed deep networks. Recent works have relied on volumetric or point cloud representations, but such approaches suffer from a number of issues…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Jhony K. Pontes , Chen Kong , Sridha Sridharan , Simon Lucey , Anders Eriksson , Clinton Fookes

A lot of work has been done towards reconstructing the 3D facial structure from single images by capitalizing on the power of Deep Convolutional Neural Networks (DCNNs). In the recent works, the texture features either correspond to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Baris Gecer , Stylianos Ploumpis , Irene Kotsia , Stefanos Zafeiriou

The ability to estimate the 3D human shape and pose from images can be useful in many contexts. Recent approaches have explored using graph convolutional networks and achieved promising results. The fact that the 3D shape is represented by…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Xin Yu , Jeroen van Baar , Siheng Chen

Recent attempts to solve the problem of head reenactment using a single reference image have shown promising results. However, most of them either perform poorly in terms of photo-realism, or fail to meet the identity preservation problem,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Michail Christos Doukas , Stefanos Zafeiriou , Viktoriia Sharmanska

This paper proposes an approach to learn generic multi-modal mesh surface representations using a novel scheme for fusing texture and geometric data. Our approach defines an inverse mapping between different geometric descriptors computed…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Bilal Taha , Munawar Hayat , Stefano Berretti , Naoufel Werghi

As a structured representation of the image content, the visual scene graph (visual relationship) acts as a bridge between computer vision and natural language processing. Existing models on the scene graph generation task notoriously…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Yuyu Guo , Jingkuan Song , Lianli Gao , Heng Tao Shen

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Paul Henderson , Vittorio Ferrari