English
Related papers

Related papers: Mesh Guided One-shot Face Reenactment using Graph …

200 papers

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, existing approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Paul Henderson , Vittorio Ferrari

Pose guided synthesis aims to generate a new image in an arbitrary target pose while preserving the appearance details from the source image. Existing approaches rely on either hard-coded spatial transformations or 3D body modeling. They…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Haitian Zheng , Lele Chen , Chenliang Xu , Jiebo Luo

Recently, Deep Convolution Networks (DCNNs) have been applied to the task of face alignment and have shown potential for learning improved feature representations. Although deeper layers can capture abstract concepts like pose, it is…

Computer Vision and Pattern Recognition · Computer Science 2017-04-07 Amit Kumar , Rama Chellappa

3D face reconstruction is a fundamental Computer Vision problem of extraordinary difficulty. Current systems often assume the availability of multiple facial images (sometimes from the same subject) as input, and must address a number of…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Aaron S. Jackson , Adrian Bulat , Vasileios Argyriou , Georgios Tzimiropoulos

This paper presents a face recognition method based on a sequence of images. Face shape is reconstructed from images using a combination of structure-from-motion and multi-view stereo methods. The reconstructed 3D face model is compared…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Jacek Komorowski , Przemyslaw Rokita

3D facial avatar reconstruction has been a significant research topic in computer graphics and computer vision, where photo-realistic rendering and flexible controls over poses and expressions are necessary for many related applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Wangbo Yu , Yanbo Fan , Yong Zhang , Xuan Wang , Fei Yin , Yunpeng Bai , Yan-Pei Cao , Ying Shan , Yang Wu , Zhongqian Sun , Baoyuan Wu

This paper introduces ActGAN - a novel end-to-end generative adversarial network (GAN) for one-shot face reenactment. Given two images, the goal is to transfer the facial expression of the source actor onto a target person in a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Ivan Kosarevych , Marian Petruk , Markian Kostiv , Orest Kupyn , Mykola Maksymenko , Volodymyr Budzan

Animating human face images aims to synthesize a desired source identity in a natural-looking way mimicking a driving video's facial movements. In this context, Generative Adversarial Networks have demonstrated remarkable potential in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Alireza Javanmardi , Alain Pagani , Didier Stricker

In this paper, we present a self-prior-based mesh inpainting framework that requires only an incomplete mesh as input, without the need for any training datasets. Additionally, our method maintains the polygonal mesh format throughout the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Shota Hattori , Tatsuya Yatagawa , Yutaka Ohtake , Hiromasa Suzuki

Sketch-based modeling strives to bring the ease and immediacy of drawing to the 3D world. However, while drawings are easy for humans to create, they are very challenging for computers to interpret due to their sparsity and ambiguity. We…

Graphics · Computer Science 2018-06-20 Johanna Delanoy , Mathieu Aubry , Phillip Isola , Alexei A. Efros , Adrien Bousseau

Monocular vertex-level human-scene contact prediction is a fundamental capability for interactive systems such as assistive monitoring, embodied AI, and rehabilitation analysis. In this work, we study this task jointly with single-image 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xiaojian Lin , Yaomin Shen , Junyuan Ma , Yujie Sun , Chengqing Bu , Wenxin Zhang , Zongzheng Zhang , Hao Fei , Lei Jin , Hao Zhao

An important problem for both graphics and vision is to synthesize novel views of a 3D object from a single image. This is particularly challenging due to the partial observability inherent in projecting a 3D object onto the image space,…

Machine Learning · Computer Science 2016-01-06 Jimei Yang , Scott Reed , Ming-Hsuan Yang , Honglak Lee

In recent years, the role of image generative models in facial reenactment has been steadily increasing. Such models are usually subject-agnostic and trained on domain-wide datasets. The appearance of the reenacted individual is learned…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Ariel Elazary , Yotam Nitzan , Daniel Cohen-Or

This paper presents new designs of graph convolutional neural networks (GCNs) on 3D meshes for 3D object segmentation and classification. We use the faces of the mesh as basic processing units and represent a 3D mesh as a graph where each…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Wenming Tang Guoping Qiu

Depth estimation is a challenging task of 3D reconstruction to enhance the accuracy sensing of environment awareness. This work brings a new solution with a set of improvements, which increase the quantitative and qualitative understanding…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Armin Masoumian , Hatem A. Rashwan , Saddam Abdulwahab , Julian Cristiano , Domenec Puig

Mesh-based learning is one of the popular approaches nowadays to learn shapes. The most established backbone in this field is MeshCNN. In this paper, we propose infusing MeshCNN with geometric reasoning to achieve higher quality learning.…

Graphics · Computer Science 2021-05-28 Amir Barda , Yotam Erel , Amit H. Bermano

The majority of model-based learned image reconstruction methods in medical imaging have been limited to uniform domains, such as pixelated images. If the underlying model is solved on nonuniform meshes, arising from a finite element method…

Image and Video Processing · Electrical Eng. & Systems 2021-07-12 William Herzberg , Daniel B. Rowe , Andreas Hauptmann , Sarah J. Hamilton

With the advances in capturing 2D or 3D skeleton data, skeleton-based action recognition has received an increasing interest over the last years. As skeleton data is commonly represented by graphs, graph convolutional networks have been…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Shijie Li , Jinhui Yi , Yazan Abu Farha , Juergen Gall

Deep learning-based medical image segmentation and surface mesh generation typically involve a sequential pipeline from image to segmentation to meshes, often requiring large training datasets while making limited use of prior geometric…

We propose a novel method for real-time face alignment in videos based on a recurrent encoder-decoder network model. Our proposed model predicts 2D facial point heat maps regularized by both detection and regression loss, while uniquely…

Computer Vision and Pattern Recognition · Computer Science 2018-01-19 Xi Peng , Rogerio S. Feris , Xiaoyu Wang , Dimitris N. Metaxas