English
Related papers

Related papers: Real-Time Monocular 4D Face Reconstruction using t…

200 papers

Reenacting facial images is an important task that can find numerous applications. We proposed IFaceUV, a fully differentiable pipeline that properly combines 2D and 3D information to conduct the facial reenactment task. The…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Hansol Lee , Yunhoe Ku , Eunseo Kim , Seungryul Baek

In this study, we introduce a novel two-stage technique for decomposing and reconstructing facial features from sparse-view images, a task made challenging by the unique geometry and complex skin reflectance of each individual. To…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Daisheng Jin , Jiangbei Hu , Baixin Xu , Yuxin Dai , Chen Qian , Ying He

To overcome the limitations of convolutional neural network in the process of facial expression recognition, a facial expression recognition model Capsule-LSTM based on video frame sequence is proposed. This model is composed of three…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Siwei Liu , Yuanpeng Long , Gao Xu , Lijia Yang , Shimei Xu , Xiaoming Yao , Kunxian Shu

State-of-the-art methods for 3D reconstruction of faces from a single image require 2D-3D pairs of ground-truth data for supervision. Such data is costly to acquire, and most datasets available in the literature are restricted to pairs for…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Yifan Xing , Rahul Tewari , Paulo R. S. Mendonca

In 3D face reconstruction, orthogonal projection has been widely employed to substitute perspective projection to simplify the fitting process. This approximation performs well when the distance between camera and face is far enough.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-05 Yueying Kao , Bowen Pan , Miao Xu , Jiangjing Lyu , Xiangyu Zhu , Yuanzhang Chang , Xiaobo Li , Zhen Lei

We propose FaceVR, a novel image-based method that enables video teleconferencing in VR based on self-reenactment. State-of-the-art face tracking methods in the VR context are focused on the animation of rigged 3d avatars. While they…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Justus Thies , Michael Zollhöfer , Marc Stamminger , Christian Theobalt , Matthias Nießner

This paper describes how to obtain accurate 3D body models and texture of arbitrary people from a single, monocular video in which a person is moving. Based on a parametric body model, we present a robust processing pipeline achieving 3D…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Thiemo Alldieck , Marcus Magnor , Weipeng Xu , Christian Theobalt , Gerard Pons-Moll

Talking face generation (TFG) allows for producing lifelike talking videos of any character using only facial images and accompanying text. Abuse of this technology could pose significant risks to society, creating the urgent need for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xiaocan Chen , Qilin Yin , Jiarui Liu , Wei Lu , Xiangyang Luo , Jiantao Zhou

Single-view 3D face reconstruction is a fundamental Computer Vision problem of extraordinary difficulty. Current systems often assume the input is unobstructed faces which makes their method not suitable for in-the-wild conditions. We…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Dapeng Zhao , Yue Qi

We introduce FaceGPT, a self-supervised learning framework for Large Vision-Language Models (VLMs) to reason about 3D human faces from images and text. Typical 3D face reconstruction methods are specialized algorithms that lack semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Haoran Wang , Mohit Mendiratta , Christian Theobalt , Adam Kortylewski

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

In this paper, we present a large-scale detailed 3D face dataset, FaceScape, and the corresponding benchmark to evaluate single-view facial 3D reconstruction. By training on FaceScape data, a novel algorithm is proposed to predict elaborate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Hao Zhu , Haotian Yang , Longwei Guo , Yidi Zhang , Yanru Wang , Mingkai Huang , Menghua Wu , Qiu Shen , Ruigang Yang , Xun Cao

An authentic face restoration system is becoming increasingly demanding in many computer vision applications, e.g., image enhancement, video communication, and taking portrait. Most of the advanced face restoration models can recover…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yang Zhao , Tingbo Hou , Yu-Chuan Su , Xuhui Jia. Yandong Li , Matthias Grundmann

3D face reconstruction from a single 2D image is a very important topic in computer vision. However, the current reconstruction methods are usually non-sensitive to face identities and over-sensitive to facial poses, which may result in…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Yao Luo , Xiaoguang Tu , Mei Xie

Face recognition now requires a large number of labelled masked face images in the era of this unprecedented COVID-19 pandemic. Unfortunately, the rapid spread of the virus has left us little time to prepare for such dataset in the wild. To…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Je Hyeong Hong , Hanjo Kim , Minsoo Kim , Gi Pyo Nam , Junghyun Cho , Hyeong-Seok Ko , Ig-Jae Kim

While recent works on blind face image restoration have successfully produced impressive high-quality (HQ) images with abundant details from low-quality (LQ) input images, the generated content may not accurately reflect the real appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Chi-Wei Hsiao , Yu-Lun Liu , Cheng-Kun Yang , Sheng-Po Kuo , Kevin Jou , Chia-Ping Chen

We present a novel end-to-end identity-agnostic face reenactment system, MaskRenderer, that can generate realistic, high fidelity frames in real-time. Although recent face reenactment works have shown promising results, there are still…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Tina Behrouzi , Atefeh Shahroudnejad , Payam Mousavi

Fast 3D clothed human reconstruction from monocular video remains a significant challenge in computer vision, particularly in balancing computational efficiency with reconstruction quality. Current approaches are either focused on static…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Matthew Marchellus , Nadhira Noor , In Kyu Park

Over the last years, many face analysis tasks have accomplished astounding performance, with applications including face generation and 3D face reconstruction from a single "in-the-wild" image. Nevertheless, to the best of our knowledge,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Alexandros Lattas , Stylianos Moschoglou , Stylianos Ploumpis , Baris Gecer , Abhijeet Ghosh , Stefanos Zafeiriou

A lifespan face synthesis (LFS) model aims to generate a set of photo-realistic face images of a person's whole life, given only one snapshot as reference. The generated face image given a target age code is expected to be age-sensitive…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Sen He , Wentong Liao , Michael Ying Yang , Yi-Zhe Song , Bodo Rosenhahn , Tao Xiang